Class cascading.pipe.checkpoint.CheckpointPlatformTest

all > cascading.pipe.checkpoint > CheckpointPlatformTest
8

tests
0

failures
0

ignored
4m59.96s

duration
100%

successful

Tests

Test Duration Result
testDuplicateCheckpoint 0.019s passed
testFailCheckpoint 0.022s passed
testFailCheckpointBeforeEvery 0.038s passed
testFailCheckpointDeclaredFields 0.017s passed
testManyCheckpoints 1m39.08s passed
testRestartCheckpoint 2m1.81s passed
testSimpleCheckpoint 37.129s passed
testSimpleCheckpointTextIntermediate 41.851s passed

Standard output

2015-02-12 12:04:14,931 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-12 12:04:14,969 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-02-12 12:04:14,969 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.pipe.checkpoint.CheckpointPlatformTest
2015-02-12 12:04:14,987 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(117)) - using cluster
2015-02-12 12:04:16,114 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-02-12 12:04:16,200 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(776)) - No KeyProvider found.
2015-02-12 12:04:16,235 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(788)) - fsLock is fair:true
2015-02-12 12:04:16,310 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
2015-02-12 12:04:16,311 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(232)) - dfs.block.invalidate.limit=1000
2015-02-12 12:04:16,311 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(238)) - dfs.namenode.datanode.registration.ip-hostname-check=true
2015-02-12 12:04:16,313 INFO  blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(71)) - dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
2015-02-12 12:04:16,314 INFO  blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(76)) - The block deletion will start around 2015 Feb 12 12:04:16
2015-02-12 12:04:16,316 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlocksMap
2015-02-12 12:04:16,316 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:16,318 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 2.0% max memory 672 MB = 13.4 MB
2015-02-12 12:04:16,319 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^21 = 2097152 entries
2015-02-12 12:04:16,339 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(364)) - dfs.block.access.token.enable=false
2015-02-12 12:04:16,340 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(349)) - defaultReplication         = 3
2015-02-12 12:04:16,340 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(350)) - maxReplication             = 512
2015-02-12 12:04:16,341 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(351)) - minReplication             = 1
2015-02-12 12:04:16,341 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(352)) - maxReplicationStreams      = 2
2015-02-12 12:04:16,342 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(353)) - shouldCheckForEnoughRacks  = false
2015-02-12 12:04:16,345 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(354)) - replicationRecheckInterval = 3000
2015-02-12 12:04:16,345 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(355)) - encryptDataTransfer        = false
2015-02-12 12:04:16,346 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(356)) - maxNumBlocksToLog          = 1000
2015-02-12 12:04:16,355 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(811)) - fsOwner             = soberoi (auth:SIMPLE)
2015-02-12 12:04:16,356 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(812)) - supergroup          = supergroup
2015-02-12 12:04:16,356 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(813)) - isPermissionEnabled = true
2015-02-12 12:04:16,360 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(824)) - HA Enabled: false
2015-02-12 12:04:16,363 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(861)) - Append Enabled: true
2015-02-12 12:04:16,610 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map INodeMap
2015-02-12 12:04:16,611 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:16,612 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 1.0% max memory 672 MB = 6.7 MB
2015-02-12 12:04:16,613 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^20 = 1048576 entries
2015-02-12 12:04:16,614 INFO  namenode.NameNode (FSDirectory.java:<init>(234)) - Caching file names occuring more than 10 times
2015-02-12 12:04:16,624 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map cachedBlocks
2015-02-12 12:04:16,625 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:16,632 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.25% max memory 672 MB = 1.7 MB
2015-02-12 12:04:16,634 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^18 = 262144 entries
2015-02-12 12:04:16,657 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5666)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-02-12 12:04:16,658 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5667)) - dfs.namenode.safemode.min.datanodes = 0
2015-02-12 12:04:16,659 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5668)) - dfs.namenode.safemode.extension     = 0
2015-02-12 12:04:16,660 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(959)) - Retry cache on namenode is enabled
2015-02-12 12:04:16,661 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(967)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-02-12 12:04:16,664 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map NameNodeRetryCache
2015-02-12 12:04:16,666 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:16,667 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.029999999329447746% max memory 672 MB = 206.4 KB
2015-02-12 12:04:16,667 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^15 = 32768 entries
2015-02-12 12:04:16,675 INFO  namenode.NNConf (NNConf.java:<init>(62)) - ACLs enabled? false
2015-02-12 12:04:16,676 INFO  namenode.NNConf (NNConf.java:<init>(66)) - XAttrs enabled? true
2015-02-12 12:04:16,677 INFO  namenode.NNConf (NNConf.java:<init>(74)) - Maximum size of an xattr: 16384
2015-02-12 12:04:16,793 INFO  namenode.FSImage (FSImage.java:format(145)) - Allocated new BlockPoolId: BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:16,821 INFO  common.Storage (NNStorage.java:format(552)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/name1 has been successfully formatted.
2015-02-12 12:04:16,837 INFO  common.Storage (NNStorage.java:format(552)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/name2 has been successfully formatted.
2015-02-12 12:04:16,997 INFO  namenode.NNStorageRetentionManager (NNStorageRetentionManager.java:getImageTxIdToRetain(203)) - Going to retain 1 images with txid >= 0
2015-02-12 12:04:16,999 INFO  namenode.NameNode (NameNode.java:createNameNode(1367)) - createNameNode []
2015-02-12 12:04:17,029 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-02-12 12:04:17,118 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(376)) - Scheduled snapshot period at 10 second(s).
2015-02-12 12:04:17,119 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:start(191)) - NameNode metrics system started
2015-02-12 12:04:17,121 INFO  namenode.NameNode (NameNode.java:setClientNamenodeAddress(349)) - fs.defaultFS is hdfs://127.0.0.1:0
2015-02-12 12:04:17,178 INFO  hdfs.DFSUtil (DFSUtil.java:httpServerTemplateForNNAndJN(1694)) - Starting Web-server for hdfs at: http://localhost:0
2015-02-12 12:04:17,244 INFO  mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-02-12 12:04:17,250 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.namenode is not defined
2015-02-12 12:04:17,284 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(699)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 12:04:17,293 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
2015-02-12 12:04:17,294 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 12:04:17,295 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 12:04:17,337 INFO  http.HttpServer2 (NameNodeHttpServer.java:initWebHdfs(86)) - Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
2015-02-12 12:04:17,344 INFO  http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(603)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 12:04:17,367 INFO  http.HttpServer2 (HttpServer2.java:openListeners(887)) - Jetty bound to port 55501
2015-02-12 12:04:17,368 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
2015-02-12 12:04:17,436 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.6.0.2.2.0.0-2041/4318f06dbd560179ace6e74d21eae12ac75d8328/hadoop-hdfs-2.6.0.2.2.0.0-2041-tests.jar!/webapps/hdfs to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_55501_hdfs____dyctfk/webapp
2015-02-12 12:04:17,740 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55501
2015-02-12 12:04:17,747 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(776)) - No KeyProvider found.
2015-02-12 12:04:17,748 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(788)) - fsLock is fair:true
2015-02-12 12:04:17,749 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(232)) - dfs.block.invalidate.limit=1000
2015-02-12 12:04:17,749 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(238)) - dfs.namenode.datanode.registration.ip-hostname-check=true
2015-02-12 12:04:17,750 INFO  blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(71)) - dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
2015-02-12 12:04:17,751 INFO  blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(76)) - The block deletion will start around 2015 Feb 12 12:04:17
2015-02-12 12:04:17,751 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlocksMap
2015-02-12 12:04:17,752 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:17,752 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 2.0% max memory 672 MB = 13.4 MB
2015-02-12 12:04:17,752 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^21 = 2097152 entries
2015-02-12 12:04:17,768 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(364)) - dfs.block.access.token.enable=false
2015-02-12 12:04:17,769 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(349)) - defaultReplication         = 3
2015-02-12 12:04:17,770 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(350)) - maxReplication             = 512
2015-02-12 12:04:17,770 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(351)) - minReplication             = 1
2015-02-12 12:04:17,770 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(352)) - maxReplicationStreams      = 2
2015-02-12 12:04:17,771 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(353)) - shouldCheckForEnoughRacks  = false
2015-02-12 12:04:17,771 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(354)) - replicationRecheckInterval = 3000
2015-02-12 12:04:17,771 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(355)) - encryptDataTransfer        = false
2015-02-12 12:04:17,772 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(356)) - maxNumBlocksToLog          = 1000
2015-02-12 12:04:17,772 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(811)) - fsOwner             = soberoi (auth:SIMPLE)
2015-02-12 12:04:17,772 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(812)) - supergroup          = supergroup
2015-02-12 12:04:17,773 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(813)) - isPermissionEnabled = true
2015-02-12 12:04:17,773 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(824)) - HA Enabled: false
2015-02-12 12:04:17,774 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(861)) - Append Enabled: true
2015-02-12 12:04:17,774 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map INodeMap
2015-02-12 12:04:17,774 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:17,775 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 1.0% max memory 672 MB = 6.7 MB
2015-02-12 12:04:17,776 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^20 = 1048576 entries
2015-02-12 12:04:17,777 INFO  namenode.NameNode (FSDirectory.java:<init>(234)) - Caching file names occuring more than 10 times
2015-02-12 12:04:17,777 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map cachedBlocks
2015-02-12 12:04:17,777 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:17,778 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.25% max memory 672 MB = 1.7 MB
2015-02-12 12:04:17,778 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^18 = 262144 entries
2015-02-12 12:04:17,778 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5666)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-02-12 12:04:17,779 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5667)) - dfs.namenode.safemode.min.datanodes = 0
2015-02-12 12:04:17,779 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5668)) - dfs.namenode.safemode.extension     = 0
2015-02-12 12:04:17,779 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(959)) - Retry cache on namenode is enabled
2015-02-12 12:04:17,780 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(967)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-02-12 12:04:17,780 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map NameNodeRetryCache
2015-02-12 12:04:17,780 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:17,781 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.029999999329447746% max memory 672 MB = 206.4 KB
2015-02-12 12:04:17,781 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^15 = 32768 entries
2015-02-12 12:04:17,783 INFO  namenode.NNConf (NNConf.java:<init>(62)) - ACLs enabled? false
2015-02-12 12:04:17,783 INFO  namenode.NNConf (NNConf.java:<init>(66)) - XAttrs enabled? true
2015-02-12 12:04:17,783 INFO  namenode.NNConf (NNConf.java:<init>(74)) - Maximum size of an xattr: 16384
2015-02-12 12:04:17,787 INFO  common.Storage (Storage.java:tryLock(715)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/name1/in_use.lock acquired by nodename 74414@Edinburgh.local
2015-02-12 12:04:17,789 INFO  common.Storage (Storage.java:tryLock(715)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/name2/in_use.lock acquired by nodename 74414@Edinburgh.local
2015-02-12 12:04:17,792 INFO  namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(362)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/name1/current
2015-02-12 12:04:17,792 INFO  namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(362)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/name2/current
2015-02-12 12:04:17,793 INFO  namenode.FSImage (FSImage.java:loadFSImage(656)) - No edit log streams selected.
2015-02-12 12:04:17,813 INFO  namenode.FSImageFormatPBINode (FSImageFormatPBINode.java:loadINodeSection(214)) - Loading 1 INodes.
2015-02-12 12:04:17,820 INFO  namenode.FSImageFormatProtobuf (FSImageFormatProtobuf.java:load(182)) - Loaded FSImage in 0 seconds.
2015-02-12 12:04:17,820 INFO  namenode.FSImage (FSImage.java:loadFSImage(937)) - Loaded image for txid 0 from /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/name1/current/fsimage_0000000000000000000
2015-02-12 12:04:17,824 INFO  namenode.FSNamesystem (FSNamesystem.java:loadFSImage(1029)) - Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
2015-02-12 12:04:17,825 INFO  namenode.FSEditLog (FSEditLog.java:startLogSegment(1173)) - Starting log segment at 1
2015-02-12 12:04:17,849 INFO  namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2015-02-12 12:04:17,849 INFO  namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(748)) - Finished loading FSImage in 65 msecs
2015-02-12 12:04:18,022 INFO  namenode.NameNode (NameNodeRpcServer.java:<init>(329)) - RPC server is binding to localhost:0
2015-02-12 12:04:18,027 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:18,039 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55518
2015-02-12 12:04:18,072 INFO  namenode.NameNode (NameNode.java:initialize(603)) - Clients are to use localhost:55518 to access this namenode/service.
2015-02-12 12:04:18,076 INFO  namenode.FSNamesystem (FSNamesystem.java:registerMBean(6645)) - Registered FSNamesystemState MBean
2015-02-12 12:04:18,095 INFO  namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(6256)) - Number of blocks under construction: 0
2015-02-12 12:04:18,095 INFO  namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(6256)) - Number of blocks under construction: 0
2015-02-12 12:04:18,095 INFO  namenode.FSNamesystem (FSNamesystem.java:initializeReplQueues(1221)) - initializing replication queues
2015-02-12 12:04:18,096 INFO  hdfs.StateChange (FSNamesystem.java:leave(5740)) - STATE* Leaving safe mode after 0 secs
2015-02-12 12:04:18,096 INFO  hdfs.StateChange (FSNamesystem.java:leave(5751)) - STATE* Network topology has 0 racks and 0 datanodes
2015-02-12 12:04:18,096 INFO  hdfs.StateChange (FSNamesystem.java:leave(5754)) - STATE* UnderReplicatedBlocks has 0 blocks
2015-02-12 12:04:18,098 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2612)) - Total number of blocks            = 0
2015-02-12 12:04:18,099 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2613)) - Number of invalid blocks          = 0
2015-02-12 12:04:18,099 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2614)) - Number of under-replicated blocks = 0
2015-02-12 12:04:18,099 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2615)) - Number of  over-replicated blocks = 0
2015-02-12 12:04:18,099 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2617)) - Number of blocks being written    = 0
2015-02-12 12:04:18,099 INFO  hdfs.StateChange (BlockManager.java:processMisReplicatesAsync(2618)) - STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 3 msec
2015-02-12 12:04:18,119 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:18,119 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55518: starting
2015-02-12 12:04:18,121 INFO  namenode.NameNode (NameNode.java:startCommonServices(646)) - NameNode RPC up at: localhost/127.0.0.1:55518
2015-02-12 12:04:18,122 INFO  namenode.FSNamesystem (FSNamesystem.java:startActiveServices(1142)) - Starting services required for active state
2015-02-12 12:04:18,126 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(160)) - Starting CacheReplicationMonitor with interval 30000 milliseconds
2015-02-12 12:04:18,126 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 1423771458126 milliseconds
2015-02-12 12:04:18,127 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(201)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 12:04:18,167 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1407)) - Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2
2015-02-12 12:04:18,220 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(158)) - DataNode metrics system started (again)
2015-02-12 12:04:18,221 INFO  datanode.DataNode (DataNode.java:<init>(414)) - Configured hostname is 127.0.0.1
2015-02-12 12:04:18,225 INFO  datanode.DataNode (DataNode.java:startDataNode(1049)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 12:04:18,230 INFO  datanode.DataNode (DataNode.java:initDataXceiver(848)) - Opened streaming server at /127.0.0.1:55519
2015-02-12 12:04:18,232 INFO  datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 12:04:18,232 INFO  datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 12:04:18,236 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 12:04:18,237 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(699)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 12:04:18,239 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 12:04:18,239 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 12:04:18,239 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 12:04:18,244 INFO  http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(603)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 12:04:18,245 INFO  http.HttpServer2 (HttpServer2.java:openListeners(887)) - Jetty bound to port 55520
2015-02-12 12:04:18,245 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
2015-02-12 12:04:18,249 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.6.0.2.2.0.0-2041/4318f06dbd560179ace6e74d21eae12ac75d8328/hadoop-hdfs-2.6.0.2.2.0.0-2041-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_55520_datanode____u7n0fu/webapp
2015-02-12 12:04:18,409 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55520
2015-02-12 12:04:18,411 INFO  datanode.DataNode (DataNode.java:startDataNode(1066)) - dnUserName = soberoi
2015-02-12 12:04:18,411 INFO  datanode.DataNode (DataNode.java:startDataNode(1067)) - supergroup = supergroup
2015-02-12 12:04:18,420 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:18,421 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55521
2015-02-12 12:04:18,427 INFO  datanode.DataNode (DataNode.java:initIpcServer(723)) - Opened IPC server at /127.0.0.1:55521
2015-02-12 12:04:18,436 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 12:04:18,440 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 12:04:18,447 INFO  datanode.DataNode (BPServiceActor.java:run(821)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:55518 starting to offer service
2015-02-12 12:04:18,454 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:18,455 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55521: starting
2015-02-12 12:04:18,459 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1407)) - Starting DataNode 1 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4
2015-02-12 12:04:18,499 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(158)) - DataNode metrics system started (again)
2015-02-12 12:04:18,500 INFO  datanode.DataNode (DataNode.java:<init>(414)) - Configured hostname is 127.0.0.1
2015-02-12 12:04:18,500 INFO  datanode.DataNode (DataNode.java:startDataNode(1049)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 12:04:18,501 INFO  datanode.DataNode (DataNode.java:initDataXceiver(848)) - Opened streaming server at /127.0.0.1:55522
2015-02-12 12:04:18,501 INFO  datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 12:04:18,502 INFO  datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 12:04:18,503 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 12:04:18,504 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(699)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 12:04:18,505 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 12:04:18,505 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 12:04:18,506 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 12:04:18,508 INFO  http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(603)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 12:04:18,509 INFO  http.HttpServer2 (HttpServer2.java:openListeners(887)) - Jetty bound to port 55523
2015-02-12 12:04:18,509 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
2015-02-12 12:04:18,512 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.6.0.2.2.0.0-2041/4318f06dbd560179ace6e74d21eae12ac75d8328/hadoop-hdfs-2.6.0.2.2.0.0-2041-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_55523_datanode____fnl2t9/webapp
2015-02-12 12:04:18,668 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55523
2015-02-12 12:04:18,669 INFO  datanode.DataNode (DataNode.java:startDataNode(1066)) - dnUserName = soberoi
2015-02-12 12:04:18,669 INFO  datanode.DataNode (DataNode.java:startDataNode(1067)) - supergroup = supergroup
2015-02-12 12:04:18,670 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:18,671 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55525
2015-02-12 12:04:18,674 INFO  datanode.DataNode (DataNode.java:initIpcServer(723)) - Opened IPC server at /127.0.0.1:55525
2015-02-12 12:04:18,677 INFO  common.Storage (DataStorage.java:recoverTransitionRead(399)) - DataNode version: -56 and NameNode layout version: -60
2015-02-12 12:04:18,678 INFO  common.Storage (Storage.java:tryLock(715)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/in_use.lock acquired by nodename 74414@Edinburgh.local
2015-02-12 12:04:18,679 INFO  common.Storage (DataStorage.java:addStorageLocations(281)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1 is not formatted for BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,679 INFO  common.Storage (DataStorage.java:addStorageLocations(283)) - Formatting ...
2015-02-12 12:04:18,680 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 12:04:18,680 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 12:04:18,680 INFO  common.Storage (Storage.java:tryLock(715)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/in_use.lock acquired by nodename 74414@Edinburgh.local
2015-02-12 12:04:18,680 INFO  common.Storage (DataStorage.java:addStorageLocations(281)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2 is not formatted for BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,681 INFO  common.Storage (DataStorage.java:addStorageLocations(283)) - Formatting ...
2015-02-12 12:04:18,682 INFO  datanode.DataNode (BPServiceActor.java:run(821)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:55518 starting to offer service
2015-02-12 12:04:18,682 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55525: starting
2015-02-12 12:04:18,682 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:18,686 INFO  common.Storage (DataStorage.java:recoverTransitionRead(399)) - DataNode version: -56 and NameNode layout version: -60
2015-02-12 12:04:18,687 INFO  common.Storage (Storage.java:tryLock(715)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/in_use.lock acquired by nodename 74414@Edinburgh.local
2015-02-12 12:04:18,687 INFO  common.Storage (DataStorage.java:addStorageLocations(281)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3 is not formatted for BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,688 INFO  common.Storage (DataStorage.java:addStorageLocations(283)) - Formatting ...
2015-02-12 12:04:18,689 INFO  common.Storage (Storage.java:tryLock(715)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/in_use.lock acquired by nodename 74414@Edinburgh.local
2015-02-12 12:04:18,689 INFO  common.Storage (DataStorage.java:addStorageLocations(281)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4 is not formatted for BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,690 INFO  common.Storage (DataStorage.java:addStorageLocations(283)) - Formatting ...
2015-02-12 12:04:18,690 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1407)) - Starting DataNode 2 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6
2015-02-12 12:04:18,738 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(141)) - Analyzing storage directories for bpid BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,739 INFO  common.Storage (Storage.java:lock(675)) - Locking is disabled
2015-02-12 12:04:18,740 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(172)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695 is not formatted.
2015-02-12 12:04:18,740 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(173)) - Formatting ...
2015-02-12 12:04:18,740 INFO  common.Storage (BlockPoolSliceStorage.java:format(225)) - Formatting block pool BP-1120419527-10.1.1.68-1423771456695 directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current
2015-02-12 12:04:18,741 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(141)) - Analyzing storage directories for bpid BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,741 INFO  common.Storage (Storage.java:lock(675)) - Locking is disabled
2015-02-12 12:04:18,742 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(172)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695 is not formatted.
2015-02-12 12:04:18,742 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(173)) - Formatting ...
2015-02-12 12:04:18,742 INFO  common.Storage (BlockPoolSliceStorage.java:format(225)) - Formatting block pool BP-1120419527-10.1.1.68-1423771456695 directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current
2015-02-12 12:04:18,742 INFO  common.Storage (Storage.java:lock(675)) - Locking is disabled
2015-02-12 12:04:18,742 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(172)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695 is not formatted.
2015-02-12 12:04:18,743 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(173)) - Formatting ...
2015-02-12 12:04:18,743 INFO  common.Storage (BlockPoolSliceStorage.java:format(225)) - Formatting block pool BP-1120419527-10.1.1.68-1423771456695 directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current
2015-02-12 12:04:18,743 INFO  common.Storage (Storage.java:lock(675)) - Locking is disabled
2015-02-12 12:04:18,743 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(172)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695 is not formatted.
2015-02-12 12:04:18,744 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(173)) - Formatting ...
2015-02-12 12:04:18,744 INFO  common.Storage (BlockPoolSliceStorage.java:format(225)) - Formatting block pool BP-1120419527-10.1.1.68-1423771456695 directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current
2015-02-12 12:04:18,744 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(313)) - Restored 0 block files from trash.
2015-02-12 12:04:18,744 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(313)) - Restored 0 block files from trash.
2015-02-12 12:04:18,744 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(313)) - Restored 0 block files from trash.
2015-02-12 12:04:18,745 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(313)) - Restored 0 block files from trash.
2015-02-12 12:04:18,745 INFO  datanode.DataNode (DataNode.java:initStorage(1314)) - Setting up storage: nsid=1159844277;bpid=BP-1120419527-10.1.1.68-1423771456695;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=1159844277;c=0;bpid=BP-1120419527-10.1.1.68-1423771456695;dnuuid=null
2015-02-12 12:04:18,747 INFO  datanode.DataNode (DataNode.java:initStorage(1314)) - Setting up storage: nsid=1159844277;bpid=BP-1120419527-10.1.1.68-1423771456695;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=1159844277;c=0;bpid=BP-1120419527-10.1.1.68-1423771456695;dnuuid=null
2015-02-12 12:04:18,747 INFO  datanode.DataNode (DataNode.java:checkDatanodeUuid(1142)) - Generated and persisted new Datanode UUID 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec
2015-02-12 12:04:18,748 INFO  datanode.DataNode (DataNode.java:checkDatanodeUuid(1142)) - Generated and persisted new Datanode UUID 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa
2015-02-12 12:04:18,764 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(158)) - DataNode metrics system started (again)
2015-02-12 12:04:18,764 INFO  datanode.DataNode (DataNode.java:<init>(414)) - Configured hostname is 127.0.0.1
2015-02-12 12:04:18,765 INFO  datanode.DataNode (DataNode.java:startDataNode(1049)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 12:04:18,766 INFO  datanode.DataNode (DataNode.java:initDataXceiver(848)) - Opened streaming server at /127.0.0.1:55526
2015-02-12 12:04:18,766 INFO  datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 12:04:18,767 INFO  datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 12:04:18,769 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 12:04:18,770 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(699)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 12:04:18,771 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 12:04:18,771 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 12:04:18,771 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 12:04:18,773 INFO  http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(603)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 12:04:18,774 INFO  http.HttpServer2 (HttpServer2.java:openListeners(887)) - Jetty bound to port 55527
2015-02-12 12:04:18,775 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
2015-02-12 12:04:18,778 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.6.0.2.2.0.0-2041/4318f06dbd560179ace6e74d21eae12ac75d8328/hadoop-hdfs-2.6.0.2.2.0.0-2041-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_55527_datanode____.3r5i0v/webapp
2015-02-12 12:04:18,778 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(222)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current
2015-02-12 12:04:18,779 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(222)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current
2015-02-12 12:04:18,781 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(316)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current, StorageType: DISK
2015-02-12 12:04:18,781 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(316)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current, StorageType: DISK
2015-02-12 12:04:18,781 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(222)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current
2015-02-12 12:04:18,781 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(316)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current, StorageType: DISK
2015-02-12 12:04:18,781 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(222)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current
2015-02-12 12:04:18,782 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(316)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current, StorageType: DISK
2015-02-12 12:04:18,788 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1803)) - Registered FSDatasetState MBean
2015-02-12 12:04:18,788 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1803)) - Registered FSDatasetState MBean
2015-02-12 12:04:18,792 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(330)) - Periodic Directory Tree Verification scan starting at 1423778686792 with interval 21600000
2015-02-12 12:04:18,793 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(2206)) - Adding block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,793 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(330)) - Periodic Directory Tree Verification scan starting at 1423778584793 with interval 21600000
2015-02-12 12:04:18,794 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(254)) - Scanning block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current...
2015-02-12 12:04:18,794 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(2206)) - Adding block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,794 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(254)) - Scanning block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current...
2015-02-12 12:04:18,794 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(254)) - Scanning block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current...
2015-02-12 12:04:18,795 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(254)) - Scanning block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current...
2015-02-12 12:04:18,811 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(259)) - Time taken to scan block pool BP-1120419527-10.1.1.68-1423771456695 on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current: 16ms
2015-02-12 12:04:18,811 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(259)) - Time taken to scan block pool BP-1120419527-10.1.1.68-1423771456695 on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current: 17ms
2015-02-12 12:04:18,811 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(259)) - Time taken to scan block pool BP-1120419527-10.1.1.68-1423771456695 on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current: 17ms
2015-02-12 12:04:18,811 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(259)) - Time taken to scan block pool BP-1120419527-10.1.1.68-1423771456695 on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current: 16ms
2015-02-12 12:04:18,812 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(283)) - Total time to scan all replicas for block pool BP-1120419527-10.1.1.68-1423771456695: 19ms
2015-02-12 12:04:18,812 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(283)) - Total time to scan all replicas for block pool BP-1120419527-10.1.1.68-1423771456695: 18ms
2015-02-12 12:04:18,812 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(134)) - Adding replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current...
2015-02-12 12:04:18,812 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(134)) - Adding replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current...
2015-02-12 12:04:18,813 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(134)) - Adding replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current...
2015-02-12 12:04:18,813 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(139)) - Time to add replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current: 0ms
2015-02-12 12:04:18,813 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(139)) - Time to add replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current: 1ms
2015-02-12 12:04:18,813 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(139)) - Time to add replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current: 0ms
2015-02-12 12:04:18,813 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(134)) - Adding replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current...
2015-02-12 12:04:18,813 INFO  impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(162)) - Total time to add all replicas to map: 1ms
2015-02-12 12:04:18,813 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(139)) - Time to add replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current: 0ms
2015-02-12 12:04:18,814 INFO  impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(162)) - Total time to add all replicas to map: 1ms
2015-02-12 12:04:18,815 INFO  datanode.DataNode (BPServiceActor.java:register(781)) - Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid null) service to localhost/127.0.0.1:55518 beginning handshake with NN
2015-02-12 12:04:18,816 INFO  datanode.DataNode (BPServiceActor.java:register(781)) - Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid null) service to localhost/127.0.0.1:55518 beginning handshake with NN
2015-02-12 12:04:18,824 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(903)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, infoPort=55523, ipcPort=55525, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) storage 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa
2015-02-12 12:04:18,828 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(388)) - Number of failed storage changes from 0 to 0
2015-02-12 12:04:18,829 INFO  net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:55522
2015-02-12 12:04:18,830 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(903)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, infoPort=55520, ipcPort=55521, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) storage 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec
2015-02-12 12:04:18,831 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(388)) - Number of failed storage changes from 0 to 0
2015-02-12 12:04:18,832 INFO  net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:55519
2015-02-12 12:04:18,834 INFO  datanode.DataNode (BPServiceActor.java:register(794)) - Block pool Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid null) service to localhost/127.0.0.1:55518 successfully registered with NN
2015-02-12 12:04:18,834 INFO  datanode.DataNode (BPServiceActor.java:register(794)) - Block pool Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid null) service to localhost/127.0.0.1:55518 successfully registered with NN
2015-02-12 12:04:18,834 INFO  datanode.DataNode (BPServiceActor.java:offerService(653)) - For namenode localhost/127.0.0.1:55518 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 12:04:18,834 INFO  datanode.DataNode (BPServiceActor.java:offerService(653)) - For namenode localhost/127.0.0.1:55518 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 12:04:18,872 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(388)) - Number of failed storage changes from 0 to 0
2015-02-12 12:04:18,873 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(743)) - Adding new storage ID DS-9bebf294-2850-45e2-b85c-2523885d0a4c for DN 127.0.0.1:55519
2015-02-12 12:04:18,873 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(743)) - Adding new storage ID DS-de43b62f-388f-4842-aba1-aeb68654489e for DN 127.0.0.1:55519
2015-02-12 12:04:18,873 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(388)) - Number of failed storage changes from 0 to 0
2015-02-12 12:04:18,874 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(743)) - Adding new storage ID DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739 for DN 127.0.0.1:55522
2015-02-12 12:04:18,874 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(743)) - Adding new storage ID DS-065530ff-78aa-4c0c-96f5-5cc72fea570f for DN 127.0.0.1:55522
2015-02-12 12:04:18,887 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(503)) - Namenode Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa) service to localhost/127.0.0.1:55518 trying to claim ACTIVE state with txid=1
2015-02-12 12:04:18,887 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(515)) - Acknowledging ACTIVE Namenode Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa) service to localhost/127.0.0.1:55518
2015-02-12 12:04:18,888 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(503)) - Namenode Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec) service to localhost/127.0.0.1:55518 trying to claim ACTIVE state with txid=1
2015-02-12 12:04:18,888 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(515)) - Acknowledging ACTIVE Namenode Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec) service to localhost/127.0.0.1:55518
2015-02-12 12:04:18,897 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1815)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-de43b62f-388f-4842-aba1-aeb68654489e,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 12:04:18,897 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1815)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-065530ff-78aa-4c0c-96f5-5cc72fea570f,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 12:04:18,897 INFO  BlockStateChange (BlockManager.java:processReport(1831)) - BLOCK* processReport: from storage DS-de43b62f-388f-4842-aba1-aeb68654489e node DatanodeRegistration(127.0.0.1, datanodeUuid=7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, infoPort=55520, ipcPort=55521, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0), blocks: 0, hasStaleStorages: true, processing time: 2 msecs
2015-02-12 12:04:18,897 INFO  BlockStateChange (BlockManager.java:processReport(1831)) - BLOCK* processReport: from storage DS-065530ff-78aa-4c0c-96f5-5cc72fea570f node DatanodeRegistration(127.0.0.1, datanodeUuid=6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, infoPort=55523, ipcPort=55525, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
2015-02-12 12:04:18,898 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1815)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-9bebf294-2850-45e2-b85c-2523885d0a4c,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 12:04:18,898 INFO  BlockStateChange (BlockManager.java:processReport(1831)) - BLOCK* processReport: from storage DS-9bebf294-2850-45e2-b85c-2523885d0a4c node DatanodeRegistration(127.0.0.1, datanodeUuid=7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, infoPort=55520, ipcPort=55521, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2015-02-12 12:04:18,898 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1815)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 12:04:18,898 INFO  BlockStateChange (BlockManager.java:processReport(1831)) - BLOCK* processReport: from storage DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739 node DatanodeRegistration(127.0.0.1, datanodeUuid=6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, infoPort=55523, ipcPort=55525, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2015-02-12 12:04:18,919 INFO  datanode.DataNode (BPServiceActor.java:blockReport(514)) - Sent 1 blockreports 0 blocks total. Took 1 msec to generate and 30 msecs for RPC and NN processing.  Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@4477b3e
2015-02-12 12:04:18,919 INFO  datanode.DataNode (BPOfferService.java:processCommandFromActive(689)) - Got finalize command for block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,922 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 12:04:18,922 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:18,923 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 12:04:18,923 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^19 = 524288 entries
2015-02-12 12:04:18,923 INFO  datanode.DataNode (BPServiceActor.java:blockReport(514)) - Sent 1 blockreports 0 blocks total. Took 2 msec to generate and 33 msecs for RPC and NN processing.  Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@5dcdfc98
2015-02-12 12:04:18,923 INFO  datanode.DataNode (BPOfferService.java:processCommandFromActive(689)) - Got finalize command for block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,923 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,924 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 12:04:18,924 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:18,924 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 12:04:18,924 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^19 = 524288 entries
2015-02-12 12:04:18,929 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-1120419527-10.1.1.68-1423771456695 to blockPoolScannerMap, new size=1
2015-02-12 12:04:18,926 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:18,930 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-1120419527-10.1.1.68-1423771456695 to blockPoolScannerMap, new size=1
2015-02-12 12:04:19,000 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55527
2015-02-12 12:04:19,001 INFO  datanode.DataNode (DataNode.java:startDataNode(1066)) - dnUserName = soberoi
2015-02-12 12:04:19,001 INFO  datanode.DataNode (DataNode.java:startDataNode(1067)) - supergroup = supergroup
2015-02-12 12:04:19,003 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:19,004 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55528
2015-02-12 12:04:19,008 INFO  datanode.DataNode (DataNode.java:initIpcServer(723)) - Opened IPC server at /127.0.0.1:55528
2015-02-12 12:04:19,017 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 12:04:19,017 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 12:04:19,019 INFO  datanode.DataNode (BPServiceActor.java:run(821)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:55518 starting to offer service
2015-02-12 12:04:19,021 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:19,021 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55528: starting
2015-02-12 12:04:19,023 INFO  common.Storage (DataStorage.java:recoverTransitionRead(399)) - DataNode version: -56 and NameNode layout version: -60
2015-02-12 12:04:19,024 INFO  common.Storage (Storage.java:tryLock(715)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/in_use.lock acquired by nodename 74414@Edinburgh.local
2015-02-12 12:04:19,024 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1407)) - Starting DataNode 3 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8
2015-02-12 12:04:19,024 INFO  common.Storage (DataStorage.java:addStorageLocations(281)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5 is not formatted for BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:19,025 INFO  common.Storage (DataStorage.java:addStorageLocations(283)) - Formatting ...
2015-02-12 12:04:19,026 INFO  common.Storage (Storage.java:tryLock(715)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/in_use.lock acquired by nodename 74414@Edinburgh.local
2015-02-12 12:04:19,027 INFO  common.Storage (DataStorage.java:addStorageLocations(281)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6 is not formatted for BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:19,027 INFO  common.Storage (DataStorage.java:addStorageLocations(283)) - Formatting ...
2015-02-12 12:04:19,065 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(158)) - DataNode metrics system started (again)
2015-02-12 12:04:19,066 INFO  datanode.DataNode (DataNode.java:<init>(414)) - Configured hostname is 127.0.0.1
2015-02-12 12:04:19,068 INFO  datanode.DataNode (DataNode.java:startDataNode(1049)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 12:04:19,070 INFO  datanode.DataNode (DataNode.java:initDataXceiver(848)) - Opened streaming server at /127.0.0.1:55529
2015-02-12 12:04:19,070 INFO  datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 12:04:19,070 INFO  datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 12:04:19,072 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 12:04:19,078 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(141)) - Analyzing storage directories for bpid BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:19,078 INFO  common.Storage (Storage.java:lock(675)) - Locking is disabled
2015-02-12 12:04:19,078 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(172)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695 is not formatted.
2015-02-12 12:04:19,078 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(173)) - Formatting ...
2015-02-12 12:04:19,078 INFO  common.Storage (BlockPoolSliceStorage.java:format(225)) - Formatting block pool BP-1120419527-10.1.1.68-1423771456695 directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current
2015-02-12 12:04:19,079 INFO  common.Storage (Storage.java:lock(675)) - Locking is disabled
2015-02-12 12:04:19,079 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(172)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695 is not formatted.
2015-02-12 12:04:19,079 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(173)) - Formatting ...
2015-02-12 12:04:19,080 INFO  common.Storage (BlockPoolSliceStorage.java:format(225)) - Formatting block pool BP-1120419527-10.1.1.68-1423771456695 directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current
2015-02-12 12:04:19,080 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(699)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 12:04:19,080 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(313)) - Restored 0 block files from trash.
2015-02-12 12:04:19,081 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(313)) - Restored 0 block files from trash.
2015-02-12 12:04:19,082 INFO  datanode.DataNode (DataNode.java:initStorage(1314)) - Setting up storage: nsid=1159844277;bpid=BP-1120419527-10.1.1.68-1423771456695;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=1159844277;c=0;bpid=BP-1120419527-10.1.1.68-1423771456695;dnuuid=null
2015-02-12 12:04:19,083 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 12:04:19,083 INFO  datanode.DataNode (DataNode.java:checkDatanodeUuid(1142)) - Generated and persisted new Datanode UUID 96ab84db-3835-4ade-b715-a77ff6c7c57a
2015-02-12 12:04:19,085 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 12:04:19,085 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 12:04:19,085 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(222)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current
2015-02-12 12:04:19,087 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(316)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current, StorageType: DISK
2015-02-12 12:04:19,087 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(222)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current
2015-02-12 12:04:19,087 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(316)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current, StorageType: DISK
2015-02-12 12:04:19,088 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1803)) - Registered FSDatasetState MBean
2015-02-12 12:04:19,089 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(330)) - Periodic Directory Tree Verification scan starting at 1423773808089 with interval 21600000
2015-02-12 12:04:19,090 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(2206)) - Adding block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:19,091 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(254)) - Scanning block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current...
2015-02-12 12:04:19,091 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(254)) - Scanning block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current...
2015-02-12 12:04:19,105 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(259)) - Time taken to scan block pool BP-1120419527-10.1.1.68-1423771456695 on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current: 14ms
2015-02-12 12:04:19,105 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(259)) - Time taken to scan block pool BP-1120419527-10.1.1.68-1423771456695 on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current: 14ms
2015-02-12 12:04:19,105 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(283)) - Total time to scan all replicas for block pool BP-1120419527-10.1.1.68-1423771456695: 15ms
2015-02-12 12:04:19,106 INFO  http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(603)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 12:04:19,106 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(134)) - Adding replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current...
2015-02-12 12:04:19,106 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(134)) - Adding replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current...
2015-02-12 12:04:19,107 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(139)) - Time to add replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current: 1ms
2015-02-12 12:04:19,107 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(139)) - Time to add replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current: 0ms
2015-02-12 12:04:19,107 INFO  impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(162)) - Total time to add all replicas to map: 1ms
2015-02-12 12:04:19,107 INFO  datanode.DataNode (BPServiceActor.java:register(781)) - Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid null) service to localhost/127.0.0.1:55518 beginning handshake with NN
2015-02-12 12:04:19,108 INFO  http.HttpServer2 (HttpServer2.java:openListeners(887)) - Jetty bound to port 55533
2015-02-12 12:04:19,109 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(903)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=96ab84db-3835-4ade-b715-a77ff6c7c57a, infoPort=55527, ipcPort=55528, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) storage 96ab84db-3835-4ade-b715-a77ff6c7c57a
2015-02-12 12:04:19,109 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(388)) - Number of failed storage changes from 0 to 0
2015-02-12 12:04:19,109 INFO  net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:55526
2015-02-12 12:04:19,109 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
2015-02-12 12:04:19,110 INFO  datanode.DataNode (BPServiceActor.java:register(794)) - Block pool Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid null) service to localhost/127.0.0.1:55518 successfully registered with NN
2015-02-12 12:04:19,110 INFO  datanode.DataNode (BPServiceActor.java:offerService(653)) - For namenode localhost/127.0.0.1:55518 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 12:04:19,112 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(388)) - Number of failed storage changes from 0 to 0
2015-02-12 12:04:19,112 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(743)) - Adding new storage ID DS-775daf91-35b2-45ee-850c-935c071bf8ea for DN 127.0.0.1:55526
2015-02-12 12:04:19,113 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(743)) - Adding new storage ID DS-4ce14610-be98-48ff-b28d-c33e2df27e44 for DN 127.0.0.1:55526
2015-02-12 12:04:19,113 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(503)) - Namenode Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid 96ab84db-3835-4ade-b715-a77ff6c7c57a) service to localhost/127.0.0.1:55518 trying to claim ACTIVE state with txid=1
2015-02-12 12:04:19,114 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(515)) - Acknowledging ACTIVE Namenode Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid 96ab84db-3835-4ade-b715-a77ff6c7c57a) service to localhost/127.0.0.1:55518
2015-02-12 12:04:19,204 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1815)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-775daf91-35b2-45ee-850c-935c071bf8ea,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 12:04:19,204 INFO  BlockStateChange (BlockManager.java:processReport(1831)) - BLOCK* processReport: from storage DS-775daf91-35b2-45ee-850c-935c071bf8ea node DatanodeRegistration(127.0.0.1, datanodeUuid=96ab84db-3835-4ade-b715-a77ff6c7c57a, infoPort=55527, ipcPort=55528, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0), blocks: 0, hasStaleStorages: true, processing time: 88 msecs
2015-02-12 12:04:19,204 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1815)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-4ce14610-be98-48ff-b28d-c33e2df27e44,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 12:04:19,204 INFO  BlockStateChange (BlockManager.java:processReport(1831)) - BLOCK* processReport: from storage DS-4ce14610-be98-48ff-b28d-c33e2df27e44 node DatanodeRegistration(127.0.0.1, datanodeUuid=96ab84db-3835-4ade-b715-a77ff6c7c57a, infoPort=55527, ipcPort=55528, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2015-02-12 12:04:19,206 INFO  datanode.DataNode (BPServiceActor.java:blockReport(514)) - Sent 1 blockreports 0 blocks total. Took 0 msec to generate and 92 msecs for RPC and NN processing.  Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@16fa15d
2015-02-12 12:04:19,207 INFO  datanode.DataNode (BPOfferService.java:processCommandFromActive(689)) - Got finalize command for block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:19,215 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 12:04:19,215 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:19,215 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 12:04:19,216 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^19 = 524288 entries
2015-02-12 12:04:19,222 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:19,225 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-1120419527-10.1.1.68-1423771456695 to blockPoolScannerMap, new size=1
2015-02-12 12:04:19,350 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.6.0.2.2.0.0-2041/4318f06dbd560179ace6e74d21eae12ac75d8328/hadoop-hdfs-2.6.0.2.2.0.0-2041-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_55533_datanode____7al7a4/webapp
2015-02-12 12:04:20,253 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55533
2015-02-12 12:04:20,254 INFO  datanode.DataNode (DataNode.java:startDataNode(1066)) - dnUserName = soberoi
2015-02-12 12:04:20,254 INFO  datanode.DataNode (DataNode.java:startDataNode(1067)) - supergroup = supergroup
2015-02-12 12:04:20,256 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:20,258 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55546
2015-02-12 12:04:20,261 INFO  datanode.DataNode (DataNode.java:initIpcServer(723)) - Opened IPC server at /127.0.0.1:55546
2015-02-12 12:04:20,268 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 12:04:20,268 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 12:04:20,270 INFO  datanode.DataNode (BPServiceActor.java:run(821)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:55518 starting to offer service
2015-02-12 12:04:20,270 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:20,273 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55546: starting
2015-02-12 12:04:20,273 INFO  common.Storage (DataStorage.java:recoverTransitionRead(399)) - DataNode version: -56 and NameNode layout version: -60
2015-02-12 12:04:20,274 INFO  common.Storage (Storage.java:tryLock(715)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/in_use.lock acquired by nodename 74414@Edinburgh.local
2015-02-12 12:04:20,274 INFO  common.Storage (DataStorage.java:addStorageLocations(281)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7 is not formatted for BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:20,274 INFO  common.Storage (DataStorage.java:addStorageLocations(283)) - Formatting ...
2015-02-12 12:04:20,276 INFO  common.Storage (Storage.java:tryLock(715)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/in_use.lock acquired by nodename 74414@Edinburgh.local
2015-02-12 12:04:20,276 INFO  common.Storage (DataStorage.java:addStorageLocations(281)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8 is not formatted for BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:20,276 INFO  common.Storage (DataStorage.java:addStorageLocations(283)) - Formatting ...
2015-02-12 12:04:20,326 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(141)) - Analyzing storage directories for bpid BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:20,326 INFO  common.Storage (Storage.java:lock(675)) - Locking is disabled
2015-02-12 12:04:20,326 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(172)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695 is not formatted.
2015-02-12 12:04:20,326 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(173)) - Formatting ...
2015-02-12 12:04:20,326 INFO  common.Storage (BlockPoolSliceStorage.java:format(225)) - Formatting block pool BP-1120419527-10.1.1.68-1423771456695 directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current
2015-02-12 12:04:20,327 INFO  common.Storage (Storage.java:lock(675)) - Locking is disabled
2015-02-12 12:04:20,327 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(172)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695 is not formatted.
2015-02-12 12:04:20,327 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(173)) - Formatting ...
2015-02-12 12:04:20,328 INFO  common.Storage (BlockPoolSliceStorage.java:format(225)) - Formatting block pool BP-1120419527-10.1.1.68-1423771456695 directory /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current
2015-02-12 12:04:20,328 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(313)) - Restored 0 block files from trash.
2015-02-12 12:04:20,329 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(313)) - Restored 0 block files from trash.
2015-02-12 12:04:20,330 INFO  datanode.DataNode (DataNode.java:initStorage(1314)) - Setting up storage: nsid=1159844277;bpid=BP-1120419527-10.1.1.68-1423771456695;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=1159844277;c=0;bpid=BP-1120419527-10.1.1.68-1423771456695;dnuuid=null
2015-02-12 12:04:20,331 INFO  datanode.DataNode (DataNode.java:checkDatanodeUuid(1142)) - Generated and persisted new Datanode UUID de9e44f0-e16e-4afe-864c-4a5fdf6d29d8
2015-02-12 12:04:20,333 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(222)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current
2015-02-12 12:04:20,333 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(316)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current, StorageType: DISK
2015-02-12 12:04:20,333 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(222)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current
2015-02-12 12:04:20,333 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(316)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current, StorageType: DISK
2015-02-12 12:04:20,335 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1803)) - Registered FSDatasetState MBean
2015-02-12 12:04:20,336 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(330)) - Periodic Directory Tree Verification scan starting at 1423790957336 with interval 21600000
2015-02-12 12:04:20,336 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(2206)) - Adding block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:20,337 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(254)) - Scanning block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current...
2015-02-12 12:04:20,337 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(254)) - Scanning block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current...
2015-02-12 12:04:20,511 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(259)) - Time taken to scan block pool BP-1120419527-10.1.1.68-1423771456695 on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current: 174ms
2015-02-12 12:04:20,516 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(259)) - Time taken to scan block pool BP-1120419527-10.1.1.68-1423771456695 on /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current: 179ms
2015-02-12 12:04:20,516 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(283)) - Total time to scan all replicas for block pool BP-1120419527-10.1.1.68-1423771456695: 180ms
2015-02-12 12:04:20,516 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(134)) - Adding replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current...
2015-02-12 12:04:20,517 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(134)) - Adding replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current...
2015-02-12 12:04:20,517 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(139)) - Time to add replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current: 1ms
2015-02-12 12:04:20,517 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(139)) - Time to add replicas to map for block pool BP-1120419527-10.1.1.68-1423771456695 on volume /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current: 0ms
2015-02-12 12:04:20,517 INFO  impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(162)) - Total time to add all replicas to map: 1ms
2015-02-12 12:04:20,517 INFO  datanode.DataNode (BPServiceActor.java:register(781)) - Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid null) service to localhost/127.0.0.1:55518 beginning handshake with NN
2015-02-12 12:04:20,518 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(903)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, infoPort=55533, ipcPort=55546, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) storage de9e44f0-e16e-4afe-864c-4a5fdf6d29d8
2015-02-12 12:04:20,519 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(388)) - Number of failed storage changes from 0 to 0
2015-02-12 12:04:20,519 INFO  net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:55529
2015-02-12 12:04:20,520 INFO  datanode.DataNode (BPServiceActor.java:register(794)) - Block pool Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid null) service to localhost/127.0.0.1:55518 successfully registered with NN
2015-02-12 12:04:20,520 INFO  datanode.DataNode (BPServiceActor.java:offerService(653)) - For namenode localhost/127.0.0.1:55518 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 12:04:20,521 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(388)) - Number of failed storage changes from 0 to 0
2015-02-12 12:04:20,522 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(743)) - Adding new storage ID DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2 for DN 127.0.0.1:55529
2015-02-12 12:04:20,522 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(743)) - Adding new storage ID DS-e341031c-9900-4893-989b-b930fef79e2d for DN 127.0.0.1:55529
2015-02-12 12:04:20,523 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(503)) - Namenode Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid de9e44f0-e16e-4afe-864c-4a5fdf6d29d8) service to localhost/127.0.0.1:55518 trying to claim ACTIVE state with txid=1
2015-02-12 12:04:20,523 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(515)) - Acknowledging ACTIVE Namenode Block pool BP-1120419527-10.1.1.68-1423771456695 (Datanode Uuid de9e44f0-e16e-4afe-864c-4a5fdf6d29d8) service to localhost/127.0.0.1:55518
2015-02-12 12:04:20,525 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1815)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 12:04:20,525 INFO  BlockStateChange (BlockManager.java:processReport(1831)) - BLOCK* processReport: from storage DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2 node DatanodeRegistration(127.0.0.1, datanodeUuid=de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, infoPort=55533, ipcPort=55546, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
2015-02-12 12:04:20,525 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1815)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-e341031c-9900-4893-989b-b930fef79e2d,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 12:04:20,525 INFO  BlockStateChange (BlockManager.java:processReport(1831)) - BLOCK* processReport: from storage DS-e341031c-9900-4893-989b-b930fef79e2d node DatanodeRegistration(127.0.0.1, datanodeUuid=de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, infoPort=55533, ipcPort=55546, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2015-02-12 12:04:20,527 INFO  datanode.DataNode (BPServiceActor.java:blockReport(514)) - Sent 1 blockreports 0 blocks total. Took 0 msec to generate and 3 msecs for RPC and NN processing.  Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@2c968e06
2015-02-12 12:04:20,527 INFO  datanode.DataNode (BPOfferService.java:processCommandFromActive(689)) - Got finalize command for block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:20,527 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 12:04:20,527 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 12:04:20,528 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 12:04:20,528 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^19 = 524288 entries
2015-02-12 12:04:20,528 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1120419527-10.1.1.68-1423771456695
2015-02-12 12:04:20,529 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-1120419527-10.1.1.68-1423771456695 to blockPoolScannerMap, new size=1
2015-02-12 12:04:21,283 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(2213)) - Cluster is active
2015-02-12 12:04:21,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:21,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:04:21,495 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:04:21,560 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001 src: /127.0.0.1:55548 dest: /127.0.0.1:55519
2015-02-12 12:04:21,573 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001 src: /127.0.0.1:55549 dest: /127.0.0.1:55522
2015-02-12 12:04:21,575 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001 src: /127.0.0.1:55550 dest: /127.0.0.1:55526
2015-02-12 12:04:21,619 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55550, dest: /127.0.0.1:55526, bytes: 504324, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001, duration: 32868000
2015-02-12 12:04:21,619 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:04:21,621 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55549, dest: /127.0.0.1:55522, bytes: 504324, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001, duration: 35996000
2015-02-12 12:04:21,622 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:21,624 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55548, dest: /127.0.0.1:55519, bytes: 504324, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001, duration: 38267000
2015-02-12 12:04:21,624 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:21,632 INFO  namenode.FSNamesystem (FSNamesystem.java:checkFileProgress(3694)) - BLOCK* checkFileProgress: blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} has not reached minimal replication 1
2015-02-12 12:04:21,632 INFO  namenode.EditLogFileOutputStream (EditLogFileOutputStream.java:flushAndSync(200)) - Nothing to flush
2015-02-12 12:04:21,632 INFO  namenode.EditLogFileOutputStream (EditLogFileOutputStream.java:flushAndSync(200)) - Nothing to flush
2015-02-12 12:04:21,635 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 504324
2015-02-12 12:04:21,635 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741825_1001 size 504324
2015-02-12 12:04:21,636 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741825_1001 size 504324
2015-02-12 12:04:22,046 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:04:22,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=soberoi:supergroup:rwxr--r--	proto=rpc
2015-02-12 12:04:22,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:22,406 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:04:22,409 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:04:22,411 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002 src: /127.0.0.1:55551 dest: /127.0.0.1:55526
2015-02-12 12:04:22,414 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002 src: /127.0.0.1:55552 dest: /127.0.0.1:55529
2015-02-12 12:04:22,416 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002 src: /127.0.0.1:55553 dest: /127.0.0.1:55519
2015-02-12 12:04:22,425 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55553, dest: /127.0.0.1:55519, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002, duration: 6399000
2015-02-12 12:04:22,426 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:04:22,427 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:04:22,427 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55552, dest: /127.0.0.1:55529, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002, duration: 8510000
2015-02-12 12:04:22,428 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:22,428 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:04:22,430 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55551, dest: /127.0.0.1:55526, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002, duration: 10372000
2015-02-12 12:04:22,430 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:22,432 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:04:22,433 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:04:22,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=soberoi:supergroup:rwxr--r--	proto=rpc
2015-02-12 12:04:22,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging	dst=null	perm=null	proto=rpc
2015-02-12 12:04:22,852 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceInit(157)) - mkdir: hdfs://localhost:55518/tmp/hadoop-yarn/staging
2015-02-12 12:04:22,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:04:22,929 INFO  jobhistory.JobHistoryUtils (JobHistoryUtils.java:getDefaultFileContext(258)) - Default file system is set solely by core-default.xml therefore -  ignoring
2015-02-12 12:04:22,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:04:23,135 INFO  conf.Configuration (Configuration.java:getConfResourceAsInputStream(2233)) - core-site.xml not found
2015-02-12 12:04:23,136 INFO  security.Groups (Groups.java:refresh(202)) - clearing userToGroupsMap cache
2015-02-12 12:04:23,379 INFO  conf.Configuration (Configuration.java:getConfResourceAsInputStream(2233)) - yarn-site.xml not found
2015-02-12 12:04:23,382 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher
2015-02-12 12:04:23,439 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:<init>(75)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms
2015-02-12 12:04:23,443 INFO  security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:<init>(77)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
2015-02-12 12:04:23,449 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:<init>(94)) - AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms
2015-02-12 12:04:23,530 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
2015-02-12 12:04:23,567 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
2015-02-12 12:04:23,567 INFO  resourcemanager.ResourceManager (ResourceManager.java:createScheduler(302)) - Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
2015-02-12 12:04:23,713 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
2015-02-12 12:04:23,715 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
2015-02-12 12:04:23,718 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
2015-02-12 12:04:23,719 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
2015-02-12 12:04:23,770 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(158)) - ResourceManager metrics system started (again)
2015-02-12 12:04:23,823 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
2015-02-12 12:04:23,870 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
2015-02-12 12:04:23,874 INFO  resourcemanager.RMNMInfo (RMNMInfo.java:<init>(63)) - Registered RMNMInfo MBean
2015-02-12 12:04:23,875 INFO  metrics.SystemMetricsPublisher (SystemMetricsPublisher.java:serviceInit(92)) - YARN system metrics publishing service is not enabled
2015-02-12 12:04:23,877 INFO  util.HostsFileReader (HostsFileReader.java:refresh(129)) - Refreshing hosts (include/exclude) list
2015-02-12 12:04:23,880 INFO  conf.Configuration (Configuration.java:getConfResourceAsInputStream(2236)) - found resource capacity-scheduler.xml at jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-tests/2.6.0.2.2.0.0-2041/ca52ec7870e6cb419445cf631dbcbc6204182d78/hadoop-yarn-server-tests-2.6.0.2.2.0.0-2041-tests.jar!/capacity-scheduler.xml
2015-02-12 12:04:24,047 INFO  capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(150)) - root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APPLICATIONS:*ADMINISTER_QUEUE:*, labels=*,
, reservationsContinueLooking=true
2015-02-12 12:04:24,064 INFO  capacity.ParentQueue (ParentQueue.java:<init>(121)) - Initialized parent-queue root name=root, fullname=root
2015-02-12 12:04:24,097 INFO  capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(263)) - Initializing default
capacity = 1.0 [= (float) configuredCapacity / 100 ]
asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]
maxCapacity = 1.0 [= configuredMaxCapacity ]
absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]
userLimit = 100 [= configuredUserLimit ]
userLimitFactor = 1.0 [= configuredUserLimitFactor ]
maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)]
maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ]
maxActiveApplications = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) * maxAMResourcePerQueuePercent * absoluteMaxCapacity),1) ]
maxActiveAppsUsingAbsCap = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) *maxAMResourcePercent * absoluteCapacity),1) ]
maxActiveApplicationsPerUser = 1 [= max((int)(maxActiveApplications * (userLimit / 100.0f) * userLimitFactor),1) ]
usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)]
absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]
maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]
minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ]
numContainers = 0 [= currentNumContainers ]
state = RUNNING [= configuredState ]
acls = SUBMIT_APPLICATIONS:*ADMINISTER_QUEUE:* [= configuredAcls ]
nodeLocalityDelay = 0
labels=*,
nodeLocalityDelay = 0
reservationsContinueLooking = true

2015-02-12 12:04:24,100 INFO  capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(603)) - Initialized queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0
2015-02-12 12:04:24,100 INFO  capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(603)) - Initialized queue: root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-02-12 12:04:24,102 INFO  capacity.CapacityScheduler (CapacityScheduler.java:initializeQueues(467)) - Initialized root queue root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-02-12 12:04:24,102 INFO  capacity.CapacityScheduler (CapacityScheduler.java:initializeQueueMappings(436)) - Initialized queue mappings, override: false
2015-02-12 12:04:24,102 INFO  capacity.CapacityScheduler (CapacityScheduler.java:initScheduler(305)) - Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<<memory:1024, vCores:1>>, maximumAllocation=<<memory:8192, vCores:32>>, asynchronousScheduling=false, asyncScheduleInterval=5ms
2015-02-12 12:04:24,105 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$1
2015-02-12 12:04:24,106 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0
2015-02-12 12:04:24,107 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1
2015-02-12 12:04:24,107 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2
2015-02-12 12:04:24,108 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3
2015-02-12 12:04:24,108 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_0
2015-02-12 12:04:24,109 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_1
2015-02-12 12:04:24,109 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_2
2015-02-12 12:04:24,110 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_3
2015-02-12 12:04:24,110 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 0
2015-02-12 12:04:24,313 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 12:04:24,314 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 12:04:24,315 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 12:04:24,316 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 12:04:24,317 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 12:04:24,317 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 12:04:24,322 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 12:04:24,323 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 12:04:24,323 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(158)) - NodeManager metrics system started (again)
2015-02-12 12:04:24,432 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 12:04:24,446 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 12:04:24,846 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 12:04:24,871 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 12:04:24,871 INFO  containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 12:04:24,995 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) -  Using ResourceCalculatorPlugin : null
2015-02-12 12:04:24,997 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) -  Using ResourceCalculatorProcessTree : null
2015-02-12 12:04:24,998 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 12:04:24,998 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 12:04:24,999 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(175)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 12:04:25,000 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0
2015-02-12 12:04:25,000 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1
2015-02-12 12:04:25,002 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2
2015-02-12 12:04:25,002 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3
2015-02-12 12:04:25,003 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_0
2015-02-12 12:04:25,003 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_1
2015-02-12 12:04:25,003 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_2
2015-02-12 12:04:25,004 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_3
2015-02-12 12:04:25,004 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 1
2015-02-12 12:04:25,054 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 12:04:25,058 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 12:04:25,062 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 12:04:25,062 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 12:04:25,062 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 12:04:25,063 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 12:04:25,063 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 12:04:25,063 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 12:04:25,064 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(158)) - NodeManager metrics system started (again)
2015-02-12 12:04:25,068 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 12:04:25,069 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 12:04:25,488 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 12:04:25,490 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 12:04:25,490 INFO  containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 12:04:25,496 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) -  Using ResourceCalculatorPlugin : null
2015-02-12 12:04:25,496 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) -  Using ResourceCalculatorProcessTree : null
2015-02-12 12:04:25,497 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 12:04:25,497 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 12:04:25,498 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(175)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 12:04:25,498 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0
2015-02-12 12:04:25,499 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1
2015-02-12 12:04:25,499 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2
2015-02-12 12:04:25,499 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3
2015-02-12 12:04:25,500 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_0
2015-02-12 12:04:25,500 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_1
2015-02-12 12:04:25,500 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_2
2015-02-12 12:04:25,500 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_3
2015-02-12 12:04:25,501 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 2
2015-02-12 12:04:25,569 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 12:04:25,569 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 12:04:25,574 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 12:04:25,577 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 12:04:25,578 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 12:04:25,580 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 12:04:25,581 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 12:04:25,581 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 12:04:25,582 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(158)) - NodeManager metrics system started (again)
2015-02-12 12:04:25,587 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 12:04:25,588 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 12:04:26,018 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 12:04:26,020 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 12:04:26,020 INFO  containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 12:04:26,023 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) -  Using ResourceCalculatorPlugin : null
2015-02-12 12:04:26,023 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) -  Using ResourceCalculatorProcessTree : null
2015-02-12 12:04:26,024 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 12:04:26,024 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 12:04:26,024 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(175)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 12:04:26,025 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0
2015-02-12 12:04:26,025 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1
2015-02-12 12:04:26,025 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2
2015-02-12 12:04:26,026 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3
2015-02-12 12:04:26,026 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_0
2015-02-12 12:04:26,026 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_1
2015-02-12 12:04:26,027 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_2
2015-02-12 12:04:26,027 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_3
2015-02-12 12:04:26,027 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 3
2015-02-12 12:04:26,075 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 12:04:26,075 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 12:04:26,075 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 12:04:26,075 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 12:04:26,076 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 12:04:26,076 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 12:04:26,076 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 12:04:26,076 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 12:04:26,077 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(158)) - NodeManager metrics system started (again)
2015-02-12 12:04:26,081 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 12:04:26,081 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 12:04:26,477 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 12:04:26,479 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 12:04:26,479 INFO  containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 12:04:26,482 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) -  Using ResourceCalculatorPlugin : null
2015-02-12 12:04:26,482 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) -  Using ResourceCalculatorProcessTree : null
2015-02-12 12:04:26,483 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 12:04:26,483 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 12:04:26,483 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(175)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 12:04:26,529 INFO  hs.JobHistory (JobHistory.java:serviceInit(83)) - JobHistory Init
2015-02-12 12:04:26,677 INFO  jobhistory.JobHistoryUtils (JobHistoryUtils.java:getDefaultFileContext(258)) - Default file system is set solely by core-default.xml therefore -  ignoring
2015-02-12 12:04:26,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null	proto=rpc
2015-02-12 12:04:26,762 INFO  jobhistory.JobHistoryUtils (JobHistoryUtils.java:getDefaultFileContext(258)) - Default file system is set solely by core-default.xml therefore -  ignoring
2015-02-12 12:04:26,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:04:26,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:04:26,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:04:26,790 INFO  hs.HistoryFileManager (HistoryFileManager.java:mkdir(645)) - Perms after creating 511, Expected: 1023
2015-02-12 12:04:26,792 INFO  hs.HistoryFileManager (HistoryFileManager.java:mkdir(648)) - Explicitly setting permissions to : 1023, rwxrwxrwt
2015-02-12 12:04:26,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=soberoi:supergroup:rwxrwxrwt	proto=rpc
2015-02-12 12:04:28,817 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001
2015-02-12 12:04:28,817 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001
2015-02-12 12:04:28,823 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002
2015-02-12 12:04:29,108 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002
2015-02-12 12:04:29,113 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741825_1001
2015-02-12 12:04:30,359 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741826_1002
2015-02-12 12:04:36,837 INFO  hs.HistoryFileManager (HistoryFileManager.java:initExisting(664)) - Initializing Existing Jobs...
2015-02-12 12:04:36,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null	proto=rpc
2015-02-12 12:04:36,845 INFO  hs.CachedHistoryStorage (CachedHistoryStorage.java:serviceInit(66)) - CachedHistoryStorage Init
2015-02-12 12:04:36,854 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:36,855 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55642
2015-02-12 12:04:36,858 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(217)) - Waiting for HistoryServer to start...
2015-02-12 12:04:36,858 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(158)) - JobHistoryServer metrics system started (again)
2015-02-12 12:04:36,859 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(325)) - Updating the current master key for generating delegation tokens
2015-02-12 12:04:36,860 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(638)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-02-12 12:04:36,861 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(325)) - Updating the current master key for generating delegation tokens
2015-02-12 12:04:36,865 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.jobhistory is not defined
2015-02-12 12:04:36,866 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(699)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 12:04:36,866 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context jobhistory
2015-02-12 12:04:36,866 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 12:04:36,867 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 12:04:36,867 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /jobhistory/*
2015-02-12 12:04:36,867 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /ws/*
2015-02-12 12:04:36,868 INFO  http.HttpServer2 (HttpServer2.java:openListeners(887)) - Jetty bound to port 55643
2015-02-12 12:04:36,868 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
2015-02-12 12:04:36,873 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.6.0.2.2.0.0-2041/e5855ed3f15eba8977581b898445fff9571db1ff/hadoop-yarn-common-2.6.0.2.2.0.0-2041.jar!/webapps/jobhistory to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_55643_jobhistory____jltduu/webapp
2015-02-12 12:04:36,963 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:55643
2015-02-12 12:04:36,964 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /jobhistory started at 55643
2015-02-12 12:04:37,189 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 12:04:37,197 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:37,198 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55645
2015-02-12 12:04:37,200 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.mapreduce.v2.api.HSClientProtocolPB to the server
2015-02-12 12:04:37,201 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:37,201 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55645: starting
2015-02-12 12:04:37,203 INFO  hs.HistoryClientService (HistoryClientService.java:serviceStart(146)) - Instantiated HistoryClientService at 10.1.1.68/10.1.1.68:55645
2015-02-12 12:04:37,204 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:37,204 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55642: starting
2015-02-12 12:04:38,359 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(234)) - MiniMRYARN ResourceManager address: Edinburgh.local:0
2015-02-12 12:04:38,359 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(236)) - MiniMRYARN ResourceManager web address: Edinburgh.local:0
2015-02-12 12:04:38,359 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(238)) - MiniMRYARN HistoryServer address: 10.1.1.68:55645
2015-02-12 12:04:38,360 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(240)) - MiniMRYARN HistoryServer web address: Edinburgh.local:55643
2015-02-12 12:04:38,360 INFO  server.MiniYARNCluster (MiniYARNCluster.java:startResourceManager(318)) - Waiting for RM to start...
2015-02-12 12:04:38,360 INFO  resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(1045)) - Transitioning to active state
2015-02-12 12:04:38,371 INFO  security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(105)) - Rolling master-key for container-tokens
2015-02-12 12:04:38,371 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(95)) - Rolling master-key for nm-tokens
2015-02-12 12:04:38,372 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(325)) - Updating the current master key for generating delegation tokens
2015-02-12 12:04:38,373 INFO  security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(87)) - storing master key with keyID 1
2015-02-12 12:04:38,373 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(638)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-02-12 12:04:38,374 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(325)) - Updating the current master key for generating delegation tokens
2015-02-12 12:04:38,375 INFO  security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(87)) - storing master key with keyID 2
2015-02-12 12:04:38,387 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:38,389 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55651
2015-02-12 12:04:38,394 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
2015-02-12 12:04:38,395 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:38,395 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55651: starting
2015-02-12 12:04:38,513 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:38,514 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55652
2015-02-12 12:04:38,525 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server
2015-02-12 12:04:38,526 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:38,526 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55652: starting
2015-02-12 12:04:38,674 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:38,675 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55658
2015-02-12 12:04:38,685 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server
2015-02-12 12:04:38,686 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:38,687 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55658: starting
2015-02-12 12:04:38,747 INFO  resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(1062)) - Transitioned to active state
2015-02-12 12:04:38,777 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.resourcemanager is not defined
2015-02-12 12:04:38,783 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(699)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 12:04:38,798 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster
2015-02-12 12:04:38,799 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs
2015-02-12 12:04:38,799 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static
2015-02-12 12:04:38,800 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
2015-02-12 12:04:38,800 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 12:04:38,806 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 12:04:38,810 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /cluster/*
2015-02-12 12:04:38,811 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /ws/*
2015-02-12 12:04:38,812 INFO  http.HttpServer2 (HttpServer2.java:openListeners(887)) - Jetty bound to port 55663
2015-02-12 12:04:38,812 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
2015-02-12 12:04:38,821 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.6.0.2.2.0.0-2041/e5855ed3f15eba8977581b898445fff9571db1ff/hadoop-yarn-common-2.6.0.2.2.0.0-2041.jar!/webapps/cluster to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_55663_cluster____.pnqtmf/webapp
2015-02-12 12:04:39,361 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(325)) - Updating the current master key for generating delegation tokens
2015-02-12 12:04:39,364 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(638)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-02-12 12:04:39,365 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(325)) - Updating the current master key for generating delegation tokens
2015-02-12 12:04:39,867 INFO  server.MiniYARNCluster (MiniYARNCluster.java:startResourceManager(330)) - MiniYARN ResourceManager address: 10.1.1.68:55658
2015-02-12 12:04:39,867 INFO  server.MiniYARNCluster (MiniYARNCluster.java:startResourceManager(332)) - MiniYARN ResourceManager web address: Edinburgh.local:0
2015-02-12 12:04:39,868 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(449)) - MiniYARN ResourceManager address: 10.1.1.68:55658
2015-02-12 12:04:39,868 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(451)) - MiniYARN ResourceManager web address: Edinburgh.local:0
2015-02-12 12:04:39,869 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 0 to start...
2015-02-12 12:04:39,885 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:39,886 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55664
2015-02-12 12:04:39,892 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 12:04:39,893 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(420)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 12:04:39,893 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:39,893 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55664: starting
2015-02-12 12:04:39,901 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.68:55664
2015-02-12 12:04:39,907 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:39,908 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55665
2015-02-12 12:04:39,911 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 12:04:39,912 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:39,912 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55665: starting
2015-02-12 12:04:39,939 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 55665
2015-02-12 12:04:39,979 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 12:04:39,998 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 55666
2015-02-12 12:04:39,998 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:04:39,999 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(465)) - ContainerManager started at /10.1.1.68:55664
2015-02-12 12:04:39,999 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(466)) - ContainerManager bound to Edinburgh.local/10.1.1.68:0
2015-02-12 12:04:39,999 INFO  webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 12:04:40,000 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 12:04:40,000 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(699)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 12:04:40,001 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 12:04:40,001 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 12:04:40,001 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 12:04:40,002 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /node/*
2015-02-12 12:04:40,002 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /ws/*
2015-02-12 12:04:40,002 INFO  http.HttpServer2 (HttpServer2.java:openListeners(887)) - Jetty bound to port 55667
2015-02-12 12:04:40,003 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
2015-02-12 12:04:40,006 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.6.0.2.2.0.0-2041/e5855ed3f15eba8977581b898445fff9571db1ff/hadoop-yarn-common-2.6.0.2.2.0.0-2041.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_55667_node____u7vn25/webapp
2015-02-12 12:04:40,879 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 1 to start...
2015-02-12 12:04:40,884 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:40,885 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55669
2015-02-12 12:04:40,888 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 12:04:40,888 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(420)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 12:04:40,889 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:40,889 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55669: starting
2015-02-12 12:04:40,899 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.68:55669
2015-02-12 12:04:40,900 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:40,901 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55670
2015-02-12 12:04:40,903 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 12:04:40,904 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:40,904 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55670: starting
2015-02-12 12:04:40,905 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 55670
2015-02-12 12:04:40,907 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 12:04:40,907 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 55671
2015-02-12 12:04:40,908 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:04:40,908 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(465)) - ContainerManager started at /10.1.1.68:55669
2015-02-12 12:04:40,908 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(466)) - ContainerManager bound to Edinburgh.local/10.1.1.68:0
2015-02-12 12:04:40,908 INFO  webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 12:04:40,911 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 12:04:40,912 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(699)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 12:04:40,913 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 12:04:40,913 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 12:04:40,913 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 12:04:40,914 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /node/*
2015-02-12 12:04:40,914 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /ws/*
2015-02-12 12:04:40,914 INFO  http.HttpServer2 (HttpServer2.java:openListeners(887)) - Jetty bound to port 55672
2015-02-12 12:04:40,914 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
2015-02-12 12:04:40,984 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.6.0.2.2.0.0-2041/e5855ed3f15eba8977581b898445fff9571db1ff/hadoop-yarn-common-2.6.0.2.2.0.0-2041.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_55672_node____yd7o9j/webapp
2015-02-12 12:04:41,889 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 2 to start...
2015-02-12 12:04:41,892 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:41,893 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55673
2015-02-12 12:04:41,906 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 12:04:41,907 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(420)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 12:04:41,907 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:41,907 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55673: starting
2015-02-12 12:04:41,913 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.68:55673
2015-02-12 12:04:41,914 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:41,915 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55674
2015-02-12 12:04:41,919 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 12:04:41,919 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:41,919 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55674: starting
2015-02-12 12:04:41,924 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 55674
2015-02-12 12:04:41,940 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 12:04:41,941 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 55675
2015-02-12 12:04:41,941 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:04:41,941 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(465)) - ContainerManager started at /10.1.1.68:55673
2015-02-12 12:04:41,941 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(466)) - ContainerManager bound to Edinburgh.local/10.1.1.68:0
2015-02-12 12:04:41,941 INFO  webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 12:04:41,943 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 12:04:41,944 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(699)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 12:04:41,944 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 12:04:41,944 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 12:04:41,945 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 12:04:41,945 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /node/*
2015-02-12 12:04:41,945 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /ws/*
2015-02-12 12:04:41,946 INFO  http.HttpServer2 (HttpServer2.java:openListeners(887)) - Jetty bound to port 55676
2015-02-12 12:04:41,946 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
2015-02-12 12:04:41,949 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.6.0.2.2.0.0-2041/e5855ed3f15eba8977581b898445fff9571db1ff/hadoop-yarn-common-2.6.0.2.2.0.0-2041.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_55676_node____.e64cx1/webapp
2015-02-12 12:04:42,893 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 3 to start...
2015-02-12 12:04:42,896 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:42,896 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55677
2015-02-12 12:04:42,900 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 12:04:42,901 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(420)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 12:04:42,901 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:42,901 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55677: starting
2015-02-12 12:04:42,905 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.68:55677
2015-02-12 12:04:42,906 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:42,907 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55678
2015-02-12 12:04:42,909 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 12:04:42,910 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:42,910 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55678: starting
2015-02-12 12:04:42,912 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 55678
2015-02-12 12:04:42,916 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 12:04:42,917 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 55679
2015-02-12 12:04:42,917 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:04:42,917 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(465)) - ContainerManager started at /10.1.1.68:55677
2015-02-12 12:04:42,918 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(466)) - ContainerManager bound to Edinburgh.local/10.1.1.68:0
2015-02-12 12:04:42,918 INFO  webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 12:04:42,918 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 12:04:42,919 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(699)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 12:04:42,919 INFO  http.HttpServer2 (HttpServer2.java:addFilter(677)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 12:04:42,919 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 12:04:42,919 INFO  http.HttpServer2 (HttpServer2.java:addFilter(684)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 12:04:42,920 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /node/*
2015-02-12 12:04:42,920 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(402)) - adding path spec: /ws/*
2015-02-12 12:04:42,921 INFO  http.HttpServer2 (HttpServer2.java:openListeners(887)) - Jetty bound to port 55680
2015-02-12 12:04:42,921 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
2015-02-12 12:04:42,924 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.6.0.2.2.0.0-2041/e5855ed3f15eba8977581b898445fff9571db1ff/hadoop-yarn-common-2.6.0.2.2.0.0-2041.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_55680_node____jvbp2s/webapp
2015-02-12 12:04:43,711 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(325)) - Updating the current master key for generating delegation tokens
2015-02-12 12:04:43,713 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:55676
2015-02-12 12:04:43,713 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:55680
2015-02-12 12:04:43,713 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:55667
2015-02-12 12:04:43,713 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:55672
2015-02-12 12:04:43,747 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 55672
2015-02-12 12:04:43,746 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 55667
2015-02-12 12:04:43,714 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 55680
2015-02-12 12:04:43,714 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 55676
2015-02-12 12:04:43,714 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(638)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-02-12 12:04:43,749 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(325)) - Updating the current master key for generating delegation tokens
2015-02-12 12:04:43,752 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(325)) - Updating the current master key for generating delegation tokens
2015-02-12 12:04:43,764 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(638)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-02-12 12:04:43,766 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(325)) - Updating the current master key for generating delegation tokens
2015-02-12 12:04:43,770 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:55663
2015-02-12 12:04:43,771 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /cluster started at 55663
2015-02-12 12:04:43,779 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 12:04:43,779 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 12:04:43,780 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 12:04:43,782 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 12:04:43,783 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(416)) - Sending out 0 NM container statuses: []
2015-02-12 12:04:43,783 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(416)) - Sending out 0 NM container statuses: []
2015-02-12 12:04:43,783 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(416)) - Sending out 0 NM container statuses: []
2015-02-12 12:04:43,783 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(416)) - Sending out 0 NM container statuses: []
2015-02-12 12:04:43,789 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(255)) - Registering with RM using containers :[]
2015-02-12 12:04:43,789 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(255)) - Registering with RM using containers :[]
2015-02-12 12:04:43,789 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(255)) - Registering with RM using containers :[]
2015-02-12 12:04:43,789 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(255)) - Registering with RM using containers :[]
2015-02-12 12:04:43,807 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.68 to /default-rack
2015-02-12 12:04:43,807 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.68 to /default-rack
2015-02-12 12:04:43,808 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.68 to /default-rack
2015-02-12 12:04:43,809 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.68 to /default-rack
2015-02-12 12:04:43,811 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(340)) - NodeManager from node 10.1.1.68(cmPort: 55677 httpPort: 55680) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.68:55677
2015-02-12 12:04:43,812 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 1077820140
2015-02-12 12:04:43,812 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(340)) - NodeManager from node 10.1.1.68(cmPort: 55664 httpPort: 55667) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.68:55664
2015-02-12 12:04:43,812 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(340)) - NodeManager from node 10.1.1.68(cmPort: 55669 httpPort: 55672) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.68:55669
2015-02-12 12:04:43,812 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(340)) - NodeManager from node 10.1.1.68(cmPort: 55673 httpPort: 55676) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.68:55673
2015-02-12 12:04:43,817 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 1077820140
2015-02-12 12:04:43,818 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 1077820140
2015-02-12 12:04:43,818 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id 1095097281
2015-02-12 12:04:43,818 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id 1095097281
2015-02-12 12:04:43,819 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as 10.1.1.68:55673 with total resource of <memory:4096, vCores:8>
2015-02-12 12:04:43,819 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 12:04:43,818 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 1077820140
2015-02-12 12:04:43,819 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as 10.1.1.68:55677 with total resource of <memory:4096, vCores:8>
2015-02-12 12:04:43,826 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 12:04:43,818 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id 1095097281
2015-02-12 12:04:43,828 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as 10.1.1.68:55664 with total resource of <memory:4096, vCores:8>
2015-02-12 12:04:43,828 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 12:04:43,826 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id 1095097281
2015-02-12 12:04:43,828 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as 10.1.1.68:55669 with total resource of <memory:4096, vCores:8>
2015-02-12 12:04:43,828 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 12:04:43,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:04:43,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:04:43,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:04:43,960 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt. BP-1120419527-10.1.1.68-1423771456695 blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:04:43,963 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003 src: /127.0.0.1:55682 dest: /127.0.0.1:55526
2015-02-12 12:04:43,965 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003 src: /127.0.0.1:55683 dest: /127.0.0.1:55522
2015-02-12 12:04:43,966 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 12:04:43,968 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003 src: /127.0.0.1:55684 dest: /127.0.0.1:55529
2015-02-12 12:04:43,970 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.68:55677 Node Transitioned from NEW to RUNNING
2015-02-12 12:04:43,970 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.68:55664 Node Transitioned from NEW to RUNNING
2015-02-12 12:04:43,974 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.68:55673 Node Transitioned from NEW to RUNNING
2015-02-12 12:04:43,974 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.68:55669 Node Transitioned from NEW to RUNNING
2015-02-12 12:04:44,003 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(1133)) - Added node 10.1.1.68:55677 clusterResource: <memory:4096, vCores:8>
2015-02-12 12:04:44,004 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(1133)) - Added node 10.1.1.68:55664 clusterResource: <memory:8192, vCores:16>
2015-02-12 12:04:44,005 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(1133)) - Added node 10.1.1.68:55673 clusterResource: <memory:12288, vCores:24>
2015-02-12 12:04:44,005 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(1133)) - Added node 10.1.1.68:55669 clusterResource: <memory:16384, vCores:32>
2015-02-12 12:04:44,007 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55684, dest: /127.0.0.1:55529, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003, duration: 34002000
2015-02-12 12:04:44,007 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:04:44,008 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:04:44,022 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55683, dest: /127.0.0.1:55522, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003, duration: 48106000
2015-02-12 12:04:44,023 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:44,023 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:04:44,024 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55682, dest: /127.0.0.1:55526, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003, duration: 52609000
2015-02-12 12:04:44,024 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:44,025 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:04:44,028 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:04:44,034 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 12:04:44,035 INFO  ipc.Server (Server.java:run(605)) - Starting Socket Reader #1 for port 55685
2015-02-12 12:04:44,038 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server
2015-02-12 12:04:44,039 INFO  ipc.Server (Server.java:run(827)) - IPC Server Responder: starting
2015-02-12 12:04:44,039 INFO  ipc.Server (Server.java:run(674)) - IPC Server listener on 55685: starting
2015-02-12 12:04:44,133 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 12:04:44,134 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 12:04:44,170 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: C20D1E4D399B4EB7AFB338BE27FF0E9D
2015-02-12 12:04:44,289 INFO  planner.FlowPlanner (FlowPlanner.java:decorateTap(674)) - found decorator: cascading.flowconnector.checkpoint_tap.decorator.classname, wrapping tap: TempHfs["null"][5104596603/test/]
2015-02-12 12:04:44,377 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-12 12:04:44,768 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-12 12:04:44,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:04:44,923 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-12 12:04:44,925 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-12 12:04:44,926 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-02-12 12:04:44,926 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint"]
2015-02-12 12:04:44,926 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  parallel execution is enabled: true
2015-02-12 12:04:44,927 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  starting jobs: 3
2015-02-12 12:04:44,927 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  allocating threads: 3
2015-02-12 12:04:44,928 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/3)
2015-02-12 12:04:44,973 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:04:45,364 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:04:45,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 12:04:45,496 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(286)) - Allocated new applicationId: 1
2015-02-12 12:04:45,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 12:04:45,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 12:04:45,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:04:45,519 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:04:45,521 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004 src: /127.0.0.1:55691 dest: /127.0.0.1:55519
2015-02-12 12:04:45,523 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004 src: /127.0.0.1:55692 dest: /127.0.0.1:55526
2015-02-12 12:04:45,527 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004 src: /127.0.0.1:55693 dest: /127.0.0.1:55529
2015-02-12 12:04:45,535 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55693, dest: /127.0.0.1:55529, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004, duration: 5511000
2015-02-12 12:04:45,535 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:04:45,536 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:04:45,537 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55692, dest: /127.0.0.1:55526, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004, duration: 6766000
2015-02-12 12:04:45,537 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:45,538 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:04:45,539 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55691, dest: /127.0.0.1:55519, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004, duration: 8352000
2015-02-12 12:04:45,539 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:45,540 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:04:45,542 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:04:45,546 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar
2015-02-12 12:04:45,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:04:45,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,664 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 12:04:45,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:04:45,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:04:45,706 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split
2015-02-12 12:04:45,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:04:45,720 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split. BP-1120419527-10.1.1.68-1423771456695 blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:04:45,722 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005 src: /127.0.0.1:55694 dest: /127.0.0.1:55526
2015-02-12 12:04:45,724 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005 src: /127.0.0.1:55695 dest: /127.0.0.1:55529
2015-02-12 12:04:45,726 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005 src: /127.0.0.1:55696 dest: /127.0.0.1:55519
2015-02-12 12:04:45,728 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005 src: /127.0.0.1:55697 dest: /127.0.0.1:55522
2015-02-12 12:04:45,737 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55697, dest: /127.0.0.1:55522, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005, duration: 7562000
2015-02-12 12:04:45,737 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:04:45,738 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:04:45,739 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55696, dest: /127.0.0.1:55519, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005, duration: 9345000
2015-02-12 12:04:45,739 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:45,741 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:04:45,742 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55695, dest: /127.0.0.1:55529, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005, duration: 11746000
2015-02-12 12:04:45,742 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:45,743 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:04:45,744 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55694, dest: /127.0.0.1:55526, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005, duration: 13804000
2015-02-12 12:04:45,745 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:45,746 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:04:45,751 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:04:45,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:04:45,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:04:45,762 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo. BP-1120419527-10.1.1.68-1423771456695 blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:04:45,765 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006 src: /127.0.0.1:55698 dest: /127.0.0.1:55519
2015-02-12 12:04:45,767 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006 src: /127.0.0.1:55699 dest: /127.0.0.1:55526
2015-02-12 12:04:45,769 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006 src: /127.0.0.1:55700 dest: /127.0.0.1:55529
2015-02-12 12:04:45,775 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55700, dest: /127.0.0.1:55529, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006, duration: 3486000
2015-02-12 12:04:45,775 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:04:45,778 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:04:45,778 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55699, dest: /127.0.0.1:55526, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006, duration: 6694000
2015-02-12 12:04:45,778 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:45,781 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:04:45,781 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55698, dest: /127.0.0.1:55519, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006, duration: 9916000
2015-02-12 12:04:45,782 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:45,783 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:04:45,785 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:04:45,785 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:4
2015-02-12 12:04:45,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:04:45,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:04:46,353 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:04:46,355 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007 src: /127.0.0.1:55701 dest: /127.0.0.1:55519
2015-02-12 12:04:46,357 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007 src: /127.0.0.1:55702 dest: /127.0.0.1:55526
2015-02-12 12:04:46,360 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007 src: /127.0.0.1:55703 dest: /127.0.0.1:55522
2015-02-12 12:04:46,380 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55703, dest: /127.0.0.1:55522, bytes: 97245, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007, duration: 18295000
2015-02-12 12:04:46,380 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:04:46,381 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:04:46,381 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55702, dest: /127.0.0.1:55526, bytes: 97245, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007, duration: 19576000
2015-02-12 12:04:46,382 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:46,383 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:04:46,383 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55701, dest: /127.0.0.1:55519, bytes: 97245, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007, duration: 20951000
2015-02-12 12:04:46,384 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:46,385 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:04:46,387 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:04:46,387 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_1423771478362_0001
2015-02-12 12:04:46,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:46,804 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(577)) - Application with id 1 submitted by user soberoi
2015-02-12 12:04:46,805 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(973)) - Storing application with id application_1423771478362_0001
2015-02-12 12:04:46,806 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0001 State change from NEW to NEW_SAVING
2015-02-12 12:04:46,806 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	IP=10.1.1.68	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423771478362_0001
2015-02-12 12:04:46,812 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423771478362_0001
2015-02-12 12:04:46,813 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0001 State change from NEW_SAVING to SUBMITTED
2015-02-12 12:04:46,815 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(386)) - Application added - appId: application_1423771478362_0001 user: soberoi leaf-queue of parent: root #applications: 1
2015-02-12 12:04:46,818 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(716)) - Accepted application application_1423771478362_0001 from user: soberoi, in queue: default
2015-02-12 12:04:46,831 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0001 State change from SUBMITTED to ACCEPTED
2015-02-12 12:04:46,843 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(251)) - Submitted application application_1423771478362_0001
2015-02-12 12:04:46,856 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(670)) - Registering app attempt : appattempt_1423771478362_0001_000001
2015-02-12 12:04:46,862 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0001_000001 State change from NEW to SUBMITTED
2015-02-12 12:04:46,872 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(626)) - Application application_1423771478362_0001 from user: soberoi activated in queue: default
2015-02-12 12:04:46,872 INFO  capacity.LeafQueue (LeafQueue.java:addApplicationAttempt(643)) - Application added - appId: application_1423771478362_0001 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@35816f1c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-02-12 12:04:46,872 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplicationAttempt(746)) - Added Application Attempt appattempt_1423771478362_0001_000001 to scheduler from user soberoi in queue default
2015-02-12 12:04:46,875 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0001_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 12:04:46,966 INFO  mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://Edinburgh.local:55663/proxy/application_1423771478362_0001/
2015-02-12 12:04:46,967 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_1423771478362_0001
2015-02-12 12:04:46,967 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://Edinburgh.local:55663/proxy/application_1423771478362_0001/
2015-02-12 12:04:47,863 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:04:47,864 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000001
2015-02-12 12:04:47,864 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55673, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 12:04:47,865 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0001_000001 container=Container: [ContainerId: container_1423771478362_0001_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:04:47,865 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:04:47,865 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:04:47,881 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55673 for container : container_1423771478362_0001_01_000001
2015-02-12 12:04:47,890 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:04:47,891 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423771478362_0001_000001
2015-02-12 12:04:47,891 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1837)) - Storing attempt: AppId: application_1423771478362_0001 AttemptId: appattempt_1423771478362_0001_000001 MasterContainer: Container: [ContainerId: container_1423771478362_0001_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ]
2015-02-12 12:04:47,893 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 12:04:47,901 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 12:04:47,904 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423771478362_0001_000001
2015-02-12 12:04:47,921 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423771478362_0001_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] for AM appattempt_1423771478362_0001_000001
2015-02-12 12:04:47,921 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423771478362_0001_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 12:04:47,922 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423771478362_0001_000001
2015-02-12 12:04:47,926 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423771478362_0001_000001
2015-02-12 12:04:47,953 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0001_000001 (auth:SIMPLE)
2015-02-12 12:04:47,969 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0001_01_000001 by user soberoi
2015-02-12 12:04:47,986 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0001
2015-02-12 12:04:48,001 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0001 transitioned from NEW to INITING
2015-02-12 12:04:48,002 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0001_01_000001 to application application_1423771478362_0001
2015-02-12 12:04:48,002 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000001
2015-02-12 12:04:48,007 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0001 transitioned from INITING to RUNNING
2015-02-12 12:04:48,010 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 12:04:48,010 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0001
2015-02-12 12:04:48,013 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423771478362_0001_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] for AM appattempt_1423771478362_0001_000001
2015-02-12 12:04:48,015 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0001_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 12:04:48,023 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:04:48,023 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 12:04:48,024 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split transitioned from INIT to DOWNLOADING
2015-02-12 12:04:48,024 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:04:48,024 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:04:48,024 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:04:48,024 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0001_01_000001
2015-02-12 12:04:48,026 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar, 1423771462433, FILE, null }
2015-02-12 12:04:48,032 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423771462045, FILE, null }
2015-02-12 12:04:48,048 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423771478362_0001_01_000001.tokens. Credentials list: 
2015-02-12 12:04:48,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,130 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30004 milliseconds
2015-02-12 12:04:48,131 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(201)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 12:04:48,148 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1492)) - BLOCK* ask 127.0.0.1:55526 to replicate blk_1073741828_1004 to datanode(s) 127.0.0.1:55522
2015-02-12 12:04:48,175 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:04:48,180 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/filecache/10/hadoop-9144650672645034592.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:04:48,210 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:04:48,347 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423771478362_0001_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000001.tokens
2015-02-12 12:04:48,347 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:04:48,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,569 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0001/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:04:48,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,657 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0001/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:04:48,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,699 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,754 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0001/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:04:48,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:04:48,837 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0001/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:04:48,838 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:04:48,853 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:04:48,903 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 12:04:48,903 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:04:49,091 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000001/default_container_executor.sh]
2015-02-12 12:04:49,137 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003
2015-02-12 12:04:49,193 INFO  datanode.DataNode (DataNode.java:transferBlock(1812)) - DatanodeRegistration(127.0.0.1, datanodeUuid=96ab84db-3835-4ade-b715-a77ff6c7c57a, infoPort=55527, ipcPort=55528, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) Starting thread to transfer BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004 to 127.0.0.1:55522 
2015-02-12 12:04:49,199 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004 src: /127.0.0.1:55711 dest: /127.0.0.1:55522
2015-02-12 12:04:49,200 INFO  datanode.DataNode (DataNode.java:run(2020)) - DataTransfer: Transmitted BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004 (numBytes=254067) to /127.0.0.1:55522
2015-02-12 12:04:49,201 INFO  datanode.DataNode (DataXceiver.java:writeBlock(755)) - Received BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004 src: /127.0.0.1:55711 dest: /127.0.0.1:55522 of size 254067
2015-02-12 12:04:49,202 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741828_1004 size 254067
2015-02-12 12:04:50,393 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003
2015-02-12 12:04:53,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:04:53,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 12:04:53,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 12:04:53,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 12:04:53,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001	dst=null	perm=null	proto=rpc
2015-02-12 12:04:53,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:04:53,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:04:53,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:04:53,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:04:53,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:04:53,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:04:53,848 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741827_1003
2015-02-12 12:04:53,848 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006
2015-02-12 12:04:53,848 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005
2015-02-12 12:04:53,849 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007
2015-02-12 12:04:53,851 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004
2015-02-12 12:04:53,851 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005
2015-02-12 12:04:53,853 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007
2015-02-12 12:04:54,141 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006
2015-02-12 12:04:54,143 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004
2015-02-12 12:04:54,144 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005
2015-02-12 12:04:54,145 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741831_1007
2015-02-12 12:04:55,061 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0001_000001 (auth:SIMPLE)
2015-02-12 12:04:55,069 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(274)) - AM registration appattempt_1423771478362_0001_000001
2015-02-12 12:04:55,070 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(127)) - USER=soberoi	IP=10.1.1.68	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423771478362_0001	APPATTEMPTID=appattempt_1423771478362_0001_000001
2015-02-12 12:04:55,070 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0001_000001 State change from LAUNCHED to RUNNING
2015-02-12 12:04:55,070 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0001 State change from ACCEPTED to RUNNING
2015-02-12 12:04:55,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:04:55,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:04:55,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:04:55,403 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004
2015-02-12 12:04:55,403 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741829_1005
2015-02-12 12:04:55,404 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741830_1006
2015-02-12 12:04:55,509 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1_conf.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:04:55,559 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008 src: /127.0.0.1:55784 dest: /127.0.0.1:55529
2015-02-12 12:04:55,561 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008 src: /127.0.0.1:55785 dest: /127.0.0.1:55519
2015-02-12 12:04:55,563 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008 src: /127.0.0.1:55786 dest: /127.0.0.1:55526
2015-02-12 12:04:55,601 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55786, dest: /127.0.0.1:55526, bytes: 114362, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008, duration: 36325000
2015-02-12 12:04:55,602 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:04:55,602 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:04:55,602 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55785, dest: /127.0.0.1:55519, bytes: 114362, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008, duration: 37407000
2015-02-12 12:04:55,603 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:55,604 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:04:55,604 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55784, dest: /127.0.0.1:55529, bytes: 114362, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008, duration: 38783000
2015-02-12 12:04:55,605 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:04:55,605 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:04:55,609 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-519173045_1
2015-02-12 12:04:56,874 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:04:56,875 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000002
2015-02-12 12:04:56,875 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:04:56,875 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0001_000001 container=Container: [ContainerId: container_1423771478362_0001_01_000002, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:04:56,875 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:04:56,876 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:04:56,876 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:04:56,876 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000003
2015-02-12 12:04:56,876 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 12:04:56,877 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0001_000001 container=Container: [ContainerId: container_1423771478362_0001_01_000003, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:04:56,877 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:04:56,877 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:04:56,878 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:04:56,878 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000004
2015-02-12 12:04:56,878 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 12:04:56,878 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0001_000001 container=Container: [ContainerId: container_1423771478362_0001_01_000004, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:04:56,878 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:04:56,878 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:04:56,879 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:04:56,879 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000005
2015-02-12 12:04:56,879 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 12:04:56,879 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0001_000001 container=Container: [ContainerId: container_1423771478362_0001_01_000005, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:04:56,880 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-02-12 12:04:56,880 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-02-12 12:04:57,165 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55669 for container : container_1423771478362_0001_01_000002
2015-02-12 12:04:57,166 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:04:57,168 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:04:57,170 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:04:57,172 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:04:57,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,347 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0001_000001 (auth:SIMPLE)
2015-02-12 12:04:57,349 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0001_000001 (auth:SIMPLE)
2015-02-12 12:04:57,351 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0001_000001 (auth:SIMPLE)
2015-02-12 12:04:57,353 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0001_000001 (auth:SIMPLE)
2015-02-12 12:04:57,361 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0001_01_000005 by user soberoi
2015-02-12 12:04:57,361 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0001_01_000002 by user soberoi
2015-02-12 12:04:57,362 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0001
2015-02-12 12:04:57,361 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0001_01_000003 by user soberoi
2015-02-12 12:04:57,363 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000005
2015-02-12 12:04:57,361 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0001_01_000004 by user soberoi
2015-02-12 12:04:57,362 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0001_01_000002 to application application_1423771478362_0001
2015-02-12 12:04:57,364 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000004
2015-02-12 12:04:57,363 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000003
2015-02-12 12:04:57,362 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000002
2015-02-12 12:04:57,367 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0001 transitioned from NEW to INITING
2015-02-12 12:04:57,369 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0001_01_000005 to application application_1423771478362_0001
2015-02-12 12:04:57,369 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0001_01_000003 to application application_1423771478362_0001
2015-02-12 12:04:57,369 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0001_01_000004 to application application_1423771478362_0001
2015-02-12 12:04:57,370 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0001 transitioned from INITING to RUNNING
2015-02-12 12:04:57,370 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 12:04:57,371 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 12:04:57,371 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 12:04:57,372 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 12:04:57,372 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0001
2015-02-12 12:04:57,372 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0001
2015-02-12 12:04:57,372 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:04:57,374 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0001
2015-02-12 12:04:57,374 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:04:57,374 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:04:57,374 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:04:57,375 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:04:57,375 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0001
2015-02-12 12:04:57,375 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0001
2015-02-12 12:04:57,375 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:04:57,375 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0001
2015-02-12 12:04:57,375 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0001
2015-02-12 12:04:57,376 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0001
2015-02-12 12:04:57,376 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:04:57,376 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0001
2015-02-12 12:04:57,376 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0001
2015-02-12 12:04:57,376 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0001
2015-02-12 12:04:57,376 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:04:57,376 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0001
2015-02-12 12:04:57,377 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0001_01_000004
2015-02-12 12:04:57,377 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar, 1423771462433, FILE, null }
2015-02-12 12:04:57,380 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423771462045, FILE, null }
2015-02-12 12:04:57,381 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0001_01_000002
2015-02-12 12:04:57,381 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar, 1423771462433, FILE, null }
2015-02-12 12:04:57,382 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423771462045, FILE, null }
2015-02-12 12:04:57,382 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0001_01_000003
2015-02-12 12:04:57,382 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar, 1423771462433, FILE, null }
2015-02-12 12:04:57,383 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423771462045, FILE, null }
2015-02-12 12:04:57,383 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0001_01_000005
2015-02-12 12:04:57,383 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar, 1423771462433, FILE, null }
2015-02-12 12:04:57,383 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423771462045, FILE, null }
2015-02-12 12:04:57,406 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0001_01_000005.tokens. Credentials list: 
2015-02-12 12:04:57,408 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423771478362_0001_01_000004.tokens. Credentials list: 
2015-02-12 12:04:57,408 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0001_01_000002.tokens. Credentials list: 
2015-02-12 12:04:57,409 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0001_01_000003.tokens. Credentials list: 
2015-02-12 12:04:57,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,506 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:04:57,508 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/filecache/10/hadoop-9144650672645034592.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:04:57,577 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:04:57,713 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:04:57,736 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0001_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000005.tokens
2015-02-12 12:04:57,736 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:04:57,853 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:04:57,870 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0001_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000003.tokens
2015-02-12 12:04:57,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:04:57,885 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:04:57,886 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:04:57,886 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:04:57,886 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:04:57,888 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:04:57,965 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0001/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:04:58,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:04:58,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:04:58,011 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:04:58,036 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0001_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000002.tokens
2015-02-12 12:04:58,037 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:04:58,086 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0001/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:04:58,086 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:04:58,086 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:04:58,086 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:04:58,087 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:04:58,158 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 12:04:58,158 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:04:58,162 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 12:04:58,163 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:04:58,163 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 12:04:58,163 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:04:58,164 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 12:04:58,164 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:04:58,194 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:04:58,288 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423771478362_0001_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000004.tokens
2015-02-12 12:04:58,289 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:04:58,360 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000002/default_container_executor.sh]
2015-02-12 12:04:58,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000003/default_container_executor.sh]
2015-02-12 12:04:58,413 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000005/default_container_executor.sh]
2015-02-12 12:04:58,433 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000004/default_container_executor.sh]
2015-02-12 12:04:58,860 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741828_1004
2015-02-12 12:05:03,869 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008
2015-02-12 12:05:04,164 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008
2015-02-12 12:05:05,412 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741832_1008
2015-02-12 12:05:06,867 INFO  hs.JobHistory (JobHistory.java:run(198)) - History Cleaner started
2015-02-12 12:05:06,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null	proto=rpc
2015-02-12 12:05:06,870 INFO  hs.JobHistory (JobHistory.java:run(204)) - History Cleaner complete
2015-02-12 12:05:12,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:12,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:12,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:12,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:13,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:05:13,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:05:13,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:05:13,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:13,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:13,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:13,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:05:13,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:14,668 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000002_0/part-00002. BP-1120419527-10.1.1.68-1423771456695 blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:05:14,787 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000003_0/part-00003. BP-1120419527-10.1.1.68-1423771456695 blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:14,862 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000000_0/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:05:14,904 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009 src: /127.0.0.1:55862 dest: /127.0.0.1:55522
2015-02-12 12:05:14,907 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009 src: /127.0.0.1:55866 dest: /127.0.0.1:55519
2015-02-12 12:05:14,908 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009 src: /127.0.0.1:55867 dest: /127.0.0.1:55526
2015-02-12 12:05:14,939 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011 src: /127.0.0.1:55865 dest: /127.0.0.1:55526
2015-02-12 12:05:14,949 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011 src: /127.0.0.1:55868 dest: /127.0.0.1:55522
2015-02-12 12:05:14,952 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011 src: /127.0.0.1:55869 dest: /127.0.0.1:55529
2015-02-12 12:05:14,985 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010 src: /127.0.0.1:55863 dest: /127.0.0.1:55526
2015-02-12 12:05:14,988 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010 src: /127.0.0.1:55871 dest: /127.0.0.1:55529
2015-02-12 12:05:14,990 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010 src: /127.0.0.1:55872 dest: /127.0.0.1:55522
2015-02-12 12:05:15,033 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55867, dest: /127.0.0.1:55526, bytes: 152, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000002_0_346092669_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009, duration: 122977000
2015-02-12 12:05:15,033 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:15,034 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55866, dest: /127.0.0.1:55519, bytes: 152, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000002_0_346092669_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009, duration: 124011000
2015-02-12 12:05:15,034 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:05:15,035 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:05:15,036 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55862, dest: /127.0.0.1:55522, bytes: 152, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000002_0_346092669_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009, duration: 126052000
2015-02-12 12:05:15,036 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,035 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,038 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:15,041 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000002_0/part-00002 is closed by DFSClient_attempt_1423771478362_0001_m_000002_0_346092669_1
2015-02-12 12:05:15,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000002	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000002_0	dst=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000002	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:05:15,098 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0001_000001 (auth:SIMPLE)
2015-02-12 12:05:15,103 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0001_01_000004
2015-02-12 12:05:15,103 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000004
2015-02-12 12:05:15,103 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000004 transitioned from RUNNING to KILLING
2015-02-12 12:05:15,104 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0001_01_000004
2015-02-12 12:05:15,124 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0001_01_000004 is : 143
2015-02-12 12:05:15,125 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1.jhist. BP-1120419527-10.1.1.68-1423771456695 blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:05:15,127 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741836_1012 src: /127.0.0.1:55875 dest: /127.0.0.1:55529
2015-02-12 12:05:15,129 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741836_1012 src: /127.0.0.1:55876 dest: /127.0.0.1:55519
2015-02-12 12:05:15,131 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741836_1012 src: /127.0.0.1:55877 dest: /127.0.0.1:55526
2015-02-12 12:05:15,139 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4450)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1.jhist for DFSClient_NONMAPREDUCE_-519173045_1
2015-02-12 12:05:15,143 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:05:15,144 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000004
2015-02-12 12:05:15,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000004
2015-02-12 12:05:15,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000004
2015-02-12 12:05:15,147 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000004
2015-02-12 12:05:15,147 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000004
2015-02-12 12:05:15,149 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:05:15,149 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0001_01_000004 from application application_1423771478362_0001
2015-02-12 12:05:15,149 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:15,149 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0001
2015-02-12 12:05:15,223 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55872, dest: /127.0.0.1:55522, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000003_0_2022125776_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010, duration: 231029000
2015-02-12 12:05:15,224 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:15,224 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:15,224 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55871, dest: /127.0.0.1:55529, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000003_0_2022125776_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010, duration: 232123000
2015-02-12 12:05:15,225 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,226 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:15,227 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55863, dest: /127.0.0.1:55526, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000003_0_2022125776_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010, duration: 233221000
2015-02-12 12:05:15,227 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,228 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:15,231 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000003_0/part-00003 is closed by DFSClient_attempt_1423771478362_0001_m_000003_0_2022125776_1
2015-02-12 12:05:15,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,243 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000001_0/part-00001. BP-1120419527-10.1.1.68-1423771456695 blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:15,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000003	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000003_0	dst=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000003	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:05:15,273 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0001_000001 (auth:SIMPLE)
2015-02-12 12:05:15,276 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0001_01_000005
2015-02-12 12:05:15,276 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000005
2015-02-12 12:05:15,276 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000005 transitioned from RUNNING to KILLING
2015-02-12 12:05:15,277 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0001_01_000005
2015-02-12 12:05:15,278 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:15,278 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0001_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 12:05:15,278 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000004
2015-02-12 12:05:15,278 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 12:05:15,279 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-02-12 12:05:15,279 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0001_01_000004, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:15,279 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:15,280 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:05:15,280 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0001_000001 released container container_1423771478362_0001_01_000004 on node: host: 10.1.1.68:55669 #containers=3 available=1024 used=3072 with event: FINISHED
2015-02-12 12:05:15,304 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0001_01_000005 is : 143
2015-02-12 12:05:15,388 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:05:15,389 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000005
2015-02-12 12:05:15,390 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000005
2015-02-12 12:05:15,392 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000005
2015-02-12 12:05:15,394 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000005
2015-02-12 12:05:15,395 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000005
2015-02-12 12:05:15,395 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:05:15,395 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0001_01_000005 from application application_1423771478362_0001
2015-02-12 12:05:15,396 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:15,396 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0001
2015-02-12 12:05:15,400 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55869, dest: /127.0.0.1:55529, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000000_0_1517189186_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011, duration: 446863000
2015-02-12 12:05:15,401 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:15,401 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:15,402 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55868, dest: /127.0.0.1:55522, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000000_0_1517189186_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011, duration: 447851000
2015-02-12 12:05:15,402 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,402 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:15,402 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55865, dest: /127.0.0.1:55526, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000000_0_1517189186_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011, duration: 448787000
2015-02-12 12:05:15,403 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,403 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:15,407 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000000_0/part-00000 is closed by DFSClient_attempt_1423771478362_0001_m_000000_0_1517189186_1
2015-02-12 12:05:15,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000000_0	dst=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:05:15,448 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0001_000001 (auth:SIMPLE)
2015-02-12 12:05:15,451 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0001_01_000002
2015-02-12 12:05:15,452 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000002
2015-02-12 12:05:15,453 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:15,453 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000002 transitioned from RUNNING to KILLING
2015-02-12 12:05:15,453 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:15,453 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0001_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 12:05:15,453 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000005
2015-02-12 12:05:15,454 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 12:05:15,454 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-02-12 12:05:15,453 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0001_01_000002
2015-02-12 12:05:15,456 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0001_01_000005, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:15,456 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:15,456 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:05:15,457 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0001_000001 released container container_1423771478362_0001_01_000005 on node: host: 10.1.1.68:55669 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 12:05:15,474 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0001_01_000002 is : 143
2015-02-12 12:05:15,481 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013 src: /127.0.0.1:55880 dest: /127.0.0.1:55529
2015-02-12 12:05:15,482 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013 src: /127.0.0.1:55883 dest: /127.0.0.1:55519
2015-02-12 12:05:15,484 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013 src: /127.0.0.1:55884 dest: /127.0.0.1:55522
2015-02-12 12:05:15,491 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:05:15,493 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000002
2015-02-12 12:05:15,494 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000002
2015-02-12 12:05:15,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000002
2015-02-12 12:05:15,518 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000002
2015-02-12 12:05:15,538 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000002
2015-02-12 12:05:15,538 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:05:15,538 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0001_01_000002 from application application_1423771478362_0001
2015-02-12 12:05:15,538 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:15,538 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0001
2015-02-12 12:05:15,663 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55884, dest: /127.0.0.1:55522, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000001_0_783862006_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013, duration: 177007000
2015-02-12 12:05:15,663 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:15,663 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:15,664 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55883, dest: /127.0.0.1:55519, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000001_0_783862006_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013, duration: 177939000
2015-02-12 12:05:15,664 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,665 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:15,665 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55880, dest: /127.0.0.1:55529, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0001_m_000001_0_783862006_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013, duration: 178806000
2015-02-12 12:05:15,665 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:15,665 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,670 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000001_0/part-00001 is closed by DFSClient_attempt_1423771478362_0001_m_000001_0_783862006_1
2015-02-12 12:05:15,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000001	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/_temporary/attempt_1423771478362_0001_m_000001_0	dst=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000001	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:05:15,709 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0001_000001 (auth:SIMPLE)
2015-02-12 12:05:15,712 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0001_01_000003
2015-02-12 12:05:15,712 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000003
2015-02-12 12:05:15,713 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000003 transitioned from RUNNING to KILLING
2015-02-12 12:05:15,713 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:15,713 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0001_01_000003
2015-02-12 12:05:15,713 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0001_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 12:05:15,714 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000002
2015-02-12 12:05:15,714 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 12:05:15,714 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-02-12 12:05:15,715 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0001_01_000002, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:15,715 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:15,715 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:05:15,715 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0001_000001 released container container_1423771478362_0001_01_000002 on node: host: 10.1.1.68:55669 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 12:05:15,715 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:15,715 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:15,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:15,723 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-519173045_1
2015-02-12 12:05:15,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,734 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0001_01_000003 is : 143
2015-02-12 12:05:15,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000000/part-00000	dst=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:15,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000001	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,750 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:05:15,751 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000003
2015-02-12 12:05:15,752 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000003
2015-02-12 12:05:15,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,752 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000003
2015-02-12 12:05:15,753 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000003
2015-02-12 12:05:15,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000001/part-00001	dst=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00001	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:15,754 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000003
2015-02-12 12:05:15,754 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:05:15,755 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0001_01_000003 from application application_1423771478362_0001
2015-02-12 12:05:15,755 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:15,755 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0001
2015-02-12 12:05:15,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,758 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000002	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000002/part-00002	dst=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00002	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:15,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000003	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary/1/task_1423771478362_0001_m_000003/part-00003	dst=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00003	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:15,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:15,787 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-519173045_1
2015-02-12 12:05:15,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:15,791 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-519173045_1
2015-02-12 12:05:15,807 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55877, dest: /127.0.0.1:55526, bytes: 47536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741836_1012, duration: 675121000
2015-02-12 12:05:15,808 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741836_1012, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:15,809 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 15495
2015-02-12 12:05:15,809 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55876, dest: /127.0.0.1:55519, bytes: 47536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741836_1012, duration: 676669000
2015-02-12 12:05:15,809 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,810 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 15495
2015-02-12 12:05:15,810 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55875, dest: /127.0.0.1:55529, bytes: 47536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741836_1012, duration: 678170000
2015-02-12 12:05:15,811 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,811 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 15495
2015-02-12 12:05:15,813 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1.jhist is closed by DFSClient_NONMAPREDUCE_-519173045_1
2015-02-12 12:05:15,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:15,820 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001.summary_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:05:15,822 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014 src: /127.0.0.1:55886 dest: /127.0.0.1:55529
2015-02-12 12:05:15,824 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014 src: /127.0.0.1:55887 dest: /127.0.0.1:55519
2015-02-12 12:05:15,825 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014 src: /127.0.0.1:55888 dest: /127.0.0.1:55526
2015-02-12 12:05:15,830 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55888, dest: /127.0.0.1:55526, bytes: 404, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014, duration: 3000000
2015-02-12 12:05:15,830 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:15,831 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:05:15,831 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55887, dest: /127.0.0.1:55519, bytes: 404, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014, duration: 3928000
2015-02-12 12:05:15,831 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,832 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:05:15,832 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55886, dest: /127.0.0.1:55529, bytes: 404, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014, duration: 4805000
2015-02-12 12:05:15,832 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,833 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:05:15,834 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001.summary_tmp is closed by DFSClient_NONMAPREDUCE_-519173045_1
2015-02-12 12:05:15,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:15,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,850 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:15,862 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:15,865 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015 src: /127.0.0.1:55890 dest: /127.0.0.1:55529
2015-02-12 12:05:15,866 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015 src: /127.0.0.1:55891 dest: /127.0.0.1:55526
2015-02-12 12:05:15,868 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015 src: /127.0.0.1:55892 dest: /127.0.0.1:55522
2015-02-12 12:05:15,877 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55892, dest: /127.0.0.1:55522, bytes: 47536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015, duration: 7784000
2015-02-12 12:05:15,878 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:15,878 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:15,878 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55891, dest: /127.0.0.1:55526, bytes: 47536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015, duration: 8737000
2015-02-12 12:05:15,879 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,879 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55890, dest: /127.0.0.1:55529, bytes: 47536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015, duration: 9571000
2015-02-12 12:05:15,879 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:15,879 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,880 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:15,881 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-519173045_1
2015-02-12 12:05:15,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:15,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001/job_1423771478362_0001_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:15,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:15,901 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001_conf.xml_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:05:15,903 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016 src: /127.0.0.1:55894 dest: /127.0.0.1:55519
2015-02-12 12:05:15,904 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016 src: /127.0.0.1:55895 dest: /127.0.0.1:55526
2015-02-12 12:05:15,906 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016 src: /127.0.0.1:55896 dest: /127.0.0.1:55529
2015-02-12 12:05:15,911 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55896, dest: /127.0.0.1:55529, bytes: 114362, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016, duration: 3569000
2015-02-12 12:05:15,912 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:15,912 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:05:15,912 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55895, dest: /127.0.0.1:55526, bytes: 114362, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016, duration: 4244000
2015-02-12 12:05:15,913 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,913 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55894, dest: /127.0.0.1:55519, bytes: 114362, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-519173045_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016, duration: 5285000
2015-02-12 12:05:15,914 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:15,914 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:05:15,914 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:05:15,916 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-519173045_1
2015-02-12 12:05:15,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:15,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:15,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:15,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:15,950 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1129)) - Updating application attempt appattempt_1423771478362_0001_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 12:05:15,951 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0001_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 12:05:15,951 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(992)) - Updating application application_1423771478362_0001 with final state: FINISHING
2015-02-12 12:05:15,952 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0001 State change from RUNNING to FINAL_SAVING
2015-02-12 12:05:15,952 INFO  recovery.RMStateStore (RMStateStore.java:transition(161)) - Updating info for app: application_1423771478362_0001
2015-02-12 12:05:15,953 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0001_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 12:05:15,953 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0001 State change from FINAL_SAVING to FINISHING
2015-02-12 12:05:16,719 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:16,719 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:16,719 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0001_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 12:05:16,720 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000003
2015-02-12 12:05:16,720 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:05:16,720 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:05:16,721 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0001_01_000003, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:16,721 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:16,721 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:05:16,721 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0001_000001 released container container_1423771478362_0001_01_000003 on node: host: 10.1.1.68:55669 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:05:16,721 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:16,721 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:16,962 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(351)) - application_1423771478362_0001 unregistered successfully. 
2015-02-12 12:05:16,966 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741828_1004 127.0.0.1:55519 127.0.0.1:55526 127.0.0.1:55529 127.0.0.1:55522 
2015-02-12 12:05:16,966 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741829_1005 127.0.0.1:55526 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:05:16,967 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741830_1006 127.0.0.1:55519 127.0.0.1:55526 127.0.0.1:55529 
2015-02-12 12:05:16,967 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741831_1007 127.0.0.1:55519 127.0.0.1:55526 127.0.0.1:55522 
2015-02-12 12:05:16,967 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741836_1012 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55526 
2015-02-12 12:05:16,967 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741832_1008 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55526 
2015-02-12 12:05:16,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0001	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,094 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (2/3)
2015-02-12 12:05:17,112 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:05:17,132 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:05:17,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,143 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(286)) - Allocated new applicationId: 2
2015-02-12 12:05:17,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 12:05:17,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 12:05:17,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:17,158 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:17,160 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017 src: /127.0.0.1:55899 dest: /127.0.0.1:55526
2015-02-12 12:05:17,161 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017 src: /127.0.0.1:55900 dest: /127.0.0.1:55519
2015-02-12 12:05:17,163 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017 src: /127.0.0.1:55901 dest: /127.0.0.1:55522
2015-02-12 12:05:17,169 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55901, dest: /127.0.0.1:55522, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017, duration: 3419000
2015-02-12 12:05:17,169 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:17,170 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:17,170 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55900, dest: /127.0.0.1:55519, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017, duration: 4424000
2015-02-12 12:05:17,170 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:17,171 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:05:17,171 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55899, dest: /127.0.0.1:55526, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017, duration: 5071000
2015-02-12 12:05:17,171 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:17,173 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:17,174 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:17,175 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar
2015-02-12 12:05:17,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:17,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,198 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 4
2015-02-12 12:05:17,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:17,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:17,204 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split
2015-02-12 12:05:17,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,206 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split. BP-1120419527-10.1.1.68-1423771456695 blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:05:17,208 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018 src: /127.0.0.1:55902 dest: /127.0.0.1:55522
2015-02-12 12:05:17,209 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018 src: /127.0.0.1:55903 dest: /127.0.0.1:55519
2015-02-12 12:05:17,211 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018 src: /127.0.0.1:55904 dest: /127.0.0.1:55526
2015-02-12 12:05:17,213 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018 src: /127.0.0.1:55905 dest: /127.0.0.1:55529
2015-02-12 12:05:17,218 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55905, dest: /127.0.0.1:55529, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018, duration: 3343000
2015-02-12 12:05:17,218 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:17,218 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:17,219 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55904, dest: /127.0.0.1:55526, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018, duration: 4333000
2015-02-12 12:05:17,219 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:17,219 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:17,220 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55903, dest: /127.0.0.1:55519, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018, duration: 5781000
2015-02-12 12:05:17,220 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:17,221 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:05:17,221 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55902, dest: /127.0.0.1:55522, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018, duration: 6561000
2015-02-12 12:05:17,221 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:17,222 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:05:17,223 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:17,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:17,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:17,229 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo. BP-1120419527-10.1.1.68-1423771456695 blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:17,231 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019 src: /127.0.0.1:55906 dest: /127.0.0.1:55529
2015-02-12 12:05:17,233 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019 src: /127.0.0.1:55907 dest: /127.0.0.1:55526
2015-02-12 12:05:17,234 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019 src: /127.0.0.1:55908 dest: /127.0.0.1:55522
2015-02-12 12:05:17,241 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55908, dest: /127.0.0.1:55522, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019, duration: 4206000
2015-02-12 12:05:17,241 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:17,241 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:17,242 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55907, dest: /127.0.0.1:55526, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019, duration: 4816000
2015-02-12 12:05:17,242 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:17,243 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:17,243 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55906, dest: /127.0.0.1:55529, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019, duration: 6102000
2015-02-12 12:05:17,243 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:17,244 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:17,245 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:17,246 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:4
2015-02-12 12:05:17,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:17,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:17,297 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:17,299 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020 src: /127.0.0.1:55909 dest: /127.0.0.1:55519
2015-02-12 12:05:17,300 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020 src: /127.0.0.1:55910 dest: /127.0.0.1:55529
2015-02-12 12:05:17,302 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020 src: /127.0.0.1:55911 dest: /127.0.0.1:55522
2015-02-12 12:05:17,312 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55911, dest: /127.0.0.1:55522, bytes: 98411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020, duration: 8348000
2015-02-12 12:05:17,312 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:17,313 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:17,313 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55910, dest: /127.0.0.1:55529, bytes: 98411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020, duration: 9144000
2015-02-12 12:05:17,313 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:17,313 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:17,314 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55909, dest: /127.0.0.1:55519, bytes: 98411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020, duration: 10078000
2015-02-12 12:05:17,314 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:17,315 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:17,316 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:17,317 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_1423771478362_0002
2015-02-12 12:05:17,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:17,343 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(577)) - Application with id 2 submitted by user soberoi
2015-02-12 12:05:17,343 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(973)) - Storing application with id application_1423771478362_0002
2015-02-12 12:05:17,343 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	IP=10.1.1.68	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423771478362_0002
2015-02-12 12:05:17,343 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423771478362_0002
2015-02-12 12:05:17,343 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0002 State change from NEW to NEW_SAVING
2015-02-12 12:05:17,343 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0002 State change from NEW_SAVING to SUBMITTED
2015-02-12 12:05:17,344 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(386)) - Application added - appId: application_1423771478362_0002 user: soberoi leaf-queue of parent: root #applications: 2
2015-02-12 12:05:17,344 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(716)) - Accepted application application_1423771478362_0002 from user: soberoi, in queue: default
2015-02-12 12:05:17,344 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0002 State change from SUBMITTED to ACCEPTED
2015-02-12 12:05:17,344 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(670)) - Registering app attempt : appattempt_1423771478362_0002_000001
2015-02-12 12:05:17,345 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0002_000001 State change from NEW to SUBMITTED
2015-02-12 12:05:17,346 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(626)) - Application application_1423771478362_0002 from user: soberoi activated in queue: default
2015-02-12 12:05:17,346 INFO  capacity.LeafQueue (LeafQueue.java:addApplicationAttempt(643)) - Application added - appId: application_1423771478362_0002 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@35816f1c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-02-12 12:05:17,346 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplicationAttempt(746)) - Added Application Attempt appattempt_1423771478362_0002_000001 to scheduler from user soberoi in queue default
2015-02-12 12:05:17,347 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(251)) - Submitted application application_1423771478362_0002
2015-02-12 12:05:17,347 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0002_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 12:05:17,350 INFO  mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://Edinburgh.local:55663/proxy/application_1423771478362_0002/
2015-02-12 12:05:17,351 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_1423771478362_0002
2015-02-12 12:05:17,351 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://Edinburgh.local:55663/proxy/application_1423771478362_0002/
2015-02-12 12:05:17,720 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:17,720 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:17,721 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:17,721 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:17,721 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:05:17,721 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000001
2015-02-12 12:05:17,721 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55669, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 12:05:17,722 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0002_000001 container=Container: [ContainerId: container_1423771478362_0002_01_000001, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:05:17,722 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-02-12 12:05:17,722 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:17,730 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55669 for container : container_1423771478362_0002_01_000001
2015-02-12 12:05:17,734 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:05:17,734 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423771478362_0002_000001
2015-02-12 12:05:17,734 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1837)) - Storing attempt: AppId: application_1423771478362_0002 AttemptId: appattempt_1423771478362_0002_000001 MasterContainer: Container: [ContainerId: container_1423771478362_0002_01_000001, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ]
2015-02-12 12:05:17,735 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0002_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 12:05:17,736 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0002_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 12:05:17,737 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423771478362_0002_000001
2015-02-12 12:05:17,739 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423771478362_0002_01_000001, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] for AM appattempt_1423771478362_0002_000001
2015-02-12 12:05:17,739 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423771478362_0002_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 12:05:17,740 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423771478362_0002_000001
2015-02-12 12:05:17,740 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423771478362_0002_000001
2015-02-12 12:05:17,745 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:17,748 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0002_01_000001 by user soberoi
2015-02-12 12:05:17,748 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0002
2015-02-12 12:05:17,749 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000001
2015-02-12 12:05:17,749 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0002 transitioned from NEW to INITING
2015-02-12 12:05:17,749 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0002_01_000001 to application application_1423771478362_0002
2015-02-12 12:05:17,749 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0002 transitioned from INITING to RUNNING
2015-02-12 12:05:17,749 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423771478362_0002_01_000001, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] for AM appattempt_1423771478362_0002_000001
2015-02-12 12:05:17,750 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0002_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 12:05:17,750 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 12:05:17,750 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0002
2015-02-12 12:05:17,750 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:05:17,750 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 12:05:17,750 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split transitioned from INIT to DOWNLOADING
2015-02-12 12:05:17,751 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:05:17,751 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0002_01_000001
2015-02-12 12:05:17,766 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0002_01_000001.tokens. Credentials list: 
2015-02-12 12:05:17,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:05:18,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0002_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000001.tokens
2015-02-12 12:05:18,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0002
2015-02-12 12:05:18,136 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30006 milliseconds
2015-02-12 12:05:18,137 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(201)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 12:05:18,196 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1492)) - BLOCK* ask 127.0.0.1:55519 to replicate blk_1073741841_1017 to datanode(s) 127.0.0.1:55529
2015-02-12 12:05:18,196 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55529 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741830_1006, blk_1073741832_1008, blk_1073741836_1012]
2015-02-12 12:05:18,196 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55519 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741836_1012]
2015-02-12 12:05:18,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:18,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:18,315 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0002/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:18,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:18,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:18,403 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0002/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:18,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:18,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:18,509 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0002/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:18,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:18,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:18,629 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0002/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:18,630 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:05:18,679 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 12:05:18,679 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:18,726 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:05:18,726 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:18,726 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:18,726 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:18,726 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:18,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000001/default_container_executor.sh]
2015-02-12 12:05:18,927 INFO  datanode.DataNode (DataNode.java:transferBlock(1812)) - DatanodeRegistration(127.0.0.1, datanodeUuid=7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, infoPort=55520, ipcPort=55521, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) Starting thread to transfer BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017 to 127.0.0.1:55529 
2015-02-12 12:05:18,928 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741828 for deletion
2015-02-12 12:05:18,930 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 12:05:18,932 INFO  datanode.DataNode (DataNode.java:run(2020)) - DataTransfer: Transmitted BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017 (numBytes=254067) to /127.0.0.1:55529
2015-02-12 12:05:18,931 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741828
2015-02-12 12:05:18,939 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741830 for deletion
2015-02-12 12:05:18,939 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741831 for deletion
2015-02-12 12:05:18,940 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741832 for deletion
2015-02-12 12:05:18,940 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741836 for deletion
2015-02-12 12:05:18,940 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 12:05:18,940 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741830
2015-02-12 12:05:18,940 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741831
2015-02-12 12:05:18,940 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741832
2015-02-12 12:05:18,941 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741836
2015-02-12 12:05:18,939 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017 src: /127.0.0.1:55952 dest: /127.0.0.1:55529
2015-02-12 12:05:18,943 INFO  datanode.DataNode (DataXceiver.java:writeBlock(755)) - Received BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017 src: /127.0.0.1:55952 dest: /127.0.0.1:55529 of size 254067
2015-02-12 12:05:18,947 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741841_1017 size 254067
2015-02-12 12:05:19,727 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:19,728 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:19,728 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:19,728 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:20,430 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010
2015-02-12 12:05:20,431 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011
2015-02-12 12:05:20,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741828 for deletion
2015-02-12 12:05:20,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 12:05:20,618 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741828
2015-02-12 12:05:20,618 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741830 for deletion
2015-02-12 12:05:20,618 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741832 for deletion
2015-02-12 12:05:20,618 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 12:05:20,618 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741836 for deletion
2015-02-12 12:05:20,618 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741830
2015-02-12 12:05:20,618 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741832
2015-02-12 12:05:20,619 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741836
2015-02-12 12:05:20,735 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:20,736 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:20,736 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:20,736 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:21,206 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741836_1012]
2015-02-12 12:05:21,206 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741831_1007]
2015-02-12 12:05:21,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:05:21,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 12:05:21,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 12:05:21,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 12:05:21,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002	dst=null	perm=null	proto=rpc
2015-02-12 12:05:21,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:05:21,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:05:21,745 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:21,745 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:21,746 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:21,746 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:21,932 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741828 for deletion
2015-02-12 12:05:21,932 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 12:05:21,932 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741831 for deletion
2015-02-12 12:05:21,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741828
2015-02-12 12:05:21,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741831
2015-02-12 12:05:21,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 12:05:21,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:21,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:22,027 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(346)) - Container container_1423771478362_0001_01_000001 succeeded 
2015-02-12 12:05:22,029 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 12:05:22,029 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0001_01_000001
2015-02-12 12:05:22,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000001
2015-02-12 12:05:22,078 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000001
2015-02-12 12:05:22,078 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000001
2015-02-12 12:05:22,079 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0001/container_1423771478362_0001_01_000001
2015-02-12 12:05:22,080 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000001
2015-02-12 12:05:22,081 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0001_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 12:05:22,081 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0001_01_000001 from application application_1423771478362_0001
2015-02-12 12:05:22,081 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:22,081 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0001
2015-02-12 12:05:22,235 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741828 for deletion
2015-02-12 12:05:22,235 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 12:05:22,236 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741828
2015-02-12 12:05:22,236 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741830 for deletion
2015-02-12 12:05:22,236 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741831 for deletion
2015-02-12 12:05:22,236 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 12:05:22,236 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741830
2015-02-12 12:05:22,236 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741832 for deletion
2015-02-12 12:05:22,236 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741836 for deletion
2015-02-12 12:05:22,237 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741831
2015-02-12 12:05:22,237 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741832
2015-02-12 12:05:22,237 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741836
2015-02-12 12:05:22,753 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:22,753 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:22,753 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:22,753 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:23,041 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0001_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:23,041 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(676)) - Unregistering app attempt : appattempt_1423771478362_0001_000001
2015-02-12 12:05:23,041 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0001_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 12:05:23,041 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000001
2015-02-12 12:05:23,042 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55673, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:05:23,042 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:05:23,042 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423771478362_0001_000001
2015-02-12 12:05:23,042 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0001_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:23,042 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:23,042 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-02-12 12:05:23,042 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0001_000001 released container container_1423771478362_0001_01_000001 on node: host: 10.1.1.68:55673 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:05:23,043 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0001_000001 State change from FINISHING to FINISHED
2015-02-12 12:05:23,044 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0001 State change from FINISHING to FINISHED
2015-02-12 12:05:23,044 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplicationAttempt(785)) - Application Attempt appattempt_1423771478362_0001_000001 is done. finalState=FINISHED
2015-02-12 12:05:23,045 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423771478362_0001 requests cleared
2015-02-12 12:05:23,045 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423771478362_0001_000001
2015-02-12 12:05:23,045 INFO  capacity.LeafQueue (LeafQueue.java:removeApplicationAttempt(686)) - Application removed - appId: application_1423771478362_0001 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-02-12 12:05:23,046 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(411)) - Application removed - appId: application_1423771478362_0001 user: soberoi leaf-queue of parent: root #applications: 1
2015-02-12 12:05:23,046 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423771478362_0001
2015-02-12 12:05:23,047 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(179)) - appId=application_1423771478362_0001,name=[61F0DA785F0A4444B72F9543DFADE737/1C5E90869A64474CAD91176B49D5DA9C] test/(1/3),user=soberoi,queue=default,state=FINISHED,trackingUrl=http://Edinburgh.local:55663/proxy/application_1423771478362_0001/jobhistory/job/job_1423771478362_0001,appMasterHost=10.1.1.68,startTime=1423771486804,finishTime=1423771515951,finalStatus=SUCCEEDED
2015-02-12 12:05:23,050 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0001_000001 (auth:SIMPLE)
2015-02-12 12:05:23,054 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0001_01_000001
2015-02-12 12:05:23,055 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0001	CONTAINERID=container_1423771478362_0001_01_000001
2015-02-12 12:05:23,055 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:23,055 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0001_01_000001]
2015-02-12 12:05:23,057 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:05:23,057 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:05:23,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:05:23,058 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0001
2015-02-12 12:05:23,059 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:05:23,059 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:05:23,059 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:05:23,060 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0001, with delay of 10800 seconds
2015-02-12 12:05:23,465 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:23,470 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(274)) - AM registration appattempt_1423771478362_0002_000001
2015-02-12 12:05:23,470 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(127)) - USER=soberoi	IP=10.1.1.68	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423771478362_0002	APPATTEMPTID=appattempt_1423771478362_0002_000001
2015-02-12 12:05:23,471 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0002_000001 State change from LAUNCHED to RUNNING
2015-02-12 12:05:23,471 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0002 State change from ACCEPTED to RUNNING
2015-02-12 12:05:23,502 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(691)) - Number of transactions: 176 Total time for transactions(ms): 39 Number of transactions batched in Syncs: 0 Number of syncs: 111 SyncTimes(ms): 6 2 
2015-02-12 12:05:23,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:23,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:05:23,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:23,759 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0001_01_000004]
2015-02-12 12:05:23,759 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:23,759 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:23,760 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:23,760 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:23,760 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:05:23,760 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:05:23,761 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:05:23,761 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:05:23,761 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0001
2015-02-12 12:05:23,762 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:05:23,761 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0001
2015-02-12 12:05:23,762 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0001, with delay of 10800 seconds
2015-02-12 12:05:23,771 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1_conf.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:23,822 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021 src: /127.0.0.1:55978 dest: /127.0.0.1:55526
2015-02-12 12:05:23,824 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021 src: /127.0.0.1:55979 dest: /127.0.0.1:55529
2015-02-12 12:05:23,826 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021 src: /127.0.0.1:55980 dest: /127.0.0.1:55522
2015-02-12 12:05:23,861 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55980, dest: /127.0.0.1:55522, bytes: 115624, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021, duration: 33869000
2015-02-12 12:05:23,862 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:23,862 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:23,862 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55979, dest: /127.0.0.1:55529, bytes: 115624, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021, duration: 34730000
2015-02-12 12:05:23,863 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:23,863 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:23,863 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:55978, dest: /127.0.0.1:55526, bytes: 115624, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021, duration: 35789000
2015-02-12 12:05:23,863 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:23,864 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:23,868 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1_conf.xml is closed by DFSClient_NONMAPREDUCE_364727529_1
2015-02-12 12:05:23,890 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010
2015-02-12 12:05:23,891 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011
2015-02-12 12:05:23,891 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013
2015-02-12 12:05:23,891 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020
2015-02-12 12:05:23,892 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009
2015-02-12 12:05:23,892 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009
2015-02-12 12:05:23,892 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018
2015-02-12 12:05:23,892 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013
2015-02-12 12:05:23,893 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014
2015-02-12 12:05:23,894 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016
2015-02-12 12:05:23,894 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017
2015-02-12 12:05:23,895 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020
2015-02-12 12:05:23,896 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015
2015-02-12 12:05:23,896 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019
2015-02-12 12:05:23,897 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017
2015-02-12 12:05:23,897 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018
2015-02-12 12:05:24,182 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741834_1010
2015-02-12 12:05:24,182 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741833_1009
2015-02-12 12:05:24,183 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741835_1011
2015-02-12 12:05:24,183 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015
2015-02-12 12:05:24,184 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016
2015-02-12 12:05:24,186 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017
2015-02-12 12:05:24,187 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018
2015-02-12 12:05:24,187 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014
2015-02-12 12:05:24,187 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019
2015-02-12 12:05:24,762 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:24,762 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:24,762 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:24,763 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:05:24,763 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000002
2015-02-12 12:05:24,763 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 12:05:24,763 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0002_000001 container=Container: [ContainerId: container_1423771478362_0002_01_000002, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:05:24,764 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:05:24,764 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:24,764 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:05:24,764 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000003
2015-02-12 12:05:24,764 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 12:05:24,764 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0002_000001 container=Container: [ContainerId: container_1423771478362_0002_01_000003, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:05:24,765 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:05:24,765 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:24,999 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:05:24,999 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000004
2015-02-12 12:05:24,999 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0002_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:05:24,999 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0002_000001 container=Container: [ContainerId: container_1423771478362_0002_01_000004, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:05:24,999 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:05:25,000 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:25,000 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:05:25,000 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000005
2015-02-12 12:05:25,000 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0002_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 12:05:25,000 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0002_000001 container=Container: [ContainerId: container_1423771478362_0002_01_000005, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:05:25,001 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-02-12 12:05:25,001 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:25,437 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741838_1014
2015-02-12 12:05:25,438 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741837_1013
2015-02-12 12:05:25,438 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741842_1018
2015-02-12 12:05:25,439 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741839_1015
2015-02-12 12:05:25,441 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741841_1017
2015-02-12 12:05:25,442 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741840_1016
2015-02-12 12:05:25,442 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741843_1019
2015-02-12 12:05:25,443 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741844_1020
2015-02-12 12:05:25,535 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55669 for container : container_1423771478362_0002_01_000002
2015-02-12 12:05:25,536 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:05:25,537 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:05:25,539 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55664 for container : container_1423771478362_0002_01_000004
2015-02-12 12:05:25,540 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:05:25,541 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:05:25,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,721 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:25,723 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:25,725 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:25,726 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:25,730 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0002_01_000003 by user soberoi
2015-02-12 12:05:25,730 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000003
2015-02-12 12:05:25,732 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0002_01_000002 by user soberoi
2015-02-12 12:05:25,733 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0002_01_000003 to application application_1423771478362_0002
2015-02-12 12:05:25,733 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000002
2015-02-12 12:05:25,732 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0002_01_000005 by user soberoi
2015-02-12 12:05:25,733 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0002_01_000004 by user soberoi
2015-02-12 12:05:25,733 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0002_01_000002 to application application_1423771478362_0002
2015-02-12 12:05:25,734 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 12:05:25,734 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0002
2015-02-12 12:05:25,735 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 12:05:25,735 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000005
2015-02-12 12:05:25,735 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000004
2015-02-12 12:05:25,735 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0002
2015-02-12 12:05:25,739 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0002
2015-02-12 12:05:25,739 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:05:25,739 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0002
2015-02-12 12:05:25,740 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0002
2015-02-12 12:05:25,740 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0002
2015-02-12 12:05:25,740 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:05:25,740 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0002
2015-02-12 12:05:25,741 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:05:25,738 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0002 transitioned from NEW to INITING
2015-02-12 12:05:25,742 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:05:25,743 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0002_01_000005 to application application_1423771478362_0002
2015-02-12 12:05:25,746 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0002_01_000004 to application application_1423771478362_0002
2015-02-12 12:05:25,747 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0002 transitioned from INITING to RUNNING
2015-02-12 12:05:25,747 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 12:05:25,748 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 12:05:25,748 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0002
2015-02-12 12:05:25,748 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0002
2015-02-12 12:05:25,748 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:05:25,748 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0002
2015-02-12 12:05:25,749 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:05:25,749 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:05:25,749 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:05:25,749 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:05:25,749 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0002
2015-02-12 12:05:25,749 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0002
2015-02-12 12:05:25,749 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:05:25,749 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0002
2015-02-12 12:05:25,750 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0002_01_000005
2015-02-12 12:05:25,752 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar, 1423771462433, FILE, null }
2015-02-12 12:05:25,755 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423771462045, FILE, null }
2015-02-12 12:05:25,755 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0002_01_000004
2015-02-12 12:05:25,756 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar, 1423771462433, FILE, null }
2015-02-12 12:05:25,757 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423771462045, FILE, null }
2015-02-12 12:05:25,772 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:05:25,772 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:05:25,787 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423771478362_0002_01_000004.tokens. Credentials list: 
2015-02-12 12:05:25,788 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423771478362_0002_01_000005.tokens. Credentials list: 
2015-02-12 12:05:25,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,820 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 12:05:25,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,820 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:25,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:25,887 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 12:05:25,887 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:25,916 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/filecache/10/hadoop-9144650672645034592.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:25,917 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:25,995 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000002/default_container_executor.sh]
2015-02-12 12:05:26,002 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:05:26,002 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:05:26,048 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000003/default_container_executor.sh]
2015-02-12 12:05:26,100 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:05:26,124 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:05:26,219 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423771478362_0002_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000005.tokens
2015-02-12 12:05:26,220 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0002
2015-02-12 12:05:26,254 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423771478362_0002_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000004.tokens
2015-02-12 12:05:26,254 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0002
2015-02-12 12:05:26,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:26,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:26,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:26,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:26,419 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0002/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:26,424 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0002/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:26,424 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:05:26,425 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:05:26,482 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 12:05:26,482 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:26,483 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 12:05:26,483 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:26,557 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:05:26,638 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000005/default_container_executor.sh]
2015-02-12 12:05:26,639 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000004/default_container_executor.sh]
2015-02-12 12:05:28,907 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021
2015-02-12 12:05:29,196 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021
2015-02-12 12:05:30,453 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741845_1021
2015-02-12 12:05:34,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:34,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:34,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:34,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:34,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:05:34,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:05:34,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:05:34,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:05:34,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:05:35,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:05:35,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:35,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:35,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/_temporary/attempt_1423771478362_0002_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:35,329 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:35,331 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0002_01_000002
2015-02-12 12:05:35,331 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000002
2015-02-12 12:05:35,331 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000002 transitioned from RUNNING to KILLING
2015-02-12 12:05:35,331 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0002_01_000002
2015-02-12 12:05:35,347 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1.jhist. BP-1120419527-10.1.1.68-1423771456695 blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:05:35,348 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0002_01_000002 is : 143
2015-02-12 12:05:35,349 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741846_1022 src: /127.0.0.1:56010 dest: /127.0.0.1:55526
2015-02-12 12:05:35,352 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741846_1022 src: /127.0.0.1:56011 dest: /127.0.0.1:55522
2015-02-12 12:05:35,354 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741846_1022 src: /127.0.0.1:56012 dest: /127.0.0.1:55529
2015-02-12 12:05:35,361 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4450)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1.jhist for DFSClient_NONMAPREDUCE_364727529_1
2015-02-12 12:05:35,367 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:05:35,368 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000002
2015-02-12 12:05:35,369 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000002
2015-02-12 12:05:35,370 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000002
2015-02-12 12:05:35,370 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000002
2015-02-12 12:05:35,373 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000002
2015-02-12 12:05:35,373 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:05:35,373 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0002_01_000002 from application application_1423771478362_0002
2015-02-12 12:05:35,373 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:35,374 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0002
2015-02-12 12:05:35,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/_temporary/attempt_1423771478362_0002_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:35,409 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:35,439 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0002_01_000003
2015-02-12 12:05:35,439 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000003
2015-02-12 12:05:35,440 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000003 transitioned from RUNNING to KILLING
2015-02-12 12:05:35,441 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0002_01_000003
2015-02-12 12:05:35,441 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:35,441 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0002_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 12:05:35,441 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000002
2015-02-12 12:05:35,442 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 12:05:35,442 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-02-12 12:05:35,442 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0002_01_000002, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:35,443 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:35,443 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:05:35,443 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0002_000001 released container container_1423771478362_0002_01_000002 on node: host: 10.1.1.68:55669 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 12:05:35,466 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0002_01_000003 is : 143
2015-02-12 12:05:35,477 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:05:35,478 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000003
2015-02-12 12:05:35,479 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000003
2015-02-12 12:05:35,480 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000003
2015-02-12 12:05:35,480 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000003
2015-02-12 12:05:35,480 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000003
2015-02-12 12:05:35,481 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:05:35,482 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0002_01_000003 from application application_1423771478362_0002
2015-02-12 12:05:35,482 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:35,482 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0002
2015-02-12 12:05:35,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/_temporary/attempt_1423771478362_0002_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:35,738 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:35,740 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0002_01_000004
2015-02-12 12:05:35,741 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000004
2015-02-12 12:05:35,741 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000004 transitioned from RUNNING to KILLING
2015-02-12 12:05:35,741 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0002_01_000004
2015-02-12 12:05:35,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/_temporary/attempt_1423771478362_0002_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:35,759 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0002_01_000004 is : 143
2015-02-12 12:05:35,767 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:35,769 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0002_01_000005
2015-02-12 12:05:35,769 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000005
2015-02-12 12:05:35,774 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:05:35,774 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000005 transitioned from RUNNING to KILLING
2015-02-12 12:05:35,775 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000004
2015-02-12 12:05:35,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000004
2015-02-12 12:05:35,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000004
2015-02-12 12:05:35,779 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000004
2015-02-12 12:05:35,779 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0002_01_000005
2015-02-12 12:05:35,799 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0002_01_000005 is : 143
2015-02-12 12:05:35,810 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000004
2015-02-12 12:05:35,811 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:05:35,811 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:05:35,811 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0002_01_000004 from application application_1423771478362_0002
2015-02-12 12:05:35,812 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:35,812 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0002
2015-02-12 12:05:35,812 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000005
2015-02-12 12:05:35,812 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000005
2015-02-12 12:05:35,813 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000005
2015-02-12 12:05:35,813 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000005
2015-02-12 12:05:35,813 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000005
2015-02-12 12:05:35,814 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:05:35,814 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0002_01_000005 from application application_1423771478362_0002
2015-02-12 12:05:35,814 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:35,814 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0002
2015-02-12 12:05:36,445 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:36,445 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:36,445 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0002_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 12:05:36,445 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000003
2015-02-12 12:05:36,446 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 12:05:36,446 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-02-12 12:05:36,446 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0002_01_000003, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:36,446 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:36,447 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:05:36,447 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0002_000001 released container container_1423771478362_0002_01_000003 on node: host: 10.1.1.68:55669 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 12:05:36,781 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:36,781 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0002_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 12:05:36,781 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000004
2015-02-12 12:05:36,781 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0002_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 12:05:36,782 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-02-12 12:05:36,782 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0002_01_000004, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:36,782 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:36,782 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:05:36,783 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0002_000001 released container container_1423771478362_0002_01_000004 on node: host: 10.1.1.68:55664 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 12:05:36,783 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:36,783 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0002_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 12:05:36,783 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000005
2015-02-12 12:05:36,783 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0002_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:05:36,783 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:05:36,784 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0002_01_000005, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:36,784 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:36,784 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:05:36,784 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0002_000001 released container container_1423771478362_0002_01_000005 on node: host: 10.1.1.68:55664 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:05:36,785 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:05:36,785 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000006
2015-02-12 12:05:36,785 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0002_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:05:36,785 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0002_000001 container=Container: [ContainerId: container_1423771478362_0002_01_000006, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 10, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:05:36,785 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:05:36,786 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:37,446 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0002_01_000002]
2015-02-12 12:05:37,446 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:37,447 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:37,640 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:05:37,652 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:37,655 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0002_01_000006 by user soberoi
2015-02-12 12:05:37,656 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000006
2015-02-12 12:05:37,656 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0002_01_000006 to application application_1423771478362_0002
2015-02-12 12:05:37,656 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 12:05:37,656 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0002
2015-02-12 12:05:37,657 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0002
2015-02-12 12:05:37,657 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:05:37,657 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0002
2015-02-12 12:05:37,657 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:05:37,709 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 12:05:37,710 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:37,782 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:05:37,782 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:37,783 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:37,832 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000006/default_container_executor.sh]
2015-02-12 12:05:38,450 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0002_01_000003]
2015-02-12 12:05:38,450 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:38,643 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:05:38,791 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:38,791 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0002_01_000005, container_1423771478362_0002_01_000004]
2015-02-12 12:05:38,791 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:41,221 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:05:41,221 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:05:41,239 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:05:41,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/_temporary/attempt_1423771478362_0002_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:41,532 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/_temporary/attempt_1423771478362_0002_r_000000_0/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:41,608 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023 src: /127.0.0.1:56057 dest: /127.0.0.1:55529
2015-02-12 12:05:41,610 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023 src: /127.0.0.1:56058 dest: /127.0.0.1:55526
2015-02-12 12:05:41,612 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023 src: /127.0.0.1:56059 dest: /127.0.0.1:55522
2015-02-12 12:05:41,644 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56059, dest: /127.0.0.1:55522, bytes: 310, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0002_r_000000_0_-324537812_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023, duration: 30379000
2015-02-12 12:05:41,644 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:41,645 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:05:41,645 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56058, dest: /127.0.0.1:55526, bytes: 310, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0002_r_000000_0_-324537812_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023, duration: 31437000
2015-02-12 12:05:41,646 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:41,649 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56057, dest: /127.0.0.1:55529, bytes: 310, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0002_r_000000_0_-324537812_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023, duration: 35475000
2015-02-12 12:05:41,649 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:41,650 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:41,651 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:41,656 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/_temporary/attempt_1423771478362_0002_r_000000_0/part-00000 is closed by DFSClient_attempt_1423771478362_0002_r_000000_0_-324537812_1
2015-02-12 12:05:41,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/_temporary/attempt_1423771478362_0002_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/_temporary/attempt_1423771478362_0002_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/task_1423771478362_0002_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/_temporary/attempt_1423771478362_0002_r_000000_0	dst=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/task_1423771478362_0002_r_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:05:41,698 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:41,700 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0002_01_000006
2015-02-12 12:05:41,700 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000006
2015-02-12 12:05:41,700 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000006 transitioned from RUNNING to KILLING
2015-02-12 12:05:41,701 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0002_01_000006
2015-02-12 12:05:41,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:41,710 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_364727529_1
2015-02-12 12:05:41,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,719 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0002_01_000006 is : 143
2015-02-12 12:05:41,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/task_1423771478362_0002_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary/1/task_1423771478362_0002_r_000000/part-00000	dst=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:41,732 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:05:41,733 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000006
2015-02-12 12:05:41,734 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000006
2015-02-12 12:05:41,734 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:05:41,734 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0002_01_000006 from application application_1423771478362_0002
2015-02-12 12:05:41,734 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:41,735 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0002
2015-02-12 12:05:41,735 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000006
2015-02-12 12:05:41,735 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000006
2015-02-12 12:05:41,736 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000006
2015-02-12 12:05:41,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:41,744 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/_SUCCESS is closed by DFSClient_NONMAPREDUCE_364727529_1
2015-02-12 12:05:41,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:41,747 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_364727529_1
2015-02-12 12:05:41,761 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56012, dest: /127.0.0.1:55529, bytes: 61262, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741846_1022, duration: 6405663000
2015-02-12 12:05:41,761 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741846_1022, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:41,762 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 15656
2015-02-12 12:05:41,763 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56011, dest: /127.0.0.1:55522, bytes: 61262, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741846_1022, duration: 6406473000
2015-02-12 12:05:41,763 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:41,765 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 15656
2015-02-12 12:05:41,766 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56010, dest: /127.0.0.1:55526, bytes: 61262, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741846_1022, duration: 6408956000
2015-02-12 12:05:41,766 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:41,766 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 15656
2015-02-12 12:05:41,768 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1.jhist is closed by DFSClient_NONMAPREDUCE_364727529_1
2015-02-12 12:05:41,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:41,773 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002.summary_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:41,775 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024 src: /127.0.0.1:56061 dest: /127.0.0.1:55526
2015-02-12 12:05:41,776 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024 src: /127.0.0.1:56062 dest: /127.0.0.1:55519
2015-02-12 12:05:41,780 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024 src: /127.0.0.1:56063 dest: /127.0.0.1:55522
2015-02-12 12:05:41,783 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56063, dest: /127.0.0.1:55522, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024, duration: 1781000
2015-02-12 12:05:41,783 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:41,784 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:41,784 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56062, dest: /127.0.0.1:55519, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024, duration: 2231000
2015-02-12 12:05:41,784 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:41,785 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:41,785 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56061, dest: /127.0.0.1:55526, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024, duration: 3441000
2015-02-12 12:05:41,785 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:41,786 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:41,787 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002.summary_tmp is closed by DFSClient_NONMAPREDUCE_364727529_1
2015-02-12 12:05:41,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:41,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:41,810 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:05:41,812 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025 src: /127.0.0.1:56065 dest: /127.0.0.1:55522
2015-02-12 12:05:41,813 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025 src: /127.0.0.1:56066 dest: /127.0.0.1:55519
2015-02-12 12:05:41,814 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025 src: /127.0.0.1:56067 dest: /127.0.0.1:55529
2015-02-12 12:05:41,818 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56067, dest: /127.0.0.1:55529, bytes: 61262, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025, duration: 1995000
2015-02-12 12:05:41,818 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:41,819 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56066, dest: /127.0.0.1:55519, bytes: 61262, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025, duration: 3073000
2015-02-12 12:05:41,820 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:41,820 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:05:41,821 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:05:41,821 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56065, dest: /127.0.0.1:55522, bytes: 61262, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025, duration: 4746000
2015-02-12 12:05:41,821 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:41,822 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:41,823 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist_tmp is closed by DFSClient_NONMAPREDUCE_364727529_1
2015-02-12 12:05:41,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:41,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002/job_1423771478362_0002_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:41,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:41,838 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002_conf.xml_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:41,840 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026 src: /127.0.0.1:56068 dest: /127.0.0.1:55529
2015-02-12 12:05:41,842 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026 src: /127.0.0.1:56069 dest: /127.0.0.1:55526
2015-02-12 12:05:41,843 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026 src: /127.0.0.1:56070 dest: /127.0.0.1:55522
2015-02-12 12:05:41,847 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56070, dest: /127.0.0.1:55522, bytes: 115624, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026, duration: 1970000
2015-02-12 12:05:41,847 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:41,847 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:41,848 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56069, dest: /127.0.0.1:55526, bytes: 115624, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026, duration: 2641000
2015-02-12 12:05:41,848 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:41,848 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:41,849 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56068, dest: /127.0.0.1:55529, bytes: 115624, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_364727529_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026, duration: 3689000
2015-02-12 12:05:41,849 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:41,849 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:41,851 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_364727529_1
2015-02-12 12:05:41,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:41,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:41,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:41,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:41,864 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1129)) - Updating application attempt appattempt_1423771478362_0002_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 12:05:41,864 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0002_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 12:05:41,864 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(992)) - Updating application application_1423771478362_0002 with final state: FINISHING
2015-02-12 12:05:41,864 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0002 State change from RUNNING to FINAL_SAVING
2015-02-12 12:05:41,865 INFO  recovery.RMStateStore (RMStateStore.java:transition(161)) - Updating info for app: application_1423771478362_0002
2015-02-12 12:05:41,865 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0002_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 12:05:41,865 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0002 State change from FINAL_SAVING to FINISHING
2015-02-12 12:05:42,707 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:42,707 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0002_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 12:05:42,707 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000006
2015-02-12 12:05:42,707 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0002_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:05:42,708 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:05:42,709 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0002_01_000006, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:42,709 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:42,709 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:05:42,709 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0002_000001 released container container_1423771478362_0002_01_000006 on node: host: 10.1.1.68:55664 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:05:42,872 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(351)) - application_1423771478362_0002 unregistered successfully. 
2015-02-12 12:05:42,876 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741841_1017 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55522 127.0.0.1:55529 
2015-02-12 12:05:42,876 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741842_1018 127.0.0.1:55522 127.0.0.1:55519 127.0.0.1:55526 127.0.0.1:55529 
2015-02-12 12:05:42,876 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741843_1019 127.0.0.1:55529 127.0.0.1:55526 127.0.0.1:55522 
2015-02-12 12:05:42,876 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741844_1020 127.0.0.1:55519 127.0.0.1:55529 127.0.0.1:55522 
2015-02-12 12:05:42,876 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741846_1022 127.0.0.1:55526 127.0.0.1:55522 127.0.0.1:55529 
2015-02-12 12:05:42,877 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741845_1021 127.0.0.1:55526 127.0.0.1:55529 127.0.0.1:55522 
2015-02-12 12:05:42,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0002	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,926 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (3/3) ...ntplatform/manycheckpoint
2015-02-12 12:05:42,935 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:05:42,945 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:05:42,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,954 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(286)) - Allocated new applicationId: 3
2015-02-12 12:05:42,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 12:05:42,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 12:05:42,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:42,963 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:05:42,965 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027 src: /127.0.0.1:56073 dest: /127.0.0.1:55526
2015-02-12 12:05:42,966 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027 src: /127.0.0.1:56074 dest: /127.0.0.1:55522
2015-02-12 12:05:42,967 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027 src: /127.0.0.1:56075 dest: /127.0.0.1:55529
2015-02-12 12:05:42,972 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56075, dest: /127.0.0.1:55529, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027, duration: 3128000
2015-02-12 12:05:42,972 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:42,973 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:42,973 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56074, dest: /127.0.0.1:55522, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027, duration: 3250000
2015-02-12 12:05:42,973 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:42,973 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:42,974 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56073, dest: /127.0.0.1:55526, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027, duration: 4163000
2015-02-12 12:05:42,974 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:42,975 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:42,976 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:42,977 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar
2015-02-12 12:05:42,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:42,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,992 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 12:05:42,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:42,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:42,996 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split
2015-02-12 12:05:42,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:42,998 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split. BP-1120419527-10.1.1.68-1423771456695 blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:42,999 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028 src: /127.0.0.1:56076 dest: /127.0.0.1:55526
2015-02-12 12:05:43,001 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028 src: /127.0.0.1:56077 dest: /127.0.0.1:55519
2015-02-12 12:05:43,002 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028 src: /127.0.0.1:56078 dest: /127.0.0.1:55529
2015-02-12 12:05:43,003 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028 src: /127.0.0.1:56079 dest: /127.0.0.1:55522
2015-02-12 12:05:43,007 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56079, dest: /127.0.0.1:55522, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028, duration: 1915000
2015-02-12 12:05:43,007 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:43,007 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:43,007 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56078, dest: /127.0.0.1:55529, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028, duration: 2094000
2015-02-12 12:05:43,008 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:43,009 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:43,009 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56077, dest: /127.0.0.1:55519, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028, duration: 3380000
2015-02-12 12:05:43,009 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:43,009 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:05:43,010 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56076, dest: /127.0.0.1:55526, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028, duration: 5280000
2015-02-12 12:05:43,010 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:43,014 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:43,015 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:43,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:43,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:43,019 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo. BP-1120419527-10.1.1.68-1423771456695 blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:05:43,021 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029 src: /127.0.0.1:56080 dest: /127.0.0.1:55526
2015-02-12 12:05:43,022 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029 src: /127.0.0.1:56081 dest: /127.0.0.1:55522
2015-02-12 12:05:43,023 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029 src: /127.0.0.1:56082 dest: /127.0.0.1:55519
2015-02-12 12:05:43,026 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56082, dest: /127.0.0.1:55519, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029, duration: 1577000
2015-02-12 12:05:43,026 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:43,027 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:05:43,027 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56081, dest: /127.0.0.1:55522, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029, duration: 2028000
2015-02-12 12:05:43,027 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:43,028 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:43,028 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56080, dest: /127.0.0.1:55526, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029, duration: 3226000
2015-02-12 12:05:43,028 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:43,031 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:43,032 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:43,033 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:1
2015-02-12 12:05:43,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:43,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:43,066 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:05:43,068 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030 src: /127.0.0.1:56083 dest: /127.0.0.1:55522
2015-02-12 12:05:43,070 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030 src: /127.0.0.1:56084 dest: /127.0.0.1:55526
2015-02-12 12:05:43,071 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030 src: /127.0.0.1:56085 dest: /127.0.0.1:55519
2015-02-12 12:05:43,075 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56085, dest: /127.0.0.1:55519, bytes: 98406, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030, duration: 1835000
2015-02-12 12:05:43,075 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:43,076 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:05:43,076 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56084, dest: /127.0.0.1:55526, bytes: 98406, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030, duration: 2689000
2015-02-12 12:05:43,076 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:43,077 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56083, dest: /127.0.0.1:55522, bytes: 98406, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030, duration: 3918000
2015-02-12 12:05:43,077 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:43,078 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:43,080 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:43,082 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:43,082 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_1423771478362_0003
2015-02-12 12:05:43,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,085 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,098 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(577)) - Application with id 3 submitted by user soberoi
2015-02-12 12:05:43,098 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(973)) - Storing application with id application_1423771478362_0003
2015-02-12 12:05:43,099 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0003 State change from NEW to NEW_SAVING
2015-02-12 12:05:43,099 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423771478362_0003
2015-02-12 12:05:43,098 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	IP=10.1.1.68	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423771478362_0003
2015-02-12 12:05:43,099 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0003 State change from NEW_SAVING to SUBMITTED
2015-02-12 12:05:43,100 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(386)) - Application added - appId: application_1423771478362_0003 user: soberoi leaf-queue of parent: root #applications: 2
2015-02-12 12:05:43,100 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(716)) - Accepted application application_1423771478362_0003 from user: soberoi, in queue: default
2015-02-12 12:05:43,100 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0003 State change from SUBMITTED to ACCEPTED
2015-02-12 12:05:43,101 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(670)) - Registering app attempt : appattempt_1423771478362_0003_000001
2015-02-12 12:05:43,101 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0003_000001 State change from NEW to SUBMITTED
2015-02-12 12:05:43,101 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(626)) - Application application_1423771478362_0003 from user: soberoi activated in queue: default
2015-02-12 12:05:43,101 INFO  capacity.LeafQueue (LeafQueue.java:addApplicationAttempt(643)) - Application added - appId: application_1423771478362_0003 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@35816f1c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-02-12 12:05:43,102 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplicationAttempt(746)) - Added Application Attempt appattempt_1423771478362_0003_000001 to scheduler from user soberoi in queue default
2015-02-12 12:05:43,103 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0003_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 12:05:43,103 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(251)) - Submitted application application_1423771478362_0003
2015-02-12 12:05:43,106 INFO  mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://Edinburgh.local:55663/proxy/application_1423771478362_0003/
2015-02-12 12:05:43,106 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_1423771478362_0003
2015-02-12 12:05:43,107 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://Edinburgh.local:55663/proxy/application_1423771478362_0003/
2015-02-12 12:05:43,153 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0003_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:05:43,154 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0003	CONTAINERID=container_1423771478362_0003_01_000001
2015-02-12 12:05:43,154 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55673, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 12:05:43,154 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0003_000001 container=Container: [ContainerId: container_1423771478362_0003_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:05:43,154 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-02-12 12:05:43,154 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:43,155 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55673 for container : container_1423771478362_0003_01_000001
2015-02-12 12:05:43,158 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0003_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:05:43,159 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423771478362_0003_000001
2015-02-12 12:05:43,159 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1837)) - Storing attempt: AppId: application_1423771478362_0003 AttemptId: appattempt_1423771478362_0003_000001 MasterContainer: Container: [ContainerId: container_1423771478362_0003_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ]
2015-02-12 12:05:43,159 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0003_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 12:05:43,160 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0003_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 12:05:43,160 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423771478362_0003_000001
2015-02-12 12:05:43,162 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423771478362_0003_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] for AM appattempt_1423771478362_0003_000001
2015-02-12 12:05:43,162 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423771478362_0003_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 12:05:43,162 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423771478362_0003_000001
2015-02-12 12:05:43,162 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423771478362_0003_000001
2015-02-12 12:05:43,165 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0003_000001 (auth:SIMPLE)
2015-02-12 12:05:43,168 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0003_01_000001 by user soberoi
2015-02-12 12:05:43,168 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0003
2015-02-12 12:05:43,168 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0003	CONTAINERID=container_1423771478362_0003_01_000001
2015-02-12 12:05:43,168 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0003 transitioned from NEW to INITING
2015-02-12 12:05:43,169 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0003_01_000001 to application application_1423771478362_0003
2015-02-12 12:05:43,169 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0003 transitioned from INITING to RUNNING
2015-02-12 12:05:43,169 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423771478362_0003_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] for AM appattempt_1423771478362_0003_000001
2015-02-12 12:05:43,169 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0003_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 12:05:43,169 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0003_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 12:05:43,170 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0003
2015-02-12 12:05:43,170 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:05:43,170 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 12:05:43,170 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split transitioned from INIT to DOWNLOADING
2015-02-12 12:05:43,170 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:05:43,170 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0003_01_000001
2015-02-12 12:05:43,180 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423771478362_0003_01_000001.tokens. Credentials list: 
2015-02-12 12:05:43,292 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:05:43,359 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423771478362_0003_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000001.tokens
2015-02-12 12:05:43,359 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0003
2015-02-12 12:05:43,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,459 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0003/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:43,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,504 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0003/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:43,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,550 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0003/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:43,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:43,596 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0003/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:43,596 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0003_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:05:43,626 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0003_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 12:05:43,627 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:43,705 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000001/default_container_executor.sh]
2015-02-12 12:05:43,711 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:44,157 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0003_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:05:44,712 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:45,242 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1492)) - BLOCK* ask 127.0.0.1:55522 to replicate blk_1073741851_1027 to datanode(s) 127.0.0.1:55519
2015-02-12 12:05:45,243 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55519 to delete [blk_1073741841_1017, blk_1073741842_1018, blk_1073741844_1020]
2015-02-12 12:05:45,243 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741846_1022]
2015-02-12 12:05:45,722 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:45,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:05:45,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 12:05:45,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 12:05:45,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 12:05:45,961 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741841 for deletion
2015-02-12 12:05:45,961 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741842 for deletion
2015-02-12 12:05:45,961 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741844 for deletion
2015-02-12 12:05:45,961 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741841
2015-02-12 12:05:45,961 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741842
2015-02-12 12:05:45,962 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741844
2015-02-12 12:05:45,967 INFO  datanode.DataNode (DataNode.java:transferBlock(1812)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, infoPort=55523, ipcPort=55525, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) Starting thread to transfer BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027 to 127.0.0.1:55519 
2015-02-12 12:05:45,967 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741841 for deletion
2015-02-12 12:05:45,968 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741842 for deletion
2015-02-12 12:05:45,968 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741843 for deletion
2015-02-12 12:05:45,968 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027 src: /127.0.0.1:56093 dest: /127.0.0.1:55519
2015-02-12 12:05:45,969 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741841
2015-02-12 12:05:45,969 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741843
2015-02-12 12:05:45,970 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741842
2015-02-12 12:05:45,968 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741844 for deletion
2015-02-12 12:05:45,970 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741845 for deletion
2015-02-12 12:05:45,970 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741846 for deletion
2015-02-12 12:05:45,970 INFO  datanode.DataNode (DataNode.java:run(2020)) - DataTransfer: Transmitted BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027 (numBytes=254067) to /127.0.0.1:55519
2015-02-12 12:05:45,971 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741844
2015-02-12 12:05:45,971 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741846
2015-02-12 12:05:45,971 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741845
2015-02-12 12:05:45,972 INFO  datanode.DataNode (DataXceiver.java:writeBlock(755)) - Received BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027 src: /127.0.0.1:56093 dest: /127.0.0.1:55519 of size 254067
2015-02-12 12:05:45,973 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741851_1027 size 254067
2015-02-12 12:05:45,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003	dst=null	perm=null	proto=rpc
2015-02-12 12:05:45,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:05:45,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:05:46,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:46,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:46,723 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:47,175 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0003_000001 (auth:SIMPLE)
2015-02-12 12:05:47,178 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(274)) - AM registration appattempt_1423771478362_0003_000001
2015-02-12 12:05:47,178 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(127)) - USER=soberoi	IP=10.1.1.68	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423771478362_0003	APPATTEMPTID=appattempt_1423771478362_0003_000001
2015-02-12 12:05:47,179 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0003_000001 State change from LAUNCHED to RUNNING
2015-02-12 12:05:47,179 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0003 State change from ACCEPTED to RUNNING
2015-02-12 12:05:47,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:47,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:05:47,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:47,408 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1_conf.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:47,447 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031 src: /127.0.0.1:56100 dest: /127.0.0.1:55529
2015-02-12 12:05:47,449 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031 src: /127.0.0.1:56101 dest: /127.0.0.1:55519
2015-02-12 12:05:47,450 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031 src: /127.0.0.1:56102 dest: /127.0.0.1:55522
2015-02-12 12:05:47,475 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56102, dest: /127.0.0.1:55522, bytes: 115385, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031, duration: 23259000
2015-02-12 12:05:47,476 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:47,477 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56101, dest: /127.0.0.1:55519, bytes: 115385, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031, duration: 24498000
2015-02-12 12:05:47,477 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:47,477 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:47,479 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56100, dest: /127.0.0.1:55529, bytes: 115385, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031, duration: 26401000
2015-02-12 12:05:47,479 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:05:47,479 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:47,479 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:47,490 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-541752697_1
2015-02-12 12:05:47,727 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:48,033 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(346)) - Container container_1423771478362_0002_01_000001 succeeded 
2015-02-12 12:05:48,033 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 12:05:48,034 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0002_01_000001
2015-02-12 12:05:48,048 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000001
2015-02-12 12:05:48,049 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000001
2015-02-12 12:05:48,049 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000001
2015-02-12 12:05:48,049 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0002/container_1423771478362_0002_01_000001
2015-02-12 12:05:48,049 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000001
2015-02-12 12:05:48,049 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0002_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 12:05:48,049 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0002_01_000001 from application application_1423771478362_0002
2015-02-12 12:05:48,049 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:48,050 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0002
2015-02-12 12:05:48,147 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30011 milliseconds
2015-02-12 12:05:48,147 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(201)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 12:05:48,249 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741845_1021, blk_1073741846_1022]
2015-02-12 12:05:48,249 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55529 to delete [blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741846_1022]
2015-02-12 12:05:48,501 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0002_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:48,501 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(676)) - Unregistering app attempt : appattempt_1423771478362_0002_000001
2015-02-12 12:05:48,502 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423771478362_0002_000001
2015-02-12 12:05:48,501 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0002_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 12:05:48,502 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000001
2015-02-12 12:05:48,502 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0002_000001 State change from FINISHING to FINISHED
2015-02-12 12:05:48,502 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55669, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:05:48,503 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0002 State change from FINISHING to FINISHED
2015-02-12 12:05:48,503 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:05:48,503 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423771478362_0002
2015-02-12 12:05:48,503 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0002_01_000001, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:48,504 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:48,504 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423771478362_0002_000001
2015-02-12 12:05:48,504 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(179)) - appId=application_1423771478362_0002,name=[61F0DA785F0A4444B72F9543DFADE737/BEB9C920C0D345D0A883280334546F25] test/(2/3),user=soberoi,queue=default,state=FINISHED,trackingUrl=http://Edinburgh.local:55663/proxy/application_1423771478362_0002/jobhistory/job/job_1423771478362_0002,appMasterHost=10.1.1.68,startTime=1423771517343,finishTime=1423771541864,finalStatus=SUCCEEDED
2015-02-12 12:05:48,504 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-02-12 12:05:48,504 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0002_000001 released container container_1423771478362_0002_01_000001 on node: host: 10.1.1.68:55669 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:05:48,505 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0003_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:05:48,505 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0003	CONTAINERID=container_1423771478362_0003_01_000002
2015-02-12 12:05:48,505 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:05:48,505 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0003_000001 container=Container: [ContainerId: container_1423771478362_0003_01_000002, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:05:48,506 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-02-12 12:05:48,506 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:48,506 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplicationAttempt(785)) - Application Attempt appattempt_1423771478362_0002_000001 is done. finalState=FINISHED
2015-02-12 12:05:48,506 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423771478362_0002 requests cleared
2015-02-12 12:05:48,506 INFO  capacity.LeafQueue (LeafQueue.java:removeApplicationAttempt(686)) - Application removed - appId: application_1423771478362_0002 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-02-12 12:05:48,506 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(411)) - Application removed - appId: application_1423771478362_0002 user: soberoi leaf-queue of parent: root #applications: 1
2015-02-12 12:05:48,509 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0002_000001 (auth:SIMPLE)
2015-02-12 12:05:48,511 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0002_01_000001
2015-02-12 12:05:48,511 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0002	CONTAINERID=container_1423771478362_0002_01_000001
2015-02-12 12:05:48,511 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0002_01_000001]
2015-02-12 12:05:48,512 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:48,512 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:05:48,512 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0002
2015-02-12 12:05:48,512 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0002
2015-02-12 12:05:48,513 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0002
2015-02-12 12:05:48,513 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:05:48,513 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0002, with delay of 10800 seconds
2015-02-12 12:05:48,513 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0002
2015-02-12 12:05:48,514 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0002
2015-02-12 12:05:48,733 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:05:48,733 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:48,734 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0002
2015-02-12 12:05:48,735 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0002
2015-02-12 12:05:48,736 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0002
2015-02-12 12:05:48,736 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0002
2015-02-12 12:05:48,736 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:05:48,736 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0002, with delay of 10800 seconds
2015-02-12 12:05:48,736 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0002
2015-02-12 12:05:48,928 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028
2015-02-12 12:05:48,929 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023
2015-02-12 12:05:48,929 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030
2015-02-12 12:05:48,930 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025
2015-02-12 12:05:48,930 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026
2015-02-12 12:05:48,931 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029
2015-02-12 12:05:48,931 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028
2015-02-12 12:05:48,931 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025
2015-02-12 12:05:48,932 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024
2015-02-12 12:05:48,933 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027
2015-02-12 12:05:48,934 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024
2015-02-12 12:05:48,934 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029
2015-02-12 12:05:49,138 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030
2015-02-12 12:05:49,222 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023
2015-02-12 12:05:49,223 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026
2015-02-12 12:05:49,223 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741848_1024
2015-02-12 12:05:49,224 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028
2015-02-12 12:05:49,224 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741846_1022
2015-02-12 12:05:49,238 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55669 for container : container_1423771478362_0003_01_000002
2015-02-12 12:05:49,240 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0003_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:05:49,277 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741841 for deletion
2015-02-12 12:05:49,277 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741842 for deletion
2015-02-12 12:05:49,277 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741843 for deletion
2015-02-12 12:05:49,278 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741845 for deletion
2015-02-12 12:05:49,278 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741846 for deletion
2015-02-12 12:05:49,278 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741842
2015-02-12 12:05:49,278 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741841
2015-02-12 12:05:49,278 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741845
2015-02-12 12:05:49,278 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741843
2015-02-12 12:05:49,279 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741846
2015-02-12 12:05:49,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,362 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0003_000001 (auth:SIMPLE)
2015-02-12 12:05:49,365 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0003_01_000002 by user soberoi
2015-02-12 12:05:49,365 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0003
2015-02-12 12:05:49,366 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0003	CONTAINERID=container_1423771478362_0003_01_000002
2015-02-12 12:05:49,366 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0003 transitioned from NEW to INITING
2015-02-12 12:05:49,366 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0003_01_000002 to application application_1423771478362_0003
2015-02-12 12:05:49,366 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0003 transitioned from INITING to RUNNING
2015-02-12 12:05:49,367 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0003_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 12:05:49,367 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0003
2015-02-12 12:05:49,367 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0003
2015-02-12 12:05:49,367 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:05:49,367 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0003
2015-02-12 12:05:49,367 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:05:49,367 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:05:49,368 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0003_01_000002
2015-02-12 12:05:49,377 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0003_01_000002.tokens. Credentials list: 
2015-02-12 12:05:49,432 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027
2015-02-12 12:05:49,432 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741853_1029
2015-02-12 12:05:49,433 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741854_1030
2015-02-12 12:05:49,473 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:05:49,514 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0003_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:05:49,542 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0003_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000002.tokens
2015-02-12 12:05:49,543 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0003
2015-02-12 12:05:49,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,646 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0003/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:49,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:49,692 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0003/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:49,692 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0003_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:05:49,721 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0003_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 12:05:49,721 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:49,741 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:49,811 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000002/default_container_executor.sh]
2015-02-12 12:05:50,261 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:05:50,468 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741850_1026
2015-02-12 12:05:50,469 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741847_1023
2015-02-12 12:05:50,469 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741846_1022
2015-02-12 12:05:50,471 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027
2015-02-12 12:05:50,657 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741841 for deletion
2015-02-12 12:05:50,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741842 for deletion
2015-02-12 12:05:50,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741843 for deletion
2015-02-12 12:05:50,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741844 for deletion
2015-02-12 12:05:50,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741845 for deletion
2015-02-12 12:05:50,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741846 for deletion
2015-02-12 12:05:50,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741841
2015-02-12 12:05:50,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741843
2015-02-12 12:05:50,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741842
2015-02-12 12:05:50,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741846
2015-02-12 12:05:50,660 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741844
2015-02-12 12:05:50,660 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741845
2015-02-12 12:05:50,675 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741849_1025
2015-02-12 12:05:50,675 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741852_1028
2015-02-12 12:05:52,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1/_temporary/attempt_1423771478362_0003_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:52,646 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1/_temporary/attempt_1423771478362_0003_m_000000_0/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:05:52,688 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032 src: /127.0.0.1:56117 dest: /127.0.0.1:55526
2015-02-12 12:05:52,690 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032 src: /127.0.0.1:56118 dest: /127.0.0.1:55529
2015-02-12 12:05:52,691 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032 src: /127.0.0.1:56119 dest: /127.0.0.1:55519
2015-02-12 12:05:52,712 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56119, dest: /127.0.0.1:55519, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0003_m_000000_0_-670642428_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032, duration: 18819000
2015-02-12 12:05:52,712 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:52,713 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:05:52,713 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56118, dest: /127.0.0.1:55529, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0003_m_000000_0_-670642428_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032, duration: 19447000
2015-02-12 12:05:52,713 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:52,713 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:52,714 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56117, dest: /127.0.0.1:55526, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0003_m_000000_0_-670642428_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032, duration: 20561000
2015-02-12 12:05:52,714 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:52,715 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:52,717 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1/_temporary/attempt_1423771478362_0003_m_000000_0/part-00000 is closed by DFSClient_attempt_1423771478362_0003_m_000000_0_-670642428_1
2015-02-12 12:05:52,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1/_temporary/attempt_1423771478362_0003_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1/_temporary/attempt_1423771478362_0003_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1/task_1423771478362_0003_m_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1/_temporary/attempt_1423771478362_0003_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1/task_1423771478362_0003_m_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:05:52,752 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0003_000001 (auth:SIMPLE)
2015-02-12 12:05:52,753 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0003_01_000002
2015-02-12 12:05:52,753 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0003	CONTAINERID=container_1423771478362_0003_01_000002
2015-02-12 12:05:52,753 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0003_01_000002 transitioned from RUNNING to KILLING
2015-02-12 12:05:52,754 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0003_01_000002
2015-02-12 12:05:52,766 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0003_01_000002 is : 143
2015-02-12 12:05:52,768 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1.jhist. BP-1120419527-10.1.1.68-1423771456695 blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:05:52,771 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741857_1033 src: /127.0.0.1:56121 dest: /127.0.0.1:55522
2015-02-12 12:05:52,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:52,772 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741857_1033 src: /127.0.0.1:56122 dest: /127.0.0.1:55529
2015-02-12 12:05:52,774 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741857_1033 src: /127.0.0.1:56123 dest: /127.0.0.1:55526
2015-02-12 12:05:52,774 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-541752697_1
2015-02-12 12:05:52,779 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4450)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1.jhist for DFSClient_NONMAPREDUCE_-541752697_1
2015-02-12 12:05:52,779 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0003_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:05:52,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,780 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000002
2015-02-12 12:05:52,780 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0003	CONTAINERID=container_1423771478362_0003_01_000002
2015-02-12 12:05:52,780 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0003_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:05:52,781 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000002
2015-02-12 12:05:52,781 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0003_01_000002 from application application_1423771478362_0003
2015-02-12 12:05:52,781 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:52,781 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0003
2015-02-12 12:05:52,781 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000002
2015-02-12 12:05:52,780 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000002
2015-02-12 12:05:52,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1/task_1423771478362_0003_m_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary/1/task_1423771478362_0003_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:52,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:52,804 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-541752697_1
2015-02-12 12:05:52,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:52,809 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-541752697_1
2015-02-12 12:05:52,823 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56123, dest: /127.0.0.1:55526, bytes: 24071, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741857_1033, duration: 47631000
2015-02-12 12:05:52,824 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741857_1033, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:52,825 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 13531
2015-02-12 12:05:52,825 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56122, dest: /127.0.0.1:55529, bytes: 24071, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741857_1033, duration: 49507000
2015-02-12 12:05:52,826 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:52,827 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 13531
2015-02-12 12:05:52,827 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56121, dest: /127.0.0.1:55522, bytes: 24071, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741857_1033, duration: 51531000
2015-02-12 12:05:52,828 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:52,828 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 13531
2015-02-12 12:05:52,830 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1.jhist is closed by DFSClient_NONMAPREDUCE_-541752697_1
2015-02-12 12:05:52,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:52,838 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003.summary_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:05:52,840 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034 src: /127.0.0.1:56125 dest: /127.0.0.1:55522
2015-02-12 12:05:52,842 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034 src: /127.0.0.1:56126 dest: /127.0.0.1:55519
2015-02-12 12:05:52,843 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034 src: /127.0.0.1:56127 dest: /127.0.0.1:55529
2015-02-12 12:05:52,847 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56127, dest: /127.0.0.1:55529, bytes: 432, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034, duration: 1601000
2015-02-12 12:05:52,847 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:52,847 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:05:52,848 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56126, dest: /127.0.0.1:55519, bytes: 432, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034, duration: 2459000
2015-02-12 12:05:52,848 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:52,848 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:05:52,849 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56125, dest: /127.0.0.1:55522, bytes: 432, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034, duration: 3560000
2015-02-12 12:05:52,849 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:52,849 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:05:52,851 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003.summary_tmp is closed by DFSClient_NONMAPREDUCE_-541752697_1
2015-02-12 12:05:52,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:52,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:52,879 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:05:52,881 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035 src: /127.0.0.1:56130 dest: /127.0.0.1:55526
2015-02-12 12:05:52,882 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035 src: /127.0.0.1:56131 dest: /127.0.0.1:55529
2015-02-12 12:05:52,883 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035 src: /127.0.0.1:56132 dest: /127.0.0.1:55519
2015-02-12 12:05:52,887 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56132, dest: /127.0.0.1:55519, bytes: 24071, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035, duration: 2557000
2015-02-12 12:05:52,888 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:52,888 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:05:52,888 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56131, dest: /127.0.0.1:55529, bytes: 24071, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035, duration: 3230000
2015-02-12 12:05:52,888 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:52,889 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56130, dest: /127.0.0.1:55526, bytes: 24071, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035, duration: 4423000
2015-02-12 12:05:52,890 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:52,890 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:52,890 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:52,892 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-541752697_1
2015-02-12 12:05:52,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:52,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003/job_1423771478362_0003_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:52,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:52,911 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003_conf.xml_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:05:52,914 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036 src: /127.0.0.1:56135 dest: /127.0.0.1:55526
2015-02-12 12:05:52,916 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036 src: /127.0.0.1:56136 dest: /127.0.0.1:55519
2015-02-12 12:05:52,917 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036 src: /127.0.0.1:56137 dest: /127.0.0.1:55529
2015-02-12 12:05:52,923 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56137, dest: /127.0.0.1:55529, bytes: 115385, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036, duration: 3558000
2015-02-12 12:05:52,923 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:52,924 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:05:52,924 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56136, dest: /127.0.0.1:55519, bytes: 115385, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036, duration: 4421000
2015-02-12 12:05:52,924 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:52,925 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56135, dest: /127.0.0.1:55526, bytes: 115385, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-541752697_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036, duration: 5853000
2015-02-12 12:05:52,926 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:52,926 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:05:52,928 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-541752697_1
2015-02-12 12:05:52,928 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741860_1036 size 115385
2015-02-12 12:05:52,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:52,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:52,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:52,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:05:52,946 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1129)) - Updating application attempt appattempt_1423771478362_0003_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 12:05:52,946 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0003_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 12:05:52,947 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(992)) - Updating application application_1423771478362_0003 with final state: FINISHING
2015-02-12 12:05:52,947 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0003 State change from RUNNING to FINAL_SAVING
2015-02-12 12:05:52,947 INFO  recovery.RMStateStore (RMStateStore.java:transition(161)) - Updating info for app: application_1423771478362_0003
2015-02-12 12:05:52,948 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0003_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 12:05:52,948 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0003 State change from FINAL_SAVING to FINISHING
2015-02-12 12:05:53,762 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0003_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:53,762 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0003_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 12:05:53,762 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0003	CONTAINERID=container_1423771478362_0003_01_000002
2015-02-12 12:05:53,762 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:05:53,762 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:05:53,763 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0003_01_000002, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:53,763 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:53,763 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:05:53,764 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0003_000001 released container container_1423771478362_0003_01_000002 on node: host: 10.1.1.68:55669 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:05:53,938 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741851_1027
2015-02-12 12:05:53,956 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(351)) - application_1423771478362_0003 unregistered successfully. 
2015-02-12 12:05:53,960 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741851_1027 127.0.0.1:55526 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55519 
2015-02-12 12:05:53,960 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741852_1028 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55529 127.0.0.1:55522 
2015-02-12 12:05:53,960 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741853_1029 127.0.0.1:55526 127.0.0.1:55522 127.0.0.1:55519 
2015-02-12 12:05:53,961 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741854_1030 127.0.0.1:55522 127.0.0.1:55526 127.0.0.1:55519 
2015-02-12 12:05:53,961 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741857_1033 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55526 
2015-02-12 12:05:53,961 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741855_1031 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:05:53,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0003	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,013 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741835_1011 127.0.0.1:55526 127.0.0.1:55522 127.0.0.1:55529 
2015-02-12 12:05:54,014 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741837_1013 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:05:54,014 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741833_1009 127.0.0.1:55522 127.0.0.1:55519 127.0.0.1:55526 
2015-02-12 12:05:54,014 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741834_1010 127.0.0.1:55526 127.0.0.1:55529 127.0.0.1:55522 
2015-02-12 12:05:54,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/1028181914_test_2F2F1CF144D84C1FBE4425F290A81966	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,016 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741847_1023 127.0.0.1:55529 127.0.0.1:55526 127.0.0.1:55522 
2015-02-12 12:05:54,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/5104596603_test_C1A1ED5FF3124FF1A189AD5DF8F4147B	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,018 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary
2015-02-12 12:05:54,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,038 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 12:05:54,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,052 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/manycheckpoint
2015-02-12 12:05:54,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/manycheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,081 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 12:05:54,081 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 12:05:54,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,103 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable] starting
2015-02-12 12:05:54,104 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-02-12 12:05:54,104 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint"]
2015-02-12 12:05:54,104 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable]  parallel execution is enabled: true
2015-02-12 12:05:54,105 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable]  starting jobs: 2
2015-02-12 12:05:54,105 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable]  allocating threads: 2
2015-02-12 12:05:54,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,109 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] at least one sink does not exist
2015-02-12 12:05:54,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,113 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] source modification date at: Thu Feb 12 12:04:44 PST 2015
2015-02-12 12:05:54,113 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] starting step: (1/2)
2015-02-12 12:05:54,124 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:05:54,136 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:05:54,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,140 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031
2015-02-12 12:05:54,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,142 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(286)) - Allocated new applicationId: 4
2015-02-12 12:05:54,142 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031
2015-02-12 12:05:54,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 12:05:54,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 12:05:54,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:54,150 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:05:54,152 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037 src: /127.0.0.1:56143 dest: /127.0.0.1:55522
2015-02-12 12:05:54,153 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037 src: /127.0.0.1:56144 dest: /127.0.0.1:55526
2015-02-12 12:05:54,155 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037 src: /127.0.0.1:56145 dest: /127.0.0.1:55519
2015-02-12 12:05:54,160 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56145, dest: /127.0.0.1:55519, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037, duration: 2494000
2015-02-12 12:05:54,160 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:54,161 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:05:54,161 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56144, dest: /127.0.0.1:55526, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037, duration: 3345000
2015-02-12 12:05:54,161 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:54,161 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:05:54,162 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56143, dest: /127.0.0.1:55522, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037, duration: 4616000
2015-02-12 12:05:54,162 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:54,163 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:54,164 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:54,165 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar
2015-02-12 12:05:54,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:54,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,179 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 12:05:54,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:54,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:54,186 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split
2015-02-12 12:05:54,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,188 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split. BP-1120419527-10.1.1.68-1423771456695 blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:54,190 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038 src: /127.0.0.1:56146 dest: /127.0.0.1:55519
2015-02-12 12:05:54,192 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038 src: /127.0.0.1:56147 dest: /127.0.0.1:55526
2015-02-12 12:05:54,193 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038 src: /127.0.0.1:56148 dest: /127.0.0.1:55529
2015-02-12 12:05:54,195 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038 src: /127.0.0.1:56149 dest: /127.0.0.1:55522
2015-02-12 12:05:54,199 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56149, dest: /127.0.0.1:55522, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038, duration: 2194000
2015-02-12 12:05:54,199 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:54,199 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:54,200 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56148, dest: /127.0.0.1:55529, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038, duration: 2440000
2015-02-12 12:05:54,200 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:54,200 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:05:54,201 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56147, dest: /127.0.0.1:55526, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038, duration: 3657000
2015-02-12 12:05:54,201 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:54,202 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:54,202 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56146, dest: /127.0.0.1:55519, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038, duration: 5000000
2015-02-12 12:05:54,202 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:54,205 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:54,207 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:54,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:54,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:54,213 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo. BP-1120419527-10.1.1.68-1423771456695 blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:05:54,215 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039 src: /127.0.0.1:56150 dest: /127.0.0.1:55526
2015-02-12 12:05:54,217 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039 src: /127.0.0.1:56151 dest: /127.0.0.1:55529
2015-02-12 12:05:54,218 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039 src: /127.0.0.1:56152 dest: /127.0.0.1:55522
2015-02-12 12:05:54,222 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56152, dest: /127.0.0.1:55522, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039, duration: 1500000
2015-02-12 12:05:54,222 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:54,223 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:54,223 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56151, dest: /127.0.0.1:55529, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039, duration: 2076000
2015-02-12 12:05:54,223 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:54,223 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:05:54,224 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56150, dest: /127.0.0.1:55526, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039, duration: 3206000
2015-02-12 12:05:54,224 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:54,225 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:54,226 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:54,227 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:4
2015-02-12 12:05:54,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:54,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:05:54,243 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:05:54,244 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040 src: /127.0.0.1:56153 dest: /127.0.0.1:55519
2015-02-12 12:05:54,246 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040 src: /127.0.0.1:56154 dest: /127.0.0.1:55529
2015-02-12 12:05:54,247 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040 src: /127.0.0.1:56155 dest: /127.0.0.1:55526
2015-02-12 12:05:54,250 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56155, dest: /127.0.0.1:55526, bytes: 97200, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040, duration: 1900000
2015-02-12 12:05:54,251 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:54,251 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:05:54,251 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56154, dest: /127.0.0.1:55529, bytes: 97200, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040, duration: 2678000
2015-02-12 12:05:54,252 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:54,252 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:54,253 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56153, dest: /127.0.0.1:55519, bytes: 97200, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040, duration: 3926000
2015-02-12 12:05:54,253 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:54,255 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:05:54,256 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:05:54,257 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_1423771478362_0004
2015-02-12 12:05:54,257 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1492)) - BLOCK* ask 127.0.0.1:55519 to replicate blk_1073741861_1037 to datanode(s) 127.0.0.1:55529
2015-02-12 12:05:54,257 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741857_1033, blk_1073741847_1023, blk_1073741833_1009, blk_1073741834_1010, blk_1073741835_1011, blk_1073741851_1027, blk_1073741852_1028, blk_1073741837_1013, blk_1073741853_1029, blk_1073741854_1030, blk_1073741855_1031]
2015-02-12 12:05:54,258 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55519 to delete [blk_1073741833_1009, blk_1073741851_1027, blk_1073741852_1028, blk_1073741837_1013, blk_1073741853_1029, blk_1073741854_1030, blk_1073741855_1031]
2015-02-12 12:05:54,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:54,277 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(577)) - Application with id 4 submitted by user soberoi
2015-02-12 12:05:54,277 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(973)) - Storing application with id application_1423771478362_0004
2015-02-12 12:05:54,277 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0004 State change from NEW to NEW_SAVING
2015-02-12 12:05:54,277 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	IP=10.1.1.68	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423771478362_0004
2015-02-12 12:05:54,277 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423771478362_0004
2015-02-12 12:05:54,278 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0004 State change from NEW_SAVING to SUBMITTED
2015-02-12 12:05:54,278 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(386)) - Application added - appId: application_1423771478362_0004 user: soberoi leaf-queue of parent: root #applications: 2
2015-02-12 12:05:54,278 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(716)) - Accepted application application_1423771478362_0004 from user: soberoi, in queue: default
2015-02-12 12:05:54,278 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0004 State change from SUBMITTED to ACCEPTED
2015-02-12 12:05:54,279 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(670)) - Registering app attempt : appattempt_1423771478362_0004_000001
2015-02-12 12:05:54,279 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0004_000001 State change from NEW to SUBMITTED
2015-02-12 12:05:54,280 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(626)) - Application application_1423771478362_0004 from user: soberoi activated in queue: default
2015-02-12 12:05:54,280 INFO  capacity.LeafQueue (LeafQueue.java:addApplicationAttempt(643)) - Application added - appId: application_1423771478362_0004 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@35816f1c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-02-12 12:05:54,280 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplicationAttempt(746)) - Added Application Attempt appattempt_1423771478362_0004_000001 to scheduler from user soberoi in queue default
2015-02-12 12:05:54,280 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(251)) - Submitted application application_1423771478362_0004
2015-02-12 12:05:54,281 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0004_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 12:05:54,284 INFO  mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://Edinburgh.local:55663/proxy/application_1423771478362_0004/
2015-02-12 12:05:54,284 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] submitted hadoop job: job_1423771478362_0004
2015-02-12 12:05:54,284 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] tracking url: http://Edinburgh.local:55663/proxy/application_1423771478362_0004/
2015-02-12 12:05:54,769 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:05:54,770 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000001
2015-02-12 12:05:54,770 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55664, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 12:05:54,770 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0004_000001 container=Container: [ContainerId: container_1423771478362_0004_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:05:54,770 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-02-12 12:05:54,770 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:54,770 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:54,771 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55664 for container : container_1423771478362_0004_01_000001
2015-02-12 12:05:54,772 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:05:54,773 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423771478362_0004_000001
2015-02-12 12:05:54,773 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1837)) - Storing attempt: AppId: application_1423771478362_0004 AttemptId: appattempt_1423771478362_0004_000001 MasterContainer: Container: [ContainerId: container_1423771478362_0004_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ]
2015-02-12 12:05:54,773 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0004_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 12:05:54,773 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0004_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 12:05:54,774 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423771478362_0004_000001
2015-02-12 12:05:54,776 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423771478362_0004_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] for AM appattempt_1423771478362_0004_000001
2015-02-12 12:05:54,776 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423771478362_0004_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 12:05:54,776 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423771478362_0004_000001
2015-02-12 12:05:54,776 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423771478362_0004_000001
2015-02-12 12:05:54,779 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0004_000001 (auth:SIMPLE)
2015-02-12 12:05:54,782 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0004_01_000001 by user soberoi
2015-02-12 12:05:54,783 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0004
2015-02-12 12:05:54,783 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000001
2015-02-12 12:05:54,783 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0004 transitioned from NEW to INITING
2015-02-12 12:05:54,783 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0004_01_000001 to application application_1423771478362_0004
2015-02-12 12:05:54,783 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0004 transitioned from INITING to RUNNING
2015-02-12 12:05:54,783 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423771478362_0004_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] for AM appattempt_1423771478362_0004_000001
2015-02-12 12:05:54,784 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0004_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 12:05:54,784 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 12:05:54,784 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0004
2015-02-12 12:05:54,784 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:05:54,784 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 12:05:54,784 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split transitioned from INIT to DOWNLOADING
2015-02-12 12:05:54,784 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:05:54,785 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0004_01_000001
2015-02-12 12:05:54,800 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423771478362_0004_01_000001.tokens. Credentials list: 
2015-02-12 12:05:54,926 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:05:54,983 INFO  datanode.DataNode (DataNode.java:transferBlock(1812)) - DatanodeRegistration(127.0.0.1, datanodeUuid=7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, infoPort=55520, ipcPort=55521, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) Starting thread to transfer BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037 to 127.0.0.1:55529 
2015-02-12 12:05:54,983 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741857 for deletion
2015-02-12 12:05:54,983 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741847 for deletion
2015-02-12 12:05:54,983 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741833 for deletion
2015-02-12 12:05:54,983 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741857
2015-02-12 12:05:54,984 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741847
2015-02-12 12:05:54,984 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741833
2015-02-12 12:05:54,983 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741833 for deletion
2015-02-12 12:05:54,983 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741834 for deletion
2015-02-12 12:05:54,984 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741851 for deletion
2015-02-12 12:05:54,984 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741835 for deletion
2015-02-12 12:05:54,984 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037 src: /127.0.0.1:56161 dest: /127.0.0.1:55529
2015-02-12 12:05:54,984 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741851 for deletion
2015-02-12 12:05:54,985 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741852 for deletion
2015-02-12 12:05:54,985 INFO  datanode.DataNode (DataNode.java:run(2020)) - DataTransfer: Transmitted BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037 (numBytes=254067) to /127.0.0.1:55529
2015-02-12 12:05:54,985 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741834
2015-02-12 12:05:54,985 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741851
2015-02-12 12:05:54,984 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741852 for deletion
2015-02-12 12:05:54,986 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741851
2015-02-12 12:05:54,986 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741835
2015-02-12 12:05:54,984 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741833
2015-02-12 12:05:54,986 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741852
2015-02-12 12:05:54,986 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741852
2015-02-12 12:05:54,986 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741853 for deletion
2015-02-12 12:05:54,987 INFO  datanode.DataNode (DataXceiver.java:writeBlock(755)) - Received BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037 src: /127.0.0.1:56161 dest: /127.0.0.1:55529 of size 254067
2015-02-12 12:05:54,985 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741853 for deletion
2015-02-12 12:05:54,987 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741837 for deletion
2015-02-12 12:05:54,987 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741853
2015-02-12 12:05:54,987 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741854 for deletion
2015-02-12 12:05:54,987 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741855 for deletion
2015-02-12 12:05:54,988 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741853
2015-02-12 12:05:54,988 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741837
2015-02-12 12:05:54,987 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741837 for deletion
2015-02-12 12:05:54,988 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741854
2015-02-12 12:05:54,988 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741861_1037 size 254067
2015-02-12 12:05:54,989 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741855
2015-02-12 12:05:54,989 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741837
2015-02-12 12:05:54,988 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741854 for deletion
2015-02-12 12:05:54,989 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741855 for deletion
2015-02-12 12:05:54,990 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741855
2015-02-12 12:05:54,990 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741854
2015-02-12 12:05:55,008 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423771478362_0004_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000001.tokens
2015-02-12 12:05:55,008 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:05:55,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:55,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:05:55,110 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0004/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:55,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:55,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:55,158 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0004/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:55,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:55,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:05:55,205 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0004/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:55,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:55,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:05:55,253 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0004/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:05:55,253 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:05:55,283 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 12:05:55,283 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:55,374 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000001/default_container_executor.sh]
2015-02-12 12:05:55,683 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741855_1031
2015-02-12 12:05:55,777 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:55,778 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:05:56,779 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:57,263 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741857_1033, blk_1073741847_1023, blk_1073741833_1009, blk_1073741834_1010, blk_1073741835_1011, blk_1073741851_1027, blk_1073741852_1028, blk_1073741853_1029, blk_1073741854_1030]
2015-02-12 12:05:57,263 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55529 to delete [blk_1073741857_1033, blk_1073741847_1023, blk_1073741834_1010, blk_1073741835_1011, blk_1073741851_1027, blk_1073741852_1028, blk_1073741837_1013, blk_1073741855_1031]
2015-02-12 12:05:57,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:05:57,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 12:05:57,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 12:05:57,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 12:05:57,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004	dst=null	perm=null	proto=rpc
2015-02-12 12:05:57,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:05:57,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:05:57,785 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:58,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:58,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:05:58,295 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741857 for deletion
2015-02-12 12:05:58,295 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741847 for deletion
2015-02-12 12:05:58,295 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741833 for deletion
2015-02-12 12:05:58,295 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741857
2015-02-12 12:05:58,295 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741834 for deletion
2015-02-12 12:05:58,296 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741851 for deletion
2015-02-12 12:05:58,296 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741847
2015-02-12 12:05:58,296 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741835 for deletion
2015-02-12 12:05:58,296 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741852 for deletion
2015-02-12 12:05:58,296 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741851
2015-02-12 12:05:58,296 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741853 for deletion
2015-02-12 12:05:58,296 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741833
2015-02-12 12:05:58,296 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741854 for deletion
2015-02-12 12:05:58,296 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741835
2015-02-12 12:05:58,296 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741834
2015-02-12 12:05:58,297 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741853
2015-02-12 12:05:58,297 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741852
2015-02-12 12:05:58,297 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741854
2015-02-12 12:05:58,785 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:59,014 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(346)) - Container container_1423771478362_0003_01_000001 succeeded 
2015-02-12 12:05:59,014 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0003_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 12:05:59,015 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0003_01_000001
2015-02-12 12:05:59,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000001
2015-02-12 12:05:59,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000001
2015-02-12 12:05:59,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000001
2015-02-12 12:05:59,062 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0003	CONTAINERID=container_1423771478362_0003_01_000001
2015-02-12 12:05:59,063 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0003_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 12:05:59,063 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0003_01_000001 from application application_1423771478362_0003
2015-02-12 12:05:59,063 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:05:59,063 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0003
2015-02-12 12:05:59,063 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0003/container_1423771478362_0003_01_000001
2015-02-12 12:05:59,150 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032
2015-02-12 12:05:59,150 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034
2015-02-12 12:05:59,151 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035
2015-02-12 12:05:59,151 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034
2015-02-12 12:05:59,153 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036
2015-02-12 12:05:59,226 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0004_000001 (auth:SIMPLE)
2015-02-12 12:05:59,230 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(274)) - AM registration appattempt_1423771478362_0004_000001
2015-02-12 12:05:59,230 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(127)) - USER=soberoi	IP=10.1.1.68	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423771478362_0004	APPATTEMPTID=appattempt_1423771478362_0004_000001
2015-02-12 12:05:59,231 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0004_000001 State change from LAUNCHED to RUNNING
2015-02-12 12:05:59,231 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0004 State change from ACCEPTED to RUNNING
2015-02-12 12:05:59,237 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0003_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:05:59,237 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0003_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 12:05:59,237 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0003	CONTAINERID=container_1423771478362_0003_01_000001
2015-02-12 12:05:59,237 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55673, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:05:59,238 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:05:59,238 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0003_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:05:59,237 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(676)) - Unregistering app attempt : appattempt_1423771478362_0003_000001
2015-02-12 12:05:59,238 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423771478362_0003_000001
2015-02-12 12:05:59,238 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:05:59,238 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0003_000001 State change from FINISHING to FINISHED
2015-02-12 12:05:59,238 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-02-12 12:05:59,239 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0003_000001 released container container_1423771478362_0003_01_000001 on node: host: 10.1.1.68:55673 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:05:59,239 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0003 State change from FINISHING to FINISHED
2015-02-12 12:05:59,239 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplicationAttempt(785)) - Application Attempt appattempt_1423771478362_0003_000001 is done. finalState=FINISHED
2015-02-12 12:05:59,239 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423771478362_0003
2015-02-12 12:05:59,239 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423771478362_0003 requests cleared
2015-02-12 12:05:59,239 INFO  capacity.LeafQueue (LeafQueue.java:removeApplicationAttempt(686)) - Application removed - appId: application_1423771478362_0003 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-02-12 12:05:59,240 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(411)) - Application removed - appId: application_1423771478362_0003 user: soberoi leaf-queue of parent: root #applications: 1
2015-02-12 12:05:59,240 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423771478362_0003_000001
2015-02-12 12:05:59,239 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(179)) - appId=application_1423771478362_0003,name=[61F0DA785F0A4444B72F9543DFADE737/498986D99FB64F2E8C2D23EA0D051509] test/(3/3) ...ntplatform/manycheckpoint,user=soberoi,queue=default,state=FINISHED,trackingUrl=http://Edinburgh.local:55663/proxy/application_1423771478362_0003/jobhistory/job/job_1423771478362_0003,appMasterHost=10.1.1.68,startTime=1423771543098,finishTime=1423771552947,finalStatus=SUCCEEDED
2015-02-12 12:05:59,244 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0003_000001 (auth:SIMPLE)
2015-02-12 12:05:59,246 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0003_01_000001
2015-02-12 12:05:59,246 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0003	CONTAINERID=container_1423771478362_0003_01_000001
2015-02-12 12:05:59,247 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0003_01_000001]
2015-02-12 12:05:59,247 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:59,247 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:05:59,248 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0003
2015-02-12 12:05:59,248 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0003
2015-02-12 12:05:59,248 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:05:59,249 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0003, with delay of 10800 seconds
2015-02-12 12:05:59,249 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0003
2015-02-12 12:05:59,249 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0003
2015-02-12 12:05:59,250 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0003
2015-02-12 12:05:59,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:59,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:05:59,444 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038
2015-02-12 12:05:59,444 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039
2015-02-12 12:05:59,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:05:59,647 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037
2015-02-12 12:05:59,647 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035
2015-02-12 12:05:59,648 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032
2015-02-12 12:05:59,649 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040
2015-02-12 12:05:59,659 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1_conf.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:05:59,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741857 for deletion
2015-02-12 12:05:59,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741847 for deletion
2015-02-12 12:05:59,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741834 for deletion
2015-02-12 12:05:59,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741857
2015-02-12 12:05:59,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741851 for deletion
2015-02-12 12:05:59,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741847
2015-02-12 12:05:59,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741835 for deletion
2015-02-12 12:05:59,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741852 for deletion
2015-02-12 12:05:59,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741834
2015-02-12 12:05:59,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741851
2015-02-12 12:05:59,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741837 for deletion
2015-02-12 12:05:59,675 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741852
2015-02-12 12:05:59,675 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741855 for deletion
2015-02-12 12:05:59,675 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741835
2015-02-12 12:05:59,675 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741837
2015-02-12 12:05:59,675 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741855
2015-02-12 12:05:59,712 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041 src: /127.0.0.1:56203 dest: /127.0.0.1:55522
2015-02-12 12:05:59,714 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041 src: /127.0.0.1:56204 dest: /127.0.0.1:55529
2015-02-12 12:05:59,716 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041 src: /127.0.0.1:56205 dest: /127.0.0.1:55526
2015-02-12 12:05:59,748 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56205, dest: /127.0.0.1:55526, bytes: 114317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041, duration: 30357000
2015-02-12 12:05:59,748 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:05:59,748 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:05:59,749 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56204, dest: /127.0.0.1:55529, bytes: 114317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041, duration: 31025000
2015-02-12 12:05:59,749 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:59,749 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:05:59,750 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56203, dest: /127.0.0.1:55522, bytes: 114317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041, duration: 32006000
2015-02-12 12:05:59,750 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:05:59,750 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:05:59,754 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1_conf.xml is closed by DFSClient_NONMAPREDUCE_599305467_1
2015-02-12 12:05:59,794 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:05:59,794 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:05:59,795 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0003
2015-02-12 12:05:59,795 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0003
2015-02-12 12:05:59,795 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0003
2015-02-12 12:05:59,795 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0003
2015-02-12 12:05:59,796 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:05:59,796 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0003, with delay of 10800 seconds
2015-02-12 12:05:59,796 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0003
2015-02-12 12:05:59,849 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036
2015-02-12 12:06:00,690 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040
2015-02-12 12:06:00,690 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741858_1034
2015-02-12 12:06:00,690 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741856_1032
2015-02-12 12:06:00,691 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039
2015-02-12 12:06:00,692 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741860_1036
2015-02-12 12:06:00,692 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741859_1035
2015-02-12 12:06:00,801 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:00,801 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:06:00,801 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000002
2015-02-12 12:06:00,802 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:06:00,802 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0004_000001 container=Container: [ContainerId: container_1423771478362_0004_01_000002, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:06:00,802 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:06:00,802 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:00,803 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:06:00,803 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000003
2015-02-12 12:06:00,803 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 12:06:00,803 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0004_000001 container=Container: [ContainerId: container_1423771478362_0004_01_000003, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:06:00,804 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:06:00,804 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:00,804 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:06:00,804 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000004
2015-02-12 12:06:00,804 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 12:06:00,805 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0004_000001 container=Container: [ContainerId: container_1423771478362_0004_01_000004, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:06:00,805 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:06:00,805 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:00,805 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:06:00,805 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000005
2015-02-12 12:06:00,805 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 12:06:00,806 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0004_000001 container=Container: [ContainerId: container_1423771478362_0004_01_000005, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:06:00,806 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-02-12 12:06:00,806 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:01,094 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037
2015-02-12 12:06:01,094 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038
2015-02-12 12:06:01,394 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55669 for container : container_1423771478362_0004_01_000002
2015-02-12 12:06:01,394 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:06:01,395 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:06:01,396 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:06:01,397 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:06:01,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,557 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0004_000001 (auth:SIMPLE)
2015-02-12 12:06:01,558 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0004_000001 (auth:SIMPLE)
2015-02-12 12:06:01,560 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0004_000001 (auth:SIMPLE)
2015-02-12 12:06:01,564 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0004_000001 (auth:SIMPLE)
2015-02-12 12:06:01,571 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0004_01_000004 by user soberoi
2015-02-12 12:06:01,572 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0004
2015-02-12 12:06:01,572 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0004_01_000005 by user soberoi
2015-02-12 12:06:01,572 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000004
2015-02-12 12:06:01,572 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0004_01_000003 by user soberoi
2015-02-12 12:06:01,573 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000003
2015-02-12 12:06:01,574 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0004 transitioned from NEW to INITING
2015-02-12 12:06:01,574 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0004_01_000004 to application application_1423771478362_0004
2015-02-12 12:06:01,574 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0004_01_000002 by user soberoi
2015-02-12 12:06:01,574 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000002
2015-02-12 12:06:01,575 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000005
2015-02-12 12:06:01,574 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0004_01_000005 to application application_1423771478362_0004
2015-02-12 12:06:01,575 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0004_01_000003 to application application_1423771478362_0004
2015-02-12 12:06:01,575 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0004_01_000002 to application application_1423771478362_0004
2015-02-12 12:06:01,575 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0004 transitioned from INITING to RUNNING
2015-02-12 12:06:01,576 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 12:06:01,576 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 12:06:01,576 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 12:06:01,577 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 12:06:01,577 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0004
2015-02-12 12:06:01,577 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0004
2015-02-12 12:06:01,577 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:06:01,577 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0004
2015-02-12 12:06:01,577 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:06:01,577 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:06:01,578 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0004
2015-02-12 12:06:01,580 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0004
2015-02-12 12:06:01,580 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:06:01,580 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0004
2015-02-12 12:06:01,580 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0004
2015-02-12 12:06:01,580 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0004
2015-02-12 12:06:01,581 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:06:01,581 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0004
2015-02-12 12:06:01,581 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0004
2015-02-12 12:06:01,581 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0004
2015-02-12 12:06:01,581 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:06:01,581 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0004
2015-02-12 12:06:01,582 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0004_01_000004
2015-02-12 12:06:01,583 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0004_01_000002
2015-02-12 12:06:01,584 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0004_01_000003
2015-02-12 12:06:01,585 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0004_01_000005
2015-02-12 12:06:01,604 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423771478362_0004_01_000004.tokens. Credentials list: 
2015-02-12 12:06:01,604 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423771478362_0004_01_000002.tokens. Credentials list: 
2015-02-12 12:06:01,605 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0004_01_000003.tokens. Credentials list: 
2015-02-12 12:06:01,605 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423771478362_0004_01_000005.tokens. Credentials list: 
2015-02-12 12:06:01,736 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:06:01,812 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:06:01,812 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:06:01,812 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:06:01,813 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:06:01,850 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423771478362_0004_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000004.tokens
2015-02-12 12:06:01,851 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:01,857 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:06:01,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:01,980 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:06:01,982 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423771478362_0004_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000005.tokens
2015-02-12 12:06:01,982 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:02,040 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0004/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:06:02,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:02,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:02,114 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:06:02,114 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423771478362_0004_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000003.tokens
2015-02-12 12:06:02,115 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:02,124 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:06:02,124 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:06:02,124 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:06:02,124 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:06:02,124 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:06:02,185 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 12:06:02,185 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:02,190 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 12:06:02,190 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:02,194 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 12:06:02,194 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:02,195 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 12:06:02,195 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:02,324 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423771478362_0004_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000002.tokens
2015-02-12 12:06:02,325 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:02,391 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000003/default_container_executor.sh]
2015-02-12 12:06:02,391 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000005/default_container_executor.sh]
2015-02-12 12:06:02,402 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000002/default_container_executor.sh]
2015-02-12 12:06:02,402 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000004/default_container_executor.sh]
2015-02-12 12:06:02,423 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:06:04,154 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741863_1039
2015-02-12 12:06:04,156 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037
2015-02-12 12:06:04,157 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038
2015-02-12 12:06:04,159 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741862_1038
2015-02-12 12:06:04,161 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741861_1037
2015-02-12 12:06:04,162 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741864_1040
2015-02-12 12:06:04,863 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041
2015-02-12 12:06:06,102 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041
2015-02-12 12:06:09,163 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741865_1041
2015-02-12 12:06:10,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:11,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:11,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:11,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:11,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:06:11,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:11,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:06:11,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:11,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:06:11,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:06:11,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:11,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:11,956 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000003_0/part-00003. BP-1120419527-10.1.1.68-1423771456695 blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:06:12,017 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042 src: /127.0.0.1:56251 dest: /127.0.0.1:55529
2015-02-12 12:06:12,019 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042 src: /127.0.0.1:56252 dest: /127.0.0.1:55519
2015-02-12 12:06:12,021 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042 src: /127.0.0.1:56253 dest: /127.0.0.1:55522
2015-02-12 12:06:12,053 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56253, dest: /127.0.0.1:55522, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000003_0_207908855_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042, duration: 30282000
2015-02-12 12:06:12,053 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:12,054 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:06:12,054 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56252, dest: /127.0.0.1:55519, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000003_0_207908855_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042, duration: 31189000
2015-02-12 12:06:12,054 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,055 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:06:12,055 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56251, dest: /127.0.0.1:55529, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000003_0_207908855_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042, duration: 32227000
2015-02-12 12:06:12,055 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,056 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:06:12,067 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000003_0/part-00003 is closed by DFSClient_attempt_1423771478362_0004_m_000003_0_207908855_1
2015-02-12 12:06:12,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000003	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000003_0	dst=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000003	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:06:12,128 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0004_000001 (auth:SIMPLE)
2015-02-12 12:06:12,130 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0004_01_000005
2015-02-12 12:06:12,130 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000005
2015-02-12 12:06:12,130 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000005 transitioned from RUNNING to KILLING
2015-02-12 12:06:12,131 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0004_01_000005
2015-02-12 12:06:12,149 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1.jhist. BP-1120419527-10.1.1.68-1423771456695 blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:06:12,149 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0004_01_000005 is : 143
2015-02-12 12:06:12,152 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741867_1043 src: /127.0.0.1:56256 dest: /127.0.0.1:55529
2015-02-12 12:06:12,154 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741867_1043 src: /127.0.0.1:56257 dest: /127.0.0.1:55522
2015-02-12 12:06:12,158 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741867_1043 src: /127.0.0.1:56258 dest: /127.0.0.1:55519
2015-02-12 12:06:12,175 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:06:12,175 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000005
2015-02-12 12:06:12,176 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000005
2015-02-12 12:06:12,176 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000005
2015-02-12 12:06:12,177 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000005
2015-02-12 12:06:12,177 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000005
2015-02-12 12:06:12,177 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:06:12,177 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0004_01_000005 from application application_1423771478362_0004
2015-02-12 12:06:12,177 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:12,177 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0004
2015-02-12 12:06:12,208 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4450)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1.jhist for DFSClient_NONMAPREDUCE_599305467_1
2015-02-12 12:06:12,442 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000001_0/part-00001. BP-1120419527-10.1.1.68-1423771456695 blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:06:12,477 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000000_0/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:06:12,510 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000002_0/part-00002. BP-1120419527-10.1.1.68-1423771456695 blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:06:12,578 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045 src: /127.0.0.1:56264 dest: /127.0.0.1:55529
2015-02-12 12:06:12,580 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045 src: /127.0.0.1:56266 dest: /127.0.0.1:55519
2015-02-12 12:06:12,582 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045 src: /127.0.0.1:56267 dest: /127.0.0.1:55522
2015-02-12 12:06:12,586 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046 src: /127.0.0.1:56265 dest: /127.0.0.1:55526
2015-02-12 12:06:12,588 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046 src: /127.0.0.1:56268 dest: /127.0.0.1:55519
2015-02-12 12:06:12,589 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044 src: /127.0.0.1:56263 dest: /127.0.0.1:55526
2015-02-12 12:06:12,589 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046 src: /127.0.0.1:56269 dest: /127.0.0.1:55522
2015-02-12 12:06:12,590 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044 src: /127.0.0.1:56270 dest: /127.0.0.1:55522
2015-02-12 12:06:12,592 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044 src: /127.0.0.1:56271 dest: /127.0.0.1:55529
2015-02-12 12:06:12,639 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56269, dest: /127.0.0.1:55522, bytes: 152, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000002_0_383884428_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046, duration: 47709000
2015-02-12 12:06:12,639 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:12,640 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56268, dest: /127.0.0.1:55519, bytes: 152, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000002_0_383884428_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046, duration: 48478000
2015-02-12 12:06:12,640 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,640 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:06:12,641 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:06:12,641 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56265, dest: /127.0.0.1:55526, bytes: 152, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000002_0_383884428_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046, duration: 50072000
2015-02-12 12:06:12,641 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,642 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:06:12,670 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000002_0/part-00002 is closed by DFSClient_attempt_1423771478362_0004_m_000002_0_383884428_1
2015-02-12 12:06:12,681 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56271, dest: /127.0.0.1:55529, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000001_0_-366455173_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044, duration: 87571000
2015-02-12 12:06:12,681 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:12,682 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:06:12,682 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56270, dest: /127.0.0.1:55522, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000001_0_-366455173_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044, duration: 87933000
2015-02-12 12:06:12,682 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,683 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:06:12,683 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56263, dest: /127.0.0.1:55526, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000001_0_-366455173_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044, duration: 88197000
2015-02-12 12:06:12,683 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,684 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:06:12,688 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000001_0/part-00001 is closed by DFSClient_attempt_1423771478362_0004_m_000001_0_-366455173_1
2015-02-12 12:06:12,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000002	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,707 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56267, dest: /127.0.0.1:55522, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000000_0_888670356_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045, duration: 123635000
2015-02-12 12:06:12,708 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:12,708 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:06:12,708 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56266, dest: /127.0.0.1:55519, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000000_0_888670356_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045, duration: 124241000
2015-02-12 12:06:12,709 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,709 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:06:12,709 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56264, dest: /127.0.0.1:55529, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0004_m_000000_0_888670356_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045, duration: 125221000
2015-02-12 12:06:12,709 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,710 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:06:12,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000002_0	dst=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000002	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:06:12,714 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000000_0/part-00000 is closed by DFSClient_attempt_1423771478362_0004_m_000000_0_888670356_1
2015-02-12 12:06:12,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000001	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000001_0	dst=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000001	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:06:12,732 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0004_000001 (auth:SIMPLE)
2015-02-12 12:06:12,734 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0004_01_000004
2015-02-12 12:06:12,735 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000004
2015-02-12 12:06:12,735 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000004 transitioned from RUNNING to KILLING
2015-02-12 12:06:12,735 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0004_01_000004
2015-02-12 12:06:12,736 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:06:12,736 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0004_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 12:06:12,736 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000005
2015-02-12 12:06:12,736 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 12:06:12,736 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-02-12 12:06:12,737 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0004_01_000005, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 cluster=<memory:16384, vCores:32>
2015-02-12 12:06:12,737 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:12,737 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:06:12,737 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0004_000001 released container container_1423771478362_0004_01_000005 on node: host: 10.1.1.68:55669 #containers=3 available=1024 used=3072 with event: FINISHED
2015-02-12 12:06:12,738 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0004_000001 (auth:SIMPLE)
2015-02-12 12:06:12,744 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0004_01_000003
2015-02-12 12:06:12,744 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000003
2015-02-12 12:06:12,745 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:12,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,755 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0004_01_000004 is : 143
2015-02-12 12:06:12,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/_temporary/attempt_1423771478362_0004_m_000000_0	dst=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:06:12,769 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000003 transitioned from RUNNING to KILLING
2015-02-12 12:06:12,769 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:06:12,769 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0004_01_000003
2015-02-12 12:06:12,783 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0004_000001 (auth:SIMPLE)
2015-02-12 12:06:12,785 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0004_01_000002
2015-02-12 12:06:12,785 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000002
2015-02-12 12:06:12,786 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:12,788 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0004_01_000003 is : 143
2015-02-12 12:06:12,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:12,793 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_599305467_1
2015-02-12 12:06:12,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,802 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000004
2015-02-12 12:06:12,803 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000004
2015-02-12 12:06:12,803 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000004
2015-02-12 12:06:12,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,806 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000004
2015-02-12 12:06:12,807 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000002 transitioned from RUNNING to KILLING
2015-02-12 12:06:12,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,807 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:06:12,808 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000004
2015-02-12 12:06:12,808 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:06:12,808 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0004_01_000002
2015-02-12 12:06:12,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000000/part-00000	dst=/tmp/hadoop-soberoi/restartable/restartable/test/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:12,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000001	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000001/part-00001	dst=/tmp/hadoop-soberoi/restartable/restartable/test/part-00001	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:12,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000002	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,827 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0004_01_000002 is : 143
2015-02-12 12:06:12,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000002/part-00002	dst=/tmp/hadoop-soberoi/restartable/restartable/test/part-00002	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:12,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000003	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary/1/task_1423771478362_0004_m_000003/part-00003	dst=/tmp/hadoop-soberoi/restartable/restartable/test/part-00003	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:12,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/restartable/restartable/test/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:12,846 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000003
2015-02-12 12:06:12,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000003
2015-02-12 12:06:12,847 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/restartable/restartable/test/_SUCCESS is closed by DFSClient_NONMAPREDUCE_599305467_1
2015-02-12 12:06:12,848 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000003
2015-02-12 12:06:12,849 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000003
2015-02-12 12:06:12,849 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0004_01_000004 from application application_1423771478362_0004
2015-02-12 12:06:12,850 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:12,853 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:12,854 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_599305467_1
2015-02-12 12:06:12,854 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0004
2015-02-12 12:06:12,854 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:06:12,854 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000003
2015-02-12 12:06:12,855 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:06:12,855 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000002
2015-02-12 12:06:12,856 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000002
2015-02-12 12:06:12,856 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000002
2015-02-12 12:06:12,857 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000002
2015-02-12 12:06:12,857 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0004_01_000003 from application application_1423771478362_0004
2015-02-12 12:06:12,857 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:12,857 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0004
2015-02-12 12:06:12,857 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000002
2015-02-12 12:06:12,858 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:06:12,858 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0004_01_000002 from application application_1423771478362_0004
2015-02-12 12:06:12,859 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:12,859 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0004
2015-02-12 12:06:12,869 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56258, dest: /127.0.0.1:55519, bytes: 47543, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741867_1043, duration: 709129000
2015-02-12 12:06:12,869 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741867_1043, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:12,870 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 15502
2015-02-12 12:06:12,871 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56257, dest: /127.0.0.1:55522, bytes: 47543, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741867_1043, duration: 710313000
2015-02-12 12:06:12,871 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,872 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 15502
2015-02-12 12:06:12,872 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56256, dest: /127.0.0.1:55529, bytes: 47543, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741867_1043, duration: 711937000
2015-02-12 12:06:12,872 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,873 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 15502
2015-02-12 12:06:12,874 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1.jhist is closed by DFSClient_NONMAPREDUCE_599305467_1
2015-02-12 12:06:12,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:12,881 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004.summary_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:06:12,883 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047 src: /127.0.0.1:56275 dest: /127.0.0.1:55526
2015-02-12 12:06:12,885 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047 src: /127.0.0.1:56276 dest: /127.0.0.1:55522
2015-02-12 12:06:12,886 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047 src: /127.0.0.1:56277 dest: /127.0.0.1:55519
2015-02-12 12:06:12,889 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56277, dest: /127.0.0.1:55519, bytes: 411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047, duration: 1562000
2015-02-12 12:06:12,890 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:12,890 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:06:12,890 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56276, dest: /127.0.0.1:55522, bytes: 411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047, duration: 2365000
2015-02-12 12:06:12,890 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,891 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:06:12,891 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56275, dest: /127.0.0.1:55526, bytes: 411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047, duration: 3543000
2015-02-12 12:06:12,892 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,892 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:06:12,894 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004.summary_tmp is closed by DFSClient_NONMAPREDUCE_599305467_1
2015-02-12 12:06:12,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:06:12,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:12,919 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:06:12,922 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048 src: /127.0.0.1:56279 dest: /127.0.0.1:55529
2015-02-12 12:06:12,923 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048 src: /127.0.0.1:56280 dest: /127.0.0.1:55519
2015-02-12 12:06:12,925 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048 src: /127.0.0.1:56281 dest: /127.0.0.1:55522
2015-02-12 12:06:12,928 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56281, dest: /127.0.0.1:55522, bytes: 47543, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048, duration: 1790000
2015-02-12 12:06:12,928 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:12,928 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:06:12,929 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56280, dest: /127.0.0.1:55519, bytes: 47543, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048, duration: 2453000
2015-02-12 12:06:12,929 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,929 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:06:12,930 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56279, dest: /127.0.0.1:55529, bytes: 47543, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048, duration: 3598000
2015-02-12 12:06:12,930 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,931 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:06:12,933 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist_tmp is closed by DFSClient_NONMAPREDUCE_599305467_1
2015-02-12 12:06:12,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:06:12,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004/job_1423771478362_0004_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:12,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:12,951 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004_conf.xml_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:06:12,953 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049 src: /127.0.0.1:56283 dest: /127.0.0.1:55519
2015-02-12 12:06:12,955 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049 src: /127.0.0.1:56284 dest: /127.0.0.1:55526
2015-02-12 12:06:12,957 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049 src: /127.0.0.1:56285 dest: /127.0.0.1:55522
2015-02-12 12:06:12,967 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56285, dest: /127.0.0.1:55522, bytes: 114317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049, duration: 8520000
2015-02-12 12:06:12,967 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:12,969 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56284, dest: /127.0.0.1:55526, bytes: 114317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049, duration: 9372000
2015-02-12 12:06:12,970 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,970 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:06:12,971 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:06:12,971 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56283, dest: /127.0.0.1:55519, bytes: 114317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_599305467_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049, duration: 12162000
2015-02-12 12:06:12,971 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:12,972 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:06:12,973 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_599305467_1
2015-02-12 12:06:12,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:06:12,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:06:12,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:06:12,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:06:12,995 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1129)) - Updating application attempt appattempt_1423771478362_0004_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 12:06:12,995 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0004_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 12:06:12,995 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(992)) - Updating application application_1423771478362_0004 with final state: FINISHING
2015-02-12 12:06:12,996 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0004 State change from RUNNING to FINAL_SAVING
2015-02-12 12:06:12,996 INFO  recovery.RMStateStore (RMStateStore.java:transition(161)) - Updating info for app: application_1423771478362_0004
2015-02-12 12:06:12,996 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0004_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 12:06:12,996 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0004 State change from FINAL_SAVING to FINISHING
2015-02-12 12:06:13,788 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:06:13,788 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0004_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 12:06:13,788 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000002
2015-02-12 12:06:13,788 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 12:06:13,788 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-02-12 12:06:13,790 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0004_01_000002, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 cluster=<memory:16384, vCores:32>
2015-02-12 12:06:13,791 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:13,791 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:06:13,791 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0004_000001 released container container_1423771478362_0004_01_000002 on node: host: 10.1.1.68:55669 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 12:06:13,791 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:06:13,791 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0004_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 12:06:13,791 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000003
2015-02-12 12:06:13,791 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 12:06:13,792 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-02-12 12:06:13,792 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0004_01_000003, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 cluster=<memory:16384, vCores:32>
2015-02-12 12:06:13,792 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:13,793 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:06:13,793 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0004_000001 released container container_1423771478362_0004_01_000003 on node: host: 10.1.1.68:55669 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 12:06:13,793 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:06:13,793 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0004_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 12:06:13,793 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000004
2015-02-12 12:06:13,793 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:06:13,793 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:06:13,794 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0004_01_000004, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:06:13,794 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:13,795 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:06:13,795 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0004_000001 released container container_1423771478362_0004_01_000004 on node: host: 10.1.1.68:55669 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:06:13,795 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:13,999 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(351)) - application_1423771478362_0004 unregistered successfully. 
2015-02-12 12:06:14,003 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741861_1037 127.0.0.1:55522 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55529 
2015-02-12 12:06:14,004 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741862_1038 127.0.0.1:55519 127.0.0.1:55526 127.0.0.1:55529 127.0.0.1:55522 
2015-02-12 12:06:14,004 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741863_1039 127.0.0.1:55526 127.0.0.1:55529 127.0.0.1:55522 
2015-02-12 12:06:14,004 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741864_1040 127.0.0.1:55519 127.0.0.1:55529 127.0.0.1:55526 
2015-02-12 12:06:14,004 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741867_1043 127.0.0.1:55529 127.0.0.1:55522 127.0.0.1:55519 
2015-02-12 12:06:14,005 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741865_1041 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55526 
2015-02-12 12:06:14,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0004	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,088 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] starting step: (2/2) ...latform/restartcheckpoint
2015-02-12 12:06:14,107 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:06:14,157 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:06:14,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,190 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(286)) - Allocated new applicationId: 5
2015-02-12 12:06:14,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 12:06:14,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 12:06:14,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:06:14,210 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:06:14,212 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050 src: /127.0.0.1:56297 dest: /127.0.0.1:55522
2015-02-12 12:06:14,214 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050 src: /127.0.0.1:56298 dest: /127.0.0.1:55526
2015-02-12 12:06:14,216 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050 src: /127.0.0.1:56299 dest: /127.0.0.1:55529
2015-02-12 12:06:14,221 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56299, dest: /127.0.0.1:55529, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050, duration: 2934000
2015-02-12 12:06:14,222 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:14,222 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:06:14,223 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56298, dest: /127.0.0.1:55526, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050, duration: 4242000
2015-02-12 12:06:14,223 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:14,224 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56297, dest: /127.0.0.1:55522, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050, duration: 5216000
2015-02-12 12:06:14,224 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:06:14,225 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:14,226 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:06:14,228 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:06:14,229 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar
2015-02-12 12:06:14,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:06:14,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,251 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,270 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 4
2015-02-12 12:06:14,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:06:14,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:06:14,277 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split
2015-02-12 12:06:14,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,279 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split. BP-1120419527-10.1.1.68-1423771456695 blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:06:14,282 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051 src: /127.0.0.1:56300 dest: /127.0.0.1:55522
2015-02-12 12:06:14,283 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051 src: /127.0.0.1:56301 dest: /127.0.0.1:55526
2015-02-12 12:06:14,285 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051 src: /127.0.0.1:56302 dest: /127.0.0.1:55529
2015-02-12 12:06:14,287 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051 src: /127.0.0.1:56303 dest: /127.0.0.1:55519
2015-02-12 12:06:14,290 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56303, dest: /127.0.0.1:55519, bytes: 1303, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051, duration: 1936000
2015-02-12 12:06:14,291 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:14,291 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:06:14,292 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56302, dest: /127.0.0.1:55529, bytes: 1303, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051, duration: 2908000
2015-02-12 12:06:14,292 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:14,292 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:06:14,292 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56301, dest: /127.0.0.1:55526, bytes: 1303, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051, duration: 4192000
2015-02-12 12:06:14,293 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:14,293 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:06:14,294 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56300, dest: /127.0.0.1:55522, bytes: 1303, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051, duration: 4824000
2015-02-12 12:06:14,294 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:14,294 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:06:14,303 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:06:14,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:06:14,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:06:14,310 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo. BP-1120419527-10.1.1.68-1423771456695 blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:06:14,312 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052 src: /127.0.0.1:56305 dest: /127.0.0.1:55526
2015-02-12 12:06:14,314 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052 src: /127.0.0.1:56306 dest: /127.0.0.1:55522
2015-02-12 12:06:14,316 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052 src: /127.0.0.1:56307 dest: /127.0.0.1:55529
2015-02-12 12:06:14,319 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56307, dest: /127.0.0.1:55529, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052, duration: 1534000
2015-02-12 12:06:14,319 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:14,320 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56306, dest: /127.0.0.1:55522, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052, duration: 2653000
2015-02-12 12:06:14,321 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:14,320 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:06:14,322 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56305, dest: /127.0.0.1:55526, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052, duration: 4836000
2015-02-12 12:06:14,323 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:14,322 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:06:14,324 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:06:14,327 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:06:14,327 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:4
2015-02-12 12:06:14,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:06:14,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:06:14,434 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:06:14,436 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053 src: /127.0.0.1:56310 dest: /127.0.0.1:55522
2015-02-12 12:06:14,437 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053 src: /127.0.0.1:56311 dest: /127.0.0.1:55529
2015-02-12 12:06:14,439 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053 src: /127.0.0.1:56312 dest: /127.0.0.1:55519
2015-02-12 12:06:14,450 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56312, dest: /127.0.0.1:55519, bytes: 98839, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053, duration: 9414000
2015-02-12 12:06:14,450 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:14,450 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:06:14,451 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56311, dest: /127.0.0.1:55529, bytes: 98839, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053, duration: 10279000
2015-02-12 12:06:14,451 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:14,451 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:06:14,452 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56310, dest: /127.0.0.1:55522, bytes: 98839, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053, duration: 11377000
2015-02-12 12:06:14,452 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:14,453 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:06:14,456 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:06:14,456 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_1423771478362_0005
2015-02-12 12:06:14,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:14,502 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(577)) - Application with id 5 submitted by user soberoi
2015-02-12 12:06:14,502 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(973)) - Storing application with id application_1423771478362_0005
2015-02-12 12:06:14,502 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	IP=10.1.1.68	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423771478362_0005
2015-02-12 12:06:14,502 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423771478362_0005
2015-02-12 12:06:14,502 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0005 State change from NEW to NEW_SAVING
2015-02-12 12:06:14,503 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0005 State change from NEW_SAVING to SUBMITTED
2015-02-12 12:06:14,503 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(386)) - Application added - appId: application_1423771478362_0005 user: soberoi leaf-queue of parent: root #applications: 2
2015-02-12 12:06:14,503 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(716)) - Accepted application application_1423771478362_0005 from user: soberoi, in queue: default
2015-02-12 12:06:14,503 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0005 State change from SUBMITTED to ACCEPTED
2015-02-12 12:06:14,503 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(670)) - Registering app attempt : appattempt_1423771478362_0005_000001
2015-02-12 12:06:14,503 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0005_000001 State change from NEW to SUBMITTED
2015-02-12 12:06:14,504 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(626)) - Application application_1423771478362_0005 from user: soberoi activated in queue: default
2015-02-12 12:06:14,504 INFO  capacity.LeafQueue (LeafQueue.java:addApplicationAttempt(643)) - Application added - appId: application_1423771478362_0005 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@35816f1c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-02-12 12:06:14,504 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplicationAttempt(746)) - Added Application Attempt appattempt_1423771478362_0005_000001 to scheduler from user soberoi in queue default
2015-02-12 12:06:14,505 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0005_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 12:06:14,506 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(251)) - Submitted application application_1423771478362_0005
2015-02-12 12:06:14,517 INFO  mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://Edinburgh.local:55663/proxy/application_1423771478362_0005/
2015-02-12 12:06:14,518 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] submitted hadoop job: job_1423771478362_0005
2015-02-12 12:06:14,519 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] tracking url: http://Edinburgh.local:55663/proxy/application_1423771478362_0005/
2015-02-12 12:06:14,789 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:14,789 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:14,789 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:14,790 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:14,790 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:06:14,790 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000001
2015-02-12 12:06:14,790 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55669, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 12:06:14,790 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0005_000001 container=Container: [ContainerId: container_1423771478362_0005_01_000001, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:06:14,791 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-02-12 12:06:14,791 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:14,792 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55669 for container : container_1423771478362_0005_01_000001
2015-02-12 12:06:14,792 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:06:14,792 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423771478362_0005_000001
2015-02-12 12:06:14,792 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1837)) - Storing attempt: AppId: application_1423771478362_0005 AttemptId: appattempt_1423771478362_0005_000001 MasterContainer: Container: [ContainerId: container_1423771478362_0005_01_000001, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ]
2015-02-12 12:06:14,793 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0005_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 12:06:14,793 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0005_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 12:06:14,794 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423771478362_0005_000001
2015-02-12 12:06:14,796 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423771478362_0005_01_000001, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] for AM appattempt_1423771478362_0005_000001
2015-02-12 12:06:14,796 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423771478362_0005_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 12:06:14,796 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423771478362_0005_000001
2015-02-12 12:06:14,796 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423771478362_0005_000001
2015-02-12 12:06:14,800 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:06:14,803 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0005_01_000001 by user soberoi
2015-02-12 12:06:14,803 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0005
2015-02-12 12:06:14,804 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000001
2015-02-12 12:06:14,804 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0005 transitioned from NEW to INITING
2015-02-12 12:06:14,804 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0005_01_000001 to application application_1423771478362_0005
2015-02-12 12:06:14,804 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0005 transitioned from INITING to RUNNING
2015-02-12 12:06:14,804 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423771478362_0005_01_000001, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] for AM appattempt_1423771478362_0005_000001
2015-02-12 12:06:14,805 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 12:06:14,805 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0005
2015-02-12 12:06:14,805 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:06:14,805 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 12:06:14,805 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split transitioned from INIT to DOWNLOADING
2015-02-12 12:06:14,805 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:06:14,806 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0005_01_000001
2015-02-12 12:06:14,805 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0005_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 12:06:14,820 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423771478362_0005_01_000001.tokens. Credentials list: 
2015-02-12 12:06:15,004 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:06:15,147 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423771478362_0005_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000001.tokens
2015-02-12 12:06:15,148 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0005
2015-02-12 12:06:15,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:15,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:15,302 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1492)) - BLOCK* ask 127.0.0.1:55522 to replicate blk_1073741874_1050 to datanode(s) 127.0.0.1:55519
2015-02-12 12:06:15,302 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741863_1039, blk_1073741865_1041, blk_1073741867_1043]
2015-02-12 12:06:15,302 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55519 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741864_1040, blk_1073741867_1043]
2015-02-12 12:06:15,349 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0005/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:06:15,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:06:15,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:06:15,425 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0005/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:06:15,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:15,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:15,531 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0005/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:06:15,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:15,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:15,629 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0005/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:06:15,629 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:06:15,678 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 12:06:15,678 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:15,793 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:06:15,794 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:15,794 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:15,794 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:15,794 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:15,834 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000001/default_container_executor.sh]
2015-02-12 12:06:16,008 INFO  datanode.DataNode (DataNode.java:transferBlock(1812)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, infoPort=55523, ipcPort=55525, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) Starting thread to transfer BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050 to 127.0.0.1:55519 
2015-02-12 12:06:16,008 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741861 for deletion
2015-02-12 12:06:16,008 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741862 for deletion
2015-02-12 12:06:16,009 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741864 for deletion
2015-02-12 12:06:16,009 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741867 for deletion
2015-02-12 12:06:16,008 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741861 for deletion
2015-02-12 12:06:16,009 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741862 for deletion
2015-02-12 12:06:16,009 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741863 for deletion
2015-02-12 12:06:16,009 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741865 for deletion
2015-02-12 12:06:16,009 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741867 for deletion
2015-02-12 12:06:16,009 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741861
2015-02-12 12:06:16,010 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741862
2015-02-12 12:06:16,010 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741863
2015-02-12 12:06:16,009 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741861
2015-02-12 12:06:16,010 INFO  datanode.DataNode (DataNode.java:run(2020)) - DataTransfer: Transmitted BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050 (numBytes=254067) to /127.0.0.1:55519
2015-02-12 12:06:16,011 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741864
2015-02-12 12:06:16,011 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741865
2015-02-12 12:06:16,011 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741867
2015-02-12 12:06:16,009 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741862
2015-02-12 12:06:16,011 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741867
2015-02-12 12:06:16,012 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050 src: /127.0.0.1:56322 dest: /127.0.0.1:55519
2015-02-12 12:06:16,013 INFO  datanode.DataNode (DataXceiver.java:writeBlock(755)) - Received BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050 src: /127.0.0.1:56322 dest: /127.0.0.1:55519 of size 254067
2015-02-12 12:06:16,014 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741874_1050 size 254067
2015-02-12 12:06:16,797 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:16,797 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:16,797 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:16,797 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:17,802 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:17,802 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:17,802 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:17,803 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:18,150 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30003 milliseconds
2015-02-12 12:06:18,151 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(201)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 12:06:18,310 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741863_1039, blk_1073741864_1040, blk_1073741865_1041]
2015-02-12 12:06:18,310 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55529 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741863_1039, blk_1073741864_1040, blk_1073741865_1041, blk_1073741867_1043]
2015-02-12 12:06:18,805 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:18,805 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:18,805 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:18,806 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:19,082 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(346)) - Container container_1423771478362_0004_01_000001 succeeded 
2015-02-12 12:06:19,082 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 12:06:19,082 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0004_01_000001
2015-02-12 12:06:19,107 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000001
2015-02-12 12:06:19,108 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000001
2015-02-12 12:06:19,109 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000001
2015-02-12 12:06:19,110 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0004/container_1423771478362_0004_01_000001
2015-02-12 12:06:19,110 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000001
2015-02-12 12:06:19,111 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0004_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 12:06:19,111 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0004_01_000001 from application application_1423771478362_0004
2015-02-12 12:06:19,111 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:19,111 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0004
2015-02-12 12:06:19,181 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046
2015-02-12 12:06:19,181 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048
2015-02-12 12:06:19,181 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046
2015-02-12 12:06:19,181 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047
2015-02-12 12:06:19,181 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045
2015-02-12 12:06:19,182 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044
2015-02-12 12:06:19,182 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042
2015-02-12 12:06:19,182 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042
2015-02-12 12:06:19,182 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047
2015-02-12 12:06:19,183 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049
2015-02-12 12:06:19,183 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049
2015-02-12 12:06:19,183 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045
2015-02-12 12:06:19,184 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048
2015-02-12 12:06:19,326 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741861 for deletion
2015-02-12 12:06:19,327 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741862 for deletion
2015-02-12 12:06:19,327 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741863 for deletion
2015-02-12 12:06:19,327 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741861
2015-02-12 12:06:19,327 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741863
2015-02-12 12:06:19,327 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741864 for deletion
2015-02-12 12:06:19,327 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741862
2015-02-12 12:06:19,328 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741865 for deletion
2015-02-12 12:06:19,328 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741864
2015-02-12 12:06:19,328 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741865
2015-02-12 12:06:19,814 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:19,814 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:19,815 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:19,815 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:19,875 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0004_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:06:19,875 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(676)) - Unregistering app attempt : appattempt_1423771478362_0004_000001
2015-02-12 12:06:19,875 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0004_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 12:06:19,875 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423771478362_0004_000001
2015-02-12 12:06:19,875 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000001
2015-02-12 12:06:19,875 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55664, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:06:19,875 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0004_000001 State change from FINISHING to FINISHED
2015-02-12 12:06:19,875 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:06:19,876 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0004 State change from FINISHING to FINISHED
2015-02-12 12:06:19,876 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0004_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:06:19,876 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:19,876 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-02-12 12:06:19,876 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423771478362_0004
2015-02-12 12:06:19,876 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0004_000001 released container container_1423771478362_0004_01_000001 on node: host: 10.1.1.68:55664 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:06:19,876 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423771478362_0004_000001
2015-02-12 12:06:19,876 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(179)) - appId=application_1423771478362_0004,name=[59EA8DCD6DD84327B1BA141AF8F3D13B/0C02DB5BB0AA4AB39FE7637997A872C3] restartable/(1/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=http://Edinburgh.local:55663/proxy/application_1423771478362_0004/jobhistory/job/job_1423771478362_0004,appMasterHost=10.1.1.68,startTime=1423771554277,finishTime=1423771572995,finalStatus=SUCCEEDED
2015-02-12 12:06:19,876 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplicationAttempt(785)) - Application Attempt appattempt_1423771478362_0004_000001 is done. finalState=FINISHED
2015-02-12 12:06:19,877 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423771478362_0004 requests cleared
2015-02-12 12:06:19,877 INFO  capacity.LeafQueue (LeafQueue.java:removeApplicationAttempt(686)) - Application removed - appId: application_1423771478362_0004 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-02-12 12:06:19,877 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(411)) - Application removed - appId: application_1423771478362_0004 user: soberoi leaf-queue of parent: root #applications: 1
2015-02-12 12:06:19,882 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050
2015-02-12 12:06:19,882 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741871_1047
2015-02-12 12:06:19,883 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741870_1046
2015-02-12 12:06:19,883 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0004_000001 (auth:SIMPLE)
2015-02-12 12:06:19,887 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0004_01_000001
2015-02-12 12:06:19,887 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0004	CONTAINERID=container_1423771478362_0004_01_000001
2015-02-12 12:06:19,888 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0004_01_000001]
2015-02-12 12:06:19,888 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:19,888 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:06:19,889 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:19,889 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:19,889 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:19,889 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0004
2015-02-12 12:06:19,889 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:06:19,890 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0004, with delay of 10800 seconds
2015-02-12 12:06:19,890 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:20,082 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741873_1049
2015-02-12 12:06:20,082 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051
2015-02-12 12:06:20,083 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052
2015-02-12 12:06:20,083 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044
2015-02-12 12:06:20,691 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741861 for deletion
2015-02-12 12:06:20,691 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741862 for deletion
2015-02-12 12:06:20,691 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741863 for deletion
2015-02-12 12:06:20,691 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741864 for deletion
2015-02-12 12:06:20,691 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741862
2015-02-12 12:06:20,691 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741861
2015-02-12 12:06:20,691 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741865 for deletion
2015-02-12 12:06:20,692 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741864
2015-02-12 12:06:20,692 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741863
2015-02-12 12:06:20,692 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741867 for deletion
2015-02-12 12:06:20,692 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741865
2015-02-12 12:06:20,692 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741867
2015-02-12 12:06:20,821 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:06:20,821 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:20,822 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:20,822 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:20,822 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:20,822 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:20,822 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:20,822 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:20,823 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0004
2015-02-12 12:06:20,823 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:06:20,823 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0004, with delay of 10800 seconds
2015-02-12 12:06:20,823 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0004
2015-02-12 12:06:21,117 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741869_1045
2015-02-12 12:06:21,117 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052
2015-02-12 12:06:21,118 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741872_1048
2015-02-12 12:06:21,118 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741868_1044
2015-02-12 12:06:21,119 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053
2015-02-12 12:06:21,323 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050
2015-02-12 12:06:21,323 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051
2015-02-12 12:06:21,324 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741866_1042
2015-02-12 12:06:21,823 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:21,824 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:21,824 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:21,824 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:23,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:06:23,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 12:06:23,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 12:06:23,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 12:06:24,191 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053
2015-02-12 12:06:24,191 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741877_1053
2015-02-12 12:06:24,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005	dst=null	perm=null	proto=rpc
2015-02-12 12:06:24,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:06:24,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:06:24,392 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050
2015-02-12 12:06:24,392 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741874_1050
2015-02-12 12:06:24,392 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741876_1052
2015-02-12 12:06:24,393 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051
2015-02-12 12:06:24,393 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741875_1051
2015-02-12 12:06:25,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:06:25,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:06:26,427 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:06:26,431 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(274)) - AM registration appattempt_1423771478362_0005_000001
2015-02-12 12:06:26,431 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(127)) - USER=soberoi	IP=10.1.1.68	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423771478362_0005	APPATTEMPTID=appattempt_1423771478362_0005_000001
2015-02-12 12:06:26,431 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0005_000001 State change from LAUNCHED to RUNNING
2015-02-12 12:06:26,431 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0005 State change from ACCEPTED to RUNNING
2015-02-12 12:06:26,479 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(691)) - Number of transactions: 448 Total time for transactions(ms): 62 Number of transactions batched in Syncs: 0 Number of syncs: 296 SyncTimes(ms): 13 5 
2015-02-12 12:06:26,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:26,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:06:26,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:06:26,731 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1_conf.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:06:26,801 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054 src: /127.0.0.1:56389 dest: /127.0.0.1:55522
2015-02-12 12:06:26,803 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054 src: /127.0.0.1:56390 dest: /127.0.0.1:55526
2015-02-12 12:06:26,805 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054 src: /127.0.0.1:56391 dest: /127.0.0.1:55529
2015-02-12 12:06:26,874 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56391, dest: /127.0.0.1:55529, bytes: 115914, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054, duration: 67605000
2015-02-12 12:06:26,875 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:06:26,875 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56390, dest: /127.0.0.1:55526, bytes: 115914, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054, duration: 68881000
2015-02-12 12:06:26,876 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:26,877 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:06:26,877 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56389, dest: /127.0.0.1:55522, bytes: 115914, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054, duration: 69950000
2015-02-12 12:06:26,877 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:06:26,878 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:06:26,879 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:06:26,901 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1_conf.xml is closed by DFSClient_NONMAPREDUCE_374648955_1
2015-02-12 12:06:27,855 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:06:27,856 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000002
2015-02-12 12:06:27,856 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 12:06:27,856 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0005_000001 container=Container: [ContainerId: container_1423771478362_0005_01_000002, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:06:27,856 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:06:27,856 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:27,857 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:06:27,857 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000003
2015-02-12 12:06:27,857 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 12:06:27,857 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0005_000001 container=Container: [ContainerId: container_1423771478362_0005_01_000003, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:06:27,858 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:06:27,858 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:27,928 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:06:27,929 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000004
2015-02-12 12:06:27,929 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0005_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:06:27,929 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0005_000001 container=Container: [ContainerId: container_1423771478362_0005_01_000004, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:06:27,929 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:06:27,929 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:27,930 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:06:27,930 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000005
2015-02-12 12:06:27,930 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0005_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 12:06:27,930 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0005_000001 container=Container: [ContainerId: container_1423771478362_0005_01_000005, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:06:27,931 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-02-12 12:06:27,931 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:28,508 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55669 for container : container_1423771478362_0005_01_000002
2015-02-12 12:06:28,509 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:06:28,510 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:06:28,511 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55664 for container : container_1423771478362_0005_01_000004
2015-02-12 12:06:28,511 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:06:28,512 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:06:28,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:28,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:28,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:28,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:28,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:28,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:28,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:28,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:28,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:28,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:28,715 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:06:28,715 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:06:28,716 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:06:28,720 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0005_01_000004 by user soberoi
2015-02-12 12:06:28,721 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0005
2015-02-12 12:06:28,720 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0005_01_000002 by user soberoi
2015-02-12 12:06:28,721 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000004
2015-02-12 12:06:28,721 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000002
2015-02-12 12:06:28,720 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0005_01_000005 by user soberoi
2015-02-12 12:06:28,721 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0005 transitioned from NEW to INITING
2015-02-12 12:06:28,722 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0005_01_000004 to application application_1423771478362_0005
2015-02-12 12:06:28,722 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0005_01_000005 to application application_1423771478362_0005
2015-02-12 12:06:28,722 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0005 transitioned from INITING to RUNNING
2015-02-12 12:06:28,722 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000005
2015-02-12 12:06:28,723 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 12:06:28,723 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 12:06:28,723 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0005
2015-02-12 12:06:28,723 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0005
2015-02-12 12:06:28,723 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:06:28,723 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0005
2015-02-12 12:06:28,724 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:06:28,724 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:06:28,724 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0005
2015-02-12 12:06:28,724 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0005
2015-02-12 12:06:28,724 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:06:28,722 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0005_01_000002 to application application_1423771478362_0005
2015-02-12 12:06:28,724 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0005
2015-02-12 12:06:28,725 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0005_01_000005
2015-02-12 12:06:28,725 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 12:06:28,725 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0005
2015-02-12 12:06:28,725 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0005
2015-02-12 12:06:28,725 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:06:28,726 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0005
2015-02-12 12:06:28,726 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0005_01_000004
2015-02-12 12:06:28,726 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:06:28,734 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:06:28,740 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0005_01_000003 by user soberoi
2015-02-12 12:06:28,740 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000003
2015-02-12 12:06:28,740 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0005_01_000003 to application application_1423771478362_0005
2015-02-12 12:06:28,741 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 12:06:28,741 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0005
2015-02-12 12:06:28,741 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0005
2015-02-12 12:06:28,741 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:06:28,741 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0005
2015-02-12 12:06:28,742 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423771478362_0005_01_000004.tokens. Credentials list: 
2015-02-12 12:06:28,742 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:06:28,742 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423771478362_0005_01_000005.tokens. Credentials list: 
2015-02-12 12:06:28,782 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 12:06:28,782 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:28,795 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 12:06:28,795 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:28,864 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:06:28,864 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:06:28,903 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:06:28,930 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:06:28,930 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:06:28,942 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000002/default_container_executor.sh]
2015-02-12 12:06:28,958 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000003/default_container_executor.sh]
2015-02-12 12:06:29,079 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:06:29,086 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423771478362_0005_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000004.tokens
2015-02-12 12:06:29,087 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0005
2015-02-12 12:06:29,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423771478362_0005_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000005.tokens
2015-02-12 12:06:29,227 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0005
2015-02-12 12:06:29,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:29,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:06:29,301 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0005/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:06:29,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:29,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:06:29,401 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0005/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:06:29,401 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:06:29,402 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:06:29,458 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 12:06:29,459 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:29,460 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 12:06:29,460 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:29,533 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:06:29,624 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000005/default_container_executor.sh]
2015-02-12 12:06:29,624 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000004/default_container_executor.sh]
2015-02-12 12:06:34,408 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054
2015-02-12 12:06:35,097 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054
2015-02-12 12:06:36,346 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741878_1054
2015-02-12 12:06:39,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:39,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:39,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:39,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:06:40,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:06:40,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:06:40,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:06:40,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:06:40,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:06:40,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:06:40,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:06:40,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:06:41,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:41,080 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:06:41,082 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0005_01_000003
2015-02-12 12:06:41,083 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000003
2015-02-12 12:06:41,083 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000003 transitioned from RUNNING to KILLING
2015-02-12 12:06:41,083 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0005_01_000003
2015-02-12 12:06:41,101 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1.jhist. BP-1120419527-10.1.1.68-1423771456695 blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:06:41,102 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0005_01_000003 is : 143
2015-02-12 12:06:41,103 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741879_1055 src: /127.0.0.1:56471 dest: /127.0.0.1:55522
2015-02-12 12:06:41,107 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741879_1055 src: /127.0.0.1:56472 dest: /127.0.0.1:55529
2015-02-12 12:06:41,108 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741879_1055 src: /127.0.0.1:56473 dest: /127.0.0.1:55526
2015-02-12 12:06:41,115 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4450)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1.jhist for DFSClient_NONMAPREDUCE_374648955_1
2015-02-12 12:06:41,118 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:06:41,118 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000003
2015-02-12 12:06:41,119 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000003
2015-02-12 12:06:41,119 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:06:41,119 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0005_01_000003 from application application_1423771478362_0005
2015-02-12 12:06:41,119 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:41,119 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0005
2015-02-12 12:06:41,119 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000003
2015-02-12 12:06:41,119 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000003
2015-02-12 12:06:41,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000003
2015-02-12 12:06:41,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:41,152 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:06:41,154 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0005_01_000002
2015-02-12 12:06:41,154 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000002
2015-02-12 12:06:41,154 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000002 transitioned from RUNNING to KILLING
2015-02-12 12:06:41,154 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0005_01_000002
2015-02-12 12:06:41,155 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:06:41,155 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0005_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 12:06:41,155 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000003
2015-02-12 12:06:41,155 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 12:06:41,155 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-02-12 12:06:41,159 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0005_01_000003, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 cluster=<memory:16384, vCores:32>
2015-02-12 12:06:41,159 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:41,159 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:06:41,160 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0005_000001 released container container_1423771478362_0005_01_000003 on node: host: 10.1.1.68:55669 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 12:06:41,173 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0005_01_000002 is : 143
2015-02-12 12:06:41,192 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:06:41,194 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000002
2015-02-12 12:06:41,194 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000002
2015-02-12 12:06:41,195 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000002
2015-02-12 12:06:41,196 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000002
2015-02-12 12:06:41,197 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000002
2015-02-12 12:06:41,197 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:06:41,197 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0005_01_000002 from application application_1423771478362_0005
2015-02-12 12:06:41,197 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:41,197 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0005
2015-02-12 12:06:41,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:41,436 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:06:41,438 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0005_01_000004
2015-02-12 12:06:41,438 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000004
2015-02-12 12:06:41,439 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000004 transitioned from RUNNING to KILLING
2015-02-12 12:06:41,439 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0005_01_000004
2015-02-12 12:06:41,457 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0005_01_000004 is : 143
2015-02-12 12:06:41,467 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:06:41,468 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000004
2015-02-12 12:06:41,468 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000004
2015-02-12 12:06:41,469 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000004
2015-02-12 12:06:41,469 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000004
2015-02-12 12:06:41,469 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000004
2015-02-12 12:06:41,469 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:06:41,470 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0005_01_000004 from application application_1423771478362_0005
2015-02-12 12:06:41,470 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:41,470 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0005
2015-02-12 12:06:41,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:06:41,810 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:06:41,811 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0005_01_000005
2015-02-12 12:06:41,811 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000005
2015-02-12 12:06:41,811 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000005 transitioned from RUNNING to KILLING
2015-02-12 12:06:41,811 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0005_01_000005
2015-02-12 12:06:41,815 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:06:41,816 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0005_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 12:06:41,816 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000004
2015-02-12 12:06:41,816 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0005_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 12:06:41,816 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-02-12 12:06:41,816 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0005_01_000004, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 cluster=<memory:16384, vCores:32>
2015-02-12 12:06:41,817 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:41,817 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:06:41,817 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0005_000001 released container container_1423771478362_0005_01_000004 on node: host: 10.1.1.68:55664 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 12:06:41,831 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0005_01_000005 is : 143
2015-02-12 12:06:41,843 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:06:41,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000005
2015-02-12 12:06:41,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000005
2015-02-12 12:06:41,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000005
2015-02-12 12:06:41,845 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000005
2015-02-12 12:06:41,845 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000005
2015-02-12 12:06:41,845 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:06:41,845 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0005_01_000005 from application application_1423771478362_0005
2015-02-12 12:06:41,846 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:41,846 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0005
2015-02-12 12:06:42,158 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:06:42,159 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0005_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 12:06:42,159 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000002
2015-02-12 12:06:42,159 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 12:06:42,159 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-02-12 12:06:42,159 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0005_01_000002, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 cluster=<memory:16384, vCores:32>
2015-02-12 12:06:42,159 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:42,159 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:06:42,160 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0005_000001 released container container_1423771478362_0005_01_000002 on node: host: 10.1.1.68:55669 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 12:06:42,160 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:42,823 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:42,823 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:06:42,824 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0005_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 12:06:42,824 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000005
2015-02-12 12:06:42,824 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0005_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:06:42,824 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:06:42,824 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0005_01_000005, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:06:42,825 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:42,825 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:06:42,825 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0005_000001 released container container_1423771478362_0005_01_000005 on node: host: 10.1.1.68:55664 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:06:42,826 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:06:42,826 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000006
2015-02-12 12:06:42,826 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0005_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:06:42,826 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0005_000001 container=Container: [ContainerId: container_1423771478362_0005_01_000006, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 10, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:06:42,827 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:06:42,827 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:06:43,166 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0005_01_000003]
2015-02-12 12:06:43,167 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:43,167 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:43,646 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:06:43,658 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:06:43,661 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0005_01_000006 by user soberoi
2015-02-12 12:06:43,662 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000006
2015-02-12 12:06:43,662 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0005_01_000006 to application application_1423771478362_0005
2015-02-12 12:06:43,662 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 12:06:43,662 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0005
2015-02-12 12:06:43,662 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0005
2015-02-12 12:06:43,663 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:06:43,663 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0005
2015-02-12 12:06:43,663 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:06:43,730 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 12:06:43,731 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:06:43,829 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0005_01_000004]
2015-02-12 12:06:43,829 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:06:43,829 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:43,829 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:43,914 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000006/default_container_executor.sh]
2015-02-12 12:06:44,169 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0005_01_000002]
2015-02-12 12:06:44,169 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:44,653 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:06:44,831 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0005_01_000005]
2015-02-12 12:06:44,831 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:06:48,153 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30003 milliseconds
2015-02-12 12:06:48,153 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(201)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 12:07:01,385 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:01,388 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:01,406 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:01,408 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:02,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:03,152 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_0/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:07:03,444 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741880_1056 src: /127.0.0.1:56598 dest: /127.0.0.1:55522
2015-02-12 12:07:03,445 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741880_1056 src: /127.0.0.1:56601 dest: /127.0.0.1:55529
2015-02-12 12:07:03,447 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741880_1056 src: /127.0.0.1:56602 dest: /127.0.0.1:55526
2015-02-12 12:07:03,555 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56602, dest: /127.0.0.1:55526, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_0_1582703731_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741880_1056, duration: 107167000
2015-02-12 12:07:03,556 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741880_1056, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:03,556 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:03,556 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56601, dest: /127.0.0.1:55529, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_0_1582703731_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741880_1056, duration: 107950000
2015-02-12 12:07:03,557 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:03,559 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56598, dest: /127.0.0.1:55522, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_0_1582703731_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741880_1056, duration: 109152000
2015-02-12 12:07:03,559 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:03,559 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:03,559 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:03,593 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_0/part-00000 is closed by DFSClient_attempt_1423771478362_0005_r_000000_0_1582703731_1
2015-02-12 12:07:03,607 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741880_1056 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55526 
2015-02-12 12:07:03,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:07:03,618 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:07:03,620 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0005_01_000006
2015-02-12 12:07:03,620 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000006
2015-02-12 12:07:03,620 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000006 transitioned from RUNNING to KILLING
2015-02-12 12:07:03,620 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0005_01_000006
2015-02-12 12:07:03,639 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0005_01_000006 is : 143
2015-02-12 12:07:03,649 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:07:03,650 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000006
2015-02-12 12:07:03,650 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000006
2015-02-12 12:07:03,650 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000006
2015-02-12 12:07:03,651 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000006
2015-02-12 12:07:03,651 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000006
2015-02-12 12:07:03,652 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:07:03,652 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0005_01_000006 from application application_1423771478362_0005
2015-02-12 12:07:03,653 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:03,653 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0005
2015-02-12 12:07:04,634 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:07:04,634 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0005_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 12:07:04,634 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000006
2015-02-12 12:07:04,635 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0005_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:07:04,635 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:07:04,636 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0005_01_000006, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:07:04,636 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:04,637 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:07:04,637 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0005_000001 released container container_1423771478362_0005_01_000006 on node: host: 10.1.1.68:55664 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:07:05,258 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:07:05,258 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000007
2015-02-12 12:07:05,258 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0005_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 12:07:05,258 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0005_000001 container=Container: [ContainerId: container_1423771478362_0005_01_000007, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 10, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:07:05,258 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:07:05,259 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:05,641 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:05,812 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:07:05,820 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:07:05,823 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0005_01_000007 by user soberoi
2015-02-12 12:07:05,823 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000007
2015-02-12 12:07:05,823 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0005_01_000007 to application application_1423771478362_0005
2015-02-12 12:07:05,824 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 12:07:05,824 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0005
2015-02-12 12:07:05,824 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0005
2015-02-12 12:07:05,824 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:07:05,824 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0005
2015-02-12 12:07:05,824 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:07:05,865 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 12:07:05,865 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:05,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000007/default_container_executor.sh]
2015-02-12 12:07:06,264 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:07:06,383 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741880_1056]
2015-02-12 12:07:06,384 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741880_1056]
2015-02-12 12:07:06,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0005_01_000006]
2015-02-12 12:07:06,647 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:06,817 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:07:07,073 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741880 for deletion
2015-02-12 12:07:07,073 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741880
2015-02-12 12:07:07,387 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741880 for deletion
2015-02-12 12:07:07,387 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741880
2015-02-12 12:07:09,387 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55529 to delete [blk_1073741880_1056]
2015-02-12 12:07:09,537 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:09,538 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:09,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_1/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:09,899 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_1/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:07:09,977 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741881_1057 src: /127.0.0.1:56645 dest: /127.0.0.1:55526
2015-02-12 12:07:09,979 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741881_1057 src: /127.0.0.1:56646 dest: /127.0.0.1:55519
2015-02-12 12:07:09,982 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741881_1057 src: /127.0.0.1:56647 dest: /127.0.0.1:55522
2015-02-12 12:07:10,021 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56647, dest: /127.0.0.1:55522, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_1_964742220_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741881_1057, duration: 37626000
2015-02-12 12:07:10,021 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741881_1057, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:10,022 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:07:10,022 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56646, dest: /127.0.0.1:55519, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_1_964742220_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741881_1057, duration: 38493000
2015-02-12 12:07:10,022 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:10,022 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:10,023 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56645, dest: /127.0.0.1:55526, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_1_964742220_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741881_1057, duration: 39390000
2015-02-12 12:07:10,023 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:10,023 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:10,027 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_1/part-00000 is closed by DFSClient_attempt_1423771478362_0005_r_000000_1_964742220_1
2015-02-12 12:07:10,037 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741881_1057 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:07:10,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_1	dst=null	perm=null	proto=rpc
2015-02-12 12:07:10,046 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:07:10,048 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0005_01_000007
2015-02-12 12:07:10,048 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000007
2015-02-12 12:07:10,048 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000007 transitioned from RUNNING to KILLING
2015-02-12 12:07:10,048 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0005_01_000007
2015-02-12 12:07:10,069 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0005_01_000007 is : 143
2015-02-12 12:07:10,076 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:07:10,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000007
2015-02-12 12:07:10,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000007
2015-02-12 12:07:10,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000007
2015-02-12 12:07:10,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000007
2015-02-12 12:07:10,077 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000007
2015-02-12 12:07:10,078 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:07:10,078 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0005_01_000007 from application application_1423771478362_0005
2015-02-12 12:07:10,078 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:10,078 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0005
2015-02-12 12:07:11,053 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:07:11,054 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0005_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 12:07:11,054 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000007
2015-02-12 12:07:11,054 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0005_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 12:07:11,054 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:07:11,055 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0005_01_000007, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:07:11,055 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:11,055 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:07:11,055 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0005_000001 released container container_1423771478362_0005_01_000007 on node: host: 10.1.1.68:55669 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 12:07:11,381 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741880_1056
2015-02-12 12:07:11,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741880 for deletion
2015-02-12 12:07:11,788 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741880
2015-02-12 12:07:12,060 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:12,061 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:07:12,061 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000008
2015-02-12 12:07:12,061 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0005_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 12:07:12,062 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0005_000001 container=Container: [ContainerId: container_1423771478362_0005_01_000008, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 10, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:07:12,062 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:07:12,062 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:12,395 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55519 to delete [blk_1073741881_1057]
2015-02-12 12:07:12,395 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741881_1057]
2015-02-12 12:07:12,879 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:07:12,885 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:07:12,887 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0005_01_000008 by user soberoi
2015-02-12 12:07:12,887 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000008
2015-02-12 12:07:12,887 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0005_01_000008 to application application_1423771478362_0005
2015-02-12 12:07:12,888 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 12:07:12,888 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0005
2015-02-12 12:07:12,888 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0005
2015-02-12 12:07:12,888 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:07:12,889 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0005
2015-02-12 12:07:12,889 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:07:12,918 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 12:07:12,918 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:12,995 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000008/default_container_executor.sh]
2015-02-12 12:07:13,066 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0005_01_000007]
2015-02-12 12:07:13,066 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:07:13,066 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:13,080 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741881 for deletion
2015-02-12 12:07:13,080 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741881
2015-02-12 12:07:13,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741881 for deletion
2015-02-12 12:07:13,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741881
2015-02-12 12:07:13,891 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:07:15,399 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741881_1057]
2015-02-12 12:07:15,601 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:15,604 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:15,615 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:15,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_2/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:15,906 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_2/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:07:15,984 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741882_1058 src: /127.0.0.1:56655 dest: /127.0.0.1:55529
2015-02-12 12:07:15,985 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741882_1058 src: /127.0.0.1:56656 dest: /127.0.0.1:55519
2015-02-12 12:07:15,987 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741882_1058 src: /127.0.0.1:56657 dest: /127.0.0.1:55522
2015-02-12 12:07:16,042 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56657, dest: /127.0.0.1:55522, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_2_396081577_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741882_1058, duration: 54005000
2015-02-12 12:07:16,043 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741882_1058, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:16,044 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56656, dest: /127.0.0.1:55519, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_2_396081577_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741882_1058, duration: 55234000
2015-02-12 12:07:16,044 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:07:16,044 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:16,045 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56655, dest: /127.0.0.1:55529, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_2_396081577_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741882_1058, duration: 56439000
2015-02-12 12:07:16,045 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:16,045 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:16,046 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:16,050 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_2/part-00000 is closed by DFSClient_attempt_1423771478362_0005_r_000000_2_396081577_1
2015-02-12 12:07:16,062 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741882_1058 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:07:16,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_2	dst=null	perm=null	proto=rpc
2015-02-12 12:07:16,073 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:07:16,075 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0005_01_000008
2015-02-12 12:07:16,075 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000008
2015-02-12 12:07:16,075 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000008 transitioned from RUNNING to KILLING
2015-02-12 12:07:16,075 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0005_01_000008
2015-02-12 12:07:16,088 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741881 for deletion
2015-02-12 12:07:16,089 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741881
2015-02-12 12:07:16,097 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0005_01_000008 is : 143
2015-02-12 12:07:16,107 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:07:16,108 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000008
2015-02-12 12:07:16,108 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000008
2015-02-12 12:07:16,109 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000008
2015-02-12 12:07:16,109 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000008
2015-02-12 12:07:16,109 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000008
2015-02-12 12:07:16,110 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:07:16,110 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0005_01_000008 from application application_1423771478362_0005
2015-02-12 12:07:16,111 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:16,111 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0005
2015-02-12 12:07:17,078 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:07:17,079 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0005_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 12:07:17,079 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000008
2015-02-12 12:07:17,079 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0005_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 12:07:17,079 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:07:17,080 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0005_01_000008, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:07:17,081 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:17,081 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:07:17,081 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0005_000001 released container container_1423771478362_0005_01_000008 on node: host: 10.1.1.68:55669 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 12:07:18,081 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:18,082 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:07:18,082 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000009
2015-02-12 12:07:18,082 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0005_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 12:07:18,083 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0005_000001 container=Container: [ContainerId: container_1423771478362_0005_01_000009, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 10, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:07:18,083 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:07:18,083 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:18,163 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30010 milliseconds
2015-02-12 12:07:18,163 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(201)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 12:07:18,407 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741882_1058]
2015-02-12 12:07:18,407 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55519 to delete [blk_1073741882_1058]
2015-02-12 12:07:18,923 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:07:18,930 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:07:18,932 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0005_01_000009 by user soberoi
2015-02-12 12:07:18,933 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000009
2015-02-12 12:07:18,933 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0005_01_000009 to application application_1423771478362_0005
2015-02-12 12:07:18,933 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000009 transitioned from NEW to LOCALIZING
2015-02-12 12:07:18,934 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0005
2015-02-12 12:07:18,934 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0005
2015-02-12 12:07:18,934 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:07:18,934 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0005
2015-02-12 12:07:18,935 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:07:18,963 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000009 transitioned from LOCALIZED to RUNNING
2015-02-12 12:07:18,963 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:19,041 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000009/default_container_executor.sh]
2015-02-12 12:07:19,085 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0005_01_000008]
2015-02-12 12:07:19,085 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:07:19,085 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:19,086 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741882 for deletion
2015-02-12 12:07:19,087 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741882
2015-02-12 12:07:19,098 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741882 for deletion
2015-02-12 12:07:19,099 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741882
2015-02-12 12:07:19,935 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:07:21,399 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741882_1058
2015-02-12 12:07:21,410 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55529 to delete [blk_1073741882_1058]
2015-02-12 12:07:22,239 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:22,240 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:22,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_3/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:22,633 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_3/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:07:22,732 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741883_1059 src: /127.0.0.1:56666 dest: /127.0.0.1:55522
2015-02-12 12:07:22,733 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741883_1059 src: /127.0.0.1:56667 dest: /127.0.0.1:55519
2015-02-12 12:07:22,735 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741883_1059 src: /127.0.0.1:56668 dest: /127.0.0.1:55526
2015-02-12 12:07:22,781 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56668, dest: /127.0.0.1:55526, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_3_1566201192_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741883_1059, duration: 44442000
2015-02-12 12:07:22,781 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741883_1059, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:22,781 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:07:22,781 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56667, dest: /127.0.0.1:55519, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_3_1566201192_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741883_1059, duration: 44981000
2015-02-12 12:07:22,782 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:22,782 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:07:22,782 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56666, dest: /127.0.0.1:55522, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0005_r_000000_3_1566201192_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741883_1059, duration: 45913000
2015-02-12 12:07:22,783 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:22,783 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:07:22,786 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_3/part-00000 is closed by DFSClient_attempt_1423771478362_0005_r_000000_3_1566201192_1
2015-02-12 12:07:22,797 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741883_1059 127.0.0.1:55522 127.0.0.1:55519 127.0.0.1:55526 
2015-02-12 12:07:22,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0005_r_000000_3	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,812 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:07:22,814 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0005_01_000009
2015-02-12 12:07:22,814 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000009
2015-02-12 12:07:22,814 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000009 transitioned from RUNNING to KILLING
2015-02-12 12:07:22,814 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0005_01_000009
2015-02-12 12:07:22,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,833 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0005_01_000009 is : 143
2015-02-12 12:07:22,833 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56473, dest: /127.0.0.1:55526, bytes: 60395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741879_1055, duration: 41723197000
2015-02-12 12:07:22,834 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741879_1055, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:22,835 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 15672
2015-02-12 12:07:22,835 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56472, dest: /127.0.0.1:55529, bytes: 60395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741879_1055, duration: 41724506000
2015-02-12 12:07:22,835 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:22,836 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 15672
2015-02-12 12:07:22,836 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56471, dest: /127.0.0.1:55522, bytes: 60395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741879_1055, duration: 41724495000
2015-02-12 12:07:22,837 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:22,837 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 15672
2015-02-12 12:07:22,838 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1.jhist is closed by DFSClient_NONMAPREDUCE_374648955_1
2015-02-12 12:07:22,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:22,844 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005.summary_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:07:22,845 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:07:22,846 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000009
2015-02-12 12:07:22,846 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000009
2015-02-12 12:07:22,846 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741884_1060 src: /127.0.0.1:56670 dest: /127.0.0.1:55519
2015-02-12 12:07:22,846 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000009
2015-02-12 12:07:22,846 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000009
2015-02-12 12:07:22,846 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000009
2015-02-12 12:07:22,847 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:07:22,847 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0005_01_000009 from application application_1423771478362_0005
2015-02-12 12:07:22,847 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:22,847 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0005
2015-02-12 12:07:22,848 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741884_1060 src: /127.0.0.1:56671 dest: /127.0.0.1:55526
2015-02-12 12:07:22,849 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741884_1060 src: /127.0.0.1:56672 dest: /127.0.0.1:55529
2015-02-12 12:07:22,854 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56672, dest: /127.0.0.1:55529, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741884_1060, duration: 3068000
2015-02-12 12:07:22,854 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741884_1060, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:22,855 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:07:22,855 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56671, dest: /127.0.0.1:55526, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741884_1060, duration: 2760000
2015-02-12 12:07:22,855 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:22,856 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:22,856 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56670, dest: /127.0.0.1:55519, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741884_1060, duration: 4142000
2015-02-12 12:07:22,856 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:22,857 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:22,857 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005.summary_tmp is closed by DFSClient_NONMAPREDUCE_374648955_1
2015-02-12 12:07:22,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:22,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:22,888 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:07:22,891 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061 src: /127.0.0.1:56674 dest: /127.0.0.1:55519
2015-02-12 12:07:22,892 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061 src: /127.0.0.1:56675 dest: /127.0.0.1:55529
2015-02-12 12:07:22,894 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061 src: /127.0.0.1:56676 dest: /127.0.0.1:55526
2015-02-12 12:07:22,897 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56676, dest: /127.0.0.1:55526, bytes: 60395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061, duration: 2149000
2015-02-12 12:07:22,898 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:22,898 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:22,898 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56675, dest: /127.0.0.1:55529, bytes: 60395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061, duration: 2580000
2015-02-12 12:07:22,899 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:22,899 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:07:22,899 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56674, dest: /127.0.0.1:55519, bytes: 60395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061, duration: 3647000
2015-02-12 12:07:22,900 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:22,900 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:22,901 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist_tmp is closed by DFSClient_NONMAPREDUCE_374648955_1
2015-02-12 12:07:22,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:22,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005/job_1423771478362_0005_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:22,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:22,917 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005_conf.xml_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:07:22,920 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062 src: /127.0.0.1:56678 dest: /127.0.0.1:55529
2015-02-12 12:07:22,921 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062 src: /127.0.0.1:56679 dest: /127.0.0.1:55526
2015-02-12 12:07:22,923 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062 src: /127.0.0.1:56680 dest: /127.0.0.1:55519
2015-02-12 12:07:22,926 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56680, dest: /127.0.0.1:55519, bytes: 115914, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062, duration: 1882000
2015-02-12 12:07:22,927 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:22,927 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:22,928 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56679, dest: /127.0.0.1:55526, bytes: 115914, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062, duration: 2575000
2015-02-12 12:07:22,928 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:22,929 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56678, dest: /127.0.0.1:55529, bytes: 115914, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_374648955_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062, duration: 3710000
2015-02-12 12:07:22,929 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:22,929 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:22,930 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:07:22,931 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_374648955_1
2015-02-12 12:07:22,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:22,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:22,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:22,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:22,950 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1129)) - Updating application attempt appattempt_1423771478362_0005_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 12:07:22,951 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0005_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 12:07:22,951 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(992)) - Updating application application_1423771478362_0005 with final state: FINISHING
2015-02-12 12:07:22,951 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0005 State change from RUNNING to FINAL_SAVING
2015-02-12 12:07:22,951 INFO  recovery.RMStateStore (RMStateStore.java:transition(161)) - Updating info for app: application_1423771478362_0005
2015-02-12 12:07:22,952 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0005_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 12:07:22,953 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0005 State change from FINAL_SAVING to FINISHING
2015-02-12 12:07:23,802 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741882 for deletion
2015-02-12 12:07:23,803 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741882
2015-02-12 12:07:23,823 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:07:23,823 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0005_01_000009 in state: COMPLETED event:FINISHED
2015-02-12 12:07:23,824 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000009
2015-02-12 12:07:23,824 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0005_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55669, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 12:07:23,824 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:07:23,825 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0005_01_000009, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:07:23,825 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:23,825 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:07:23,825 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0005_000001 released container container_1423771478362_0005_01_000009 on node: host: 10.1.1.68:55669 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 12:07:23,961 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(351)) - application_1423771478362_0005 unregistered successfully. 
2015-02-12 12:07:23,964 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741874_1050 127.0.0.1:55522 127.0.0.1:55526 127.0.0.1:55529 127.0.0.1:55519 
2015-02-12 12:07:23,965 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741875_1051 127.0.0.1:55522 127.0.0.1:55526 127.0.0.1:55529 127.0.0.1:55519 
2015-02-12 12:07:23,965 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741876_1052 127.0.0.1:55526 127.0.0.1:55522 127.0.0.1:55529 
2015-02-12 12:07:23,965 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741877_1053 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55519 
2015-02-12 12:07:23,965 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741879_1055 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55526 
2015-02-12 12:07:23,965 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741878_1054 127.0.0.1:55522 127.0.0.1:55526 127.0.0.1:55529 
2015-02-12 12:07:23,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0005	dst=null	perm=null	proto=rpc
2015-02-12 12:07:23,977 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] hadoop job job_1423771478362_0005 state at FAILED
2015-02-12 12:07:23,978 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] failure info: Task failed task_1423771478362_0005_r_000000
Job failed as tasks failed. failedMaps:0 failedReduces:1

2015-02-12 12:07:24,002 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] task completion events identify failed tasks
2015-02-12 12:07:24,002 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] task completion events count: 8
2015-02-12 12:07:24,003 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] event = Task Id : attempt_1423771478362_0005_m_000001_0, Status : SUCCEEDED
2015-02-12 12:07:24,003 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] event = Task Id : attempt_1423771478362_0005_m_000000_0, Status : SUCCEEDED
2015-02-12 12:07:24,003 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] event = Task Id : attempt_1423771478362_0005_m_000002_0, Status : SUCCEEDED
2015-02-12 12:07:24,003 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] event = Task Id : attempt_1423771478362_0005_m_000003_0, Status : SUCCEEDED
2015-02-12 12:07:24,004 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] event = Task Id : attempt_1423771478362_0005_r_000000_0, Status : FAILED
2015-02-12 12:07:24,004 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] event = Task Id : attempt_1423771478362_0005_r_000000_1, Status : FAILED
2015-02-12 12:07:24,004 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] event = Task Id : attempt_1423771478362_0005_r_000000_2, Status : FAILED
2015-02-12 12:07:24,004 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [restartable] event = Task Id : attempt_1423771478362_0005_r_000000_3, Status : TIPFAILED
2015-02-12 12:07:24,032 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable] stopping all jobs
2015-02-12 12:07:24,032 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] stopping: (2/2) ...latform/restartcheckpoint
2015-02-12 12:07:24,034 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] stopping: (1/2)
2015-02-12 12:07:24,414 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741874_1050, blk_1073741875_1051, blk_1073741876_1052, blk_1073741878_1054, blk_1073741879_1055, blk_1073741883_1059]
2015-02-12 12:07:24,414 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741874_1050, blk_1073741875_1051, blk_1073741876_1052, blk_1073741877_1053, blk_1073741878_1054, blk_1073741879_1055, blk_1073741883_1059]
2015-02-12 12:07:24,824 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:25,045 INFO  ipc.Client (Client.java:handleConnectionFailure(858)) - Retrying connect to server: 10.1.1.68/10.1.1.68:56180. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 12:07:25,107 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741874 for deletion
2015-02-12 12:07:25,107 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741875 for deletion
2015-02-12 12:07:25,108 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741876 for deletion
2015-02-12 12:07:25,108 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741874
2015-02-12 12:07:25,108 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741877 for deletion
2015-02-12 12:07:25,108 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741875
2015-02-12 12:07:25,108 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741878 for deletion
2015-02-12 12:07:25,108 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741877
2015-02-12 12:07:25,108 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741876
2015-02-12 12:07:25,108 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741879 for deletion
2015-02-12 12:07:25,109 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741883 for deletion
2015-02-12 12:07:25,109 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741878
2015-02-12 12:07:25,109 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741879
2015-02-12 12:07:25,109 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741883
2015-02-12 12:07:25,424 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741874 for deletion
2015-02-12 12:07:25,424 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741875 for deletion
2015-02-12 12:07:25,424 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741876 for deletion
2015-02-12 12:07:25,424 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741878 for deletion
2015-02-12 12:07:25,424 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741879 for deletion
2015-02-12 12:07:25,424 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741883 for deletion
2015-02-12 12:07:25,424 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741874
2015-02-12 12:07:25,425 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741875
2015-02-12 12:07:25,425 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741876
2015-02-12 12:07:25,425 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741878
2015-02-12 12:07:25,425 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741879
2015-02-12 12:07:25,425 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741883
2015-02-12 12:07:25,825 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:26,049 INFO  ipc.Client (Client.java:handleConnectionFailure(858)) - Retrying connect to server: 10.1.1.68/10.1.1.68:56180. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 12:07:26,827 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:27,052 INFO  ipc.Client (Client.java:handleConnectionFailure(858)) - Retrying connect to server: 10.1.1.68/10.1.1.68:56180. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 12:07:27,160 INFO  mapred.ClientServiceDelegate (ClientServiceDelegate.java:getProxy(276)) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2015-02-12 12:07:27,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003.summary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001.summary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002.summary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,184 INFO  hs.CompletedJob (CompletedJob.java:<init>(95)) - Loading job: job_1423771478362_0004 from file: hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist
2015-02-12 12:07:27,184 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423771478362_0002,submitTime=1423771517342,launchTime=1423771523495,firstMapTaskLaunchTime=1423771525739,firstReduceTaskLaunchTime=1423771537658,finishTime=1423771541748,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=39,reduceSlotSeconds=4,jobName=[61F0DA785F0A4444B72F9543DFADE737/BEB9C920C0D345D0A883280334546F25] test/(2/3)
2015-02-12 12:07:27,185 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002.summary]
2015-02-12 12:07:27,184 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423771478362_0003,submitTime=1423771543098,launchTime=1423771547194,firstMapTaskLaunchTime=1423771549372,firstReduceTaskLaunchTime=0,finishTime=1423771552810,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=1,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=3,reduceSlotSeconds=0,jobName=[61F0DA785F0A4444B72F9543DFADE737/498986D99FB64F2E8C2D23EA0D051509] test/(3/3) ...ntplatform/manycheckpoint
2015-02-12 12:07:27,184 INFO  hs.CompletedJob (CompletedJob.java:loadFullHistoryData(326)) - Loading history file: [hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist]
2015-02-12 12:07:27,184 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423771478362_0001,submitTime=1423771486772,launchTime=1423771495137,firstMapTaskLaunchTime=1423771497372,firstReduceTaskLaunchTime=0,finishTime=1423771515793,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=4,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=72,reduceSlotSeconds=0,jobName=[61F0DA785F0A4444B72F9543DFADE737/1C5E90869A64474CAD91176B49D5DA9C] test/(1/3)
2015-02-12 12:07:27,186 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001.summary]
2015-02-12 12:07:27,186 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(691)) - Number of transactions: 514 Total time for transactions(ms): 64 Number of transactions batched in Syncs: 0 Number of syncs: 337 SyncTimes(ms): 16 5 
2015-02-12 12:07:27,187 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741848_1024 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:07:27,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002.summary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,185 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003.summary]
2015-02-12 12:07:27,188 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741838_1014 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55526 
2015-02-12 12:07:27,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001.summary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,189 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741858_1034 127.0.0.1:55522 127.0.0.1:55519 127.0.0.1:55529 
2015-02-12 12:07:27,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003.summary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,195 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist to hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist
2015-02-12 12:07:27,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,196 INFO  hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(969)) - Perms after creating 504, Expected: 504
2015-02-12 12:07:27,196 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist to hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist
2015-02-12 12:07:27,197 INFO  hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(969)) - Perms after creating 504, Expected: 504
2015-02-12 12:07:27,197 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist to hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist
2015-02-12 12:07:27,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0002-1423771517342-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2FBEB9C920C0D345D0-1423771541748-4-1-SUCCEEDED-default-1423771523495.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0001-1423771486772-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F1C5E90869A64474C-1423771515793-4-0-SUCCEEDED-default-1423771495137.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0003-1423771543098-soberoi-%5B61F0DA785F0A4444B72F9543DFADE737%2F498986D99FB64F2E-1423771552810-1-0-SUCCEEDED-default-1423771547194.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,201 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002_conf.xml to hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0002_conf.xml
2015-02-12 12:07:27,201 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001_conf.xml to hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0001_conf.xml
2015-02-12 12:07:27,201 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003_conf.xml to hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0003_conf.xml
2015-02-12 12:07:27,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0002_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0002_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0003_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0003_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0001_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0001_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005.summary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,209 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423771478362_0005,submitTime=1423771574501,launchTime=1423771586486,firstMapTaskLaunchTime=1423771588735,firstReduceTaskLaunchTime=1423771603663,finishTime=1423771642819,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=FAILED,mapSlotSeconds=50,reduceSlotSeconds=31,jobName=[59EA8DCD6DD84327B1BA141AF8F3D13B/7DBD734BFCDD4EC6B03CBAB10AD7B157] restartable/(2/2) ...latform/restartcheckpoint
2015-02-12 12:07:27,209 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005.summary]
2015-02-12 12:07:27,210 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741884_1060 127.0.0.1:55519 127.0.0.1:55526 127.0.0.1:55529 
2015-02-12 12:07:27,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005.summary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,213 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist to hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist
2015-02-12 12:07:27,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0005-1423771574501-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F7DBD734BFCDD4EC6-1423771642819-4-0-FAILED-default-1423771586486.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,215 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005_conf.xml to hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0005_conf.xml
2015-02-12 12:07:27,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0005_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0005_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,415 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741858_1034, blk_1073741848_1024]
2015-02-12 12:07:27,415 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741848_1024, blk_1073741884_1060, blk_1073741838_1014]
2015-02-12 12:07:27,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004.summary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,439 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423771478362_0004,submitTime=1423771554277,launchTime=1423771559356,firstMapTaskLaunchTime=1423771561581,firstReduceTaskLaunchTime=0,finishTime=1423771572855,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=4,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=44,reduceSlotSeconds=0,jobName=[59EA8DCD6DD84327B1BA141AF8F3D13B/0C02DB5BB0AA4AB39FE7637997A872C3] restartable/(1/2)
2015-02-12 12:07:27,439 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004.summary]
2015-02-12 12:07:27,440 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741871_1047 127.0.0.1:55526 127.0.0.1:55522 127.0.0.1:55519 
2015-02-12 12:07:27,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004.summary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,443 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist to hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist
2015-02-12 12:07:27,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0004-1423771554277-soberoi-%5B59EA8DCD6DD84327B1BA141AF8F3D13B%2F0C02DB5BB0AA4AB3-1423771572855-4-0-SUCCEEDED-default-1423771559356.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,446 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004_conf.xml to hdfs://localhost:55518/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0004_conf.xml
2015-02-12 12:07:27,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0004_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423771478362_0004_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:27,452 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable] stopped all jobs
2015-02-12 12:07:27,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,453 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /tmp/hadoop-soberoi/restartable/restartable/test/_temporary
2015-02-12 12:07:27,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,456 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary
2015-02-12 12:07:27,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,473 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 12:07:27,473 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 12:07:27,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,494 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable] starting
2015-02-12 12:07:27,495 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-02-12 12:07:27,495 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint"]
2015-02-12 12:07:27,495 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable]  parallel execution is enabled: true
2015-02-12 12:07:27,495 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable]  starting jobs: 2
2015-02-12 12:07:27,495 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [restartable]  allocating threads: 2
2015-02-12 12:07:27,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,497 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] at least one sink is marked for delete
2015-02-12 12:07:27,497 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-02-12 12:07:27,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,500 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] source modification date at: Thu Feb 12 12:06:12 PST 2015
2015-02-12 12:07:27,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,501 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] sink oldest modified date: Thu Feb 12 12:06:12 PST 2015
2015-02-12 12:07:27,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,503 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] source modification date at: Thu Feb 12 12:04:44 PST 2015
2015-02-12 12:07:27,504 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] skipping step: (1/2)
2015-02-12 12:07:27,504 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] starting step: (2/2) ...latform/restartcheckpoint
2015-02-12 12:07:27,514 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:07:27,525 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:07:27,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,529 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(286)) - Allocated new applicationId: 6
2015-02-12 12:07:27,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 12:07:27,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 12:07:27,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:27,537 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:07:27,538 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063 src: /127.0.0.1:56715 dest: /127.0.0.1:55526
2015-02-12 12:07:27,539 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063 src: /127.0.0.1:56716 dest: /127.0.0.1:55522
2015-02-12 12:07:27,541 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063 src: /127.0.0.1:56717 dest: /127.0.0.1:55519
2015-02-12 12:07:27,545 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56717, dest: /127.0.0.1:55519, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063, duration: 3101000
2015-02-12 12:07:27,546 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:27,546 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:27,546 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56716, dest: /127.0.0.1:55522, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063, duration: 2667000
2015-02-12 12:07:27,546 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:27,547 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:07:27,547 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56715, dest: /127.0.0.1:55526, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063, duration: 4641000
2015-02-12 12:07:27,547 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:27,548 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:27,549 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:07:27,550 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar
2015-02-12 12:07:27,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:27,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,574 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 4
2015-02-12 12:07:27,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:27,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:27,578 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split
2015-02-12 12:07:27,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,579 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split. BP-1120419527-10.1.1.68-1423771456695 blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:07:27,581 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064 src: /127.0.0.1:56718 dest: /127.0.0.1:55522
2015-02-12 12:07:27,582 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064 src: /127.0.0.1:56719 dest: /127.0.0.1:55526
2015-02-12 12:07:27,583 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064 src: /127.0.0.1:56720 dest: /127.0.0.1:55529
2015-02-12 12:07:27,584 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064 src: /127.0.0.1:56721 dest: /127.0.0.1:55519
2015-02-12 12:07:27,588 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56721, dest: /127.0.0.1:55519, bytes: 1303, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064, duration: 3158000
2015-02-12 12:07:27,590 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:27,590 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:27,590 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56720, dest: /127.0.0.1:55529, bytes: 1303, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064, duration: 4589000
2015-02-12 12:07:27,591 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:27,591 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:27,592 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56719, dest: /127.0.0.1:55526, bytes: 1303, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064, duration: 6026000
2015-02-12 12:07:27,592 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:27,592 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:27,592 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56718, dest: /127.0.0.1:55522, bytes: 1303, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064, duration: 6665000
2015-02-12 12:07:27,593 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:27,594 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:27,595 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:07:27,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:27,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:27,599 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo. BP-1120419527-10.1.1.68-1423771456695 blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:07:27,600 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065 src: /127.0.0.1:56722 dest: /127.0.0.1:55526
2015-02-12 12:07:27,602 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065 src: /127.0.0.1:56723 dest: /127.0.0.1:55529
2015-02-12 12:07:27,603 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065 src: /127.0.0.1:56724 dest: /127.0.0.1:55522
2015-02-12 12:07:27,606 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56724, dest: /127.0.0.1:55522, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065, duration: 1156000
2015-02-12 12:07:27,606 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:27,607 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:07:27,607 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56723, dest: /127.0.0.1:55529, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065, duration: 1594000
2015-02-12 12:07:27,607 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:27,608 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:07:27,608 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56722, dest: /127.0.0.1:55526, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065, duration: 2683000
2015-02-12 12:07:27,608 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:27,609 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:07:27,610 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:07:27,610 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:4
2015-02-12 12:07:27,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:27,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:27,622 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:07:27,624 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066 src: /127.0.0.1:56725 dest: /127.0.0.1:55529
2015-02-12 12:07:27,625 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066 src: /127.0.0.1:56726 dest: /127.0.0.1:55526
2015-02-12 12:07:27,626 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066 src: /127.0.0.1:56727 dest: /127.0.0.1:55519
2015-02-12 12:07:27,630 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56727, dest: /127.0.0.1:55519, bytes: 98847, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066, duration: 1847000
2015-02-12 12:07:27,630 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:27,631 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56726, dest: /127.0.0.1:55526, bytes: 98847, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066, duration: 2028000
2015-02-12 12:07:27,631 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:07:27,631 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:27,631 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:07:27,632 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56725, dest: /127.0.0.1:55529, bytes: 98847, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066, duration: 3264000
2015-02-12 12:07:27,632 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:27,634 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:07:27,635 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:07:27,635 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_1423771478362_0006
2015-02-12 12:07:27,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,650 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,651 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(577)) - Application with id 6 submitted by user soberoi
2015-02-12 12:07:27,651 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(973)) - Storing application with id application_1423771478362_0006
2015-02-12 12:07:27,651 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	IP=10.1.1.68	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423771478362_0006
2015-02-12 12:07:27,652 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423771478362_0006
2015-02-12 12:07:27,652 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0006 State change from NEW to NEW_SAVING
2015-02-12 12:07:27,652 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0006 State change from NEW_SAVING to SUBMITTED
2015-02-12 12:07:27,652 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(386)) - Application added - appId: application_1423771478362_0006 user: soberoi leaf-queue of parent: root #applications: 2
2015-02-12 12:07:27,652 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(716)) - Accepted application application_1423771478362_0006 from user: soberoi, in queue: default
2015-02-12 12:07:27,653 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0006 State change from SUBMITTED to ACCEPTED
2015-02-12 12:07:27,653 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(251)) - Submitted application application_1423771478362_0006
2015-02-12 12:07:27,653 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(670)) - Registering app attempt : appattempt_1423771478362_0006_000001
2015-02-12 12:07:27,653 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0006_000001 State change from NEW to SUBMITTED
2015-02-12 12:07:27,653 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(626)) - Application application_1423771478362_0006 from user: soberoi activated in queue: default
2015-02-12 12:07:27,653 INFO  capacity.LeafQueue (LeafQueue.java:addApplicationAttempt(643)) - Application added - appId: application_1423771478362_0006 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@35816f1c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-02-12 12:07:27,654 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplicationAttempt(746)) - Added Application Attempt appattempt_1423771478362_0006_000001 to scheduler from user soberoi in queue default
2015-02-12 12:07:27,655 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0006_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 12:07:27,656 INFO  mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://Edinburgh.local:55663/proxy/application_1423771478362_0006/
2015-02-12 12:07:27,656 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] submitted hadoop job: job_1423771478362_0006
2015-02-12 12:07:27,656 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [restartable] tracking url: http://Edinburgh.local:55663/proxy/application_1423771478362_0006/
2015-02-12 12:07:27,732 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:07:27,732 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000001
2015-02-12 12:07:27,732 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0006_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55664, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 12:07:27,733 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0006_000001 container=Container: [ContainerId: container_1423771478362_0006_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:07:27,733 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-02-12 12:07:27,733 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:27,734 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55664 for container : container_1423771478362_0006_01_000001
2015-02-12 12:07:27,735 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:07:27,735 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423771478362_0006_000001
2015-02-12 12:07:27,735 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1837)) - Storing attempt: AppId: application_1423771478362_0006 AttemptId: appattempt_1423771478362_0006_000001 MasterContainer: Container: [ContainerId: container_1423771478362_0006_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ]
2015-02-12 12:07:27,735 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0006_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 12:07:27,736 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0006_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 12:07:27,737 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423771478362_0006_000001
2015-02-12 12:07:27,738 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423771478362_0006_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] for AM appattempt_1423771478362_0006_000001
2015-02-12 12:07:27,738 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423771478362_0006_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 12:07:27,739 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423771478362_0006_000001
2015-02-12 12:07:27,739 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423771478362_0006_000001
2015-02-12 12:07:27,741 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:27,744 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0006_01_000001 by user soberoi
2015-02-12 12:07:27,744 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0006
2015-02-12 12:07:27,744 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000001
2015-02-12 12:07:27,744 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from NEW to INITING
2015-02-12 12:07:27,745 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0006_01_000001 to application application_1423771478362_0006
2015-02-12 12:07:27,745 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from INITING to RUNNING
2015-02-12 12:07:27,745 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423771478362_0006_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] for AM appattempt_1423771478362_0006_000001
2015-02-12 12:07:27,745 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0006_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 12:07:27,745 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 12:07:27,745 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0006
2015-02-12 12:07:27,746 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:07:27,746 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 12:07:27,746 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split transitioned from INIT to DOWNLOADING
2015-02-12 12:07:27,746 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:07:27,746 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0006_01_000001
2015-02-12 12:07:27,755 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423771478362_0006_01_000001.tokens. Credentials list: 
2015-02-12 12:07:27,829 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:27,854 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:07:27,922 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423771478362_0006_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000001.tokens
2015-02-12 12:07:27,923 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:07:27,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:27,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:28,021 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0006/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:28,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:28,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:28,064 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0006/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:28,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:28,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:28,108 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0006/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:28,112 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741858 for deletion
2015-02-12 12:07:28,112 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741848 for deletion
2015-02-12 12:07:28,112 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741858
2015-02-12 12:07:28,112 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741848
2015-02-12 12:07:28,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:28,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:28,153 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0006/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:28,153 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:07:28,181 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 12:07:28,182 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:28,259 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000001/default_container_executor.sh]
2015-02-12 12:07:28,427 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741848 for deletion
2015-02-12 12:07:28,427 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741884 for deletion
2015-02-12 12:07:28,427 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741838 for deletion
2015-02-12 12:07:28,427 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741848
2015-02-12 12:07:28,428 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741884
2015-02-12 12:07:28,428 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741838
2015-02-12 12:07:28,735 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:07:28,834 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:29,114 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(346)) - Container container_1423771478362_0005_01_000001 succeeded 
2015-02-12 12:07:29,115 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 12:07:29,115 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0005_01_000001
2015-02-12 12:07:29,140 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000001
2015-02-12 12:07:29,140 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000001
2015-02-12 12:07:29,141 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000001
2015-02-12 12:07:29,141 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0005/container_1423771478362_0005_01_000001
2015-02-12 12:07:29,141 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000001
2015-02-12 12:07:29,141 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0005_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 12:07:29,141 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0005_01_000001 from application application_1423771478362_0005
2015-02-12 12:07:29,141 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:29,142 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0005
2015-02-12 12:07:29,465 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741883_1059
2015-02-12 12:07:29,466 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741884_1060
2015-02-12 12:07:29,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062
2015-02-12 12:07:29,468 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061
2015-02-12 12:07:29,837 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0005_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:07:29,837 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(676)) - Unregistering app attempt : appattempt_1423771478362_0005_000001
2015-02-12 12:07:29,838 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423771478362_0005_000001
2015-02-12 12:07:29,838 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0005_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 12:07:29,838 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0005_000001 State change from FINISHING to FINISHED
2015-02-12 12:07:29,838 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000001
2015-02-12 12:07:29,838 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0005 State change from FINISHING to FINISHED
2015-02-12 12:07:29,838 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55669, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:07:29,838 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:07:29,838 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423771478362_0005
2015-02-12 12:07:29,839 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423771478362_0005_000001
2015-02-12 12:07:29,839 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0005_01_000001, NodeId: 10.1.1.68:55669, NodeHttpAddress: 10.1.1.68:55672, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55669 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:07:29,839 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:29,839 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-02-12 12:07:29,839 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0005_000001 released container container_1423771478362_0005_01_000001 on node: host: 10.1.1.68:55669 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:07:29,839 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:29,839 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(179)) - appId=application_1423771478362_0005,name=[59EA8DCD6DD84327B1BA141AF8F3D13B/7DBD734BFCDD4EC6B03CBAB10AD7B157] restartable/(2/2) ...latform/restartcheckpoint,user=soberoi,queue=default,state=FINISHED,trackingUrl=http://Edinburgh.local:55663/proxy/application_1423771478362_0005/jobhistory/job/job_1423771478362_0005,appMasterHost=10.1.1.68,startTime=1423771574501,finishTime=1423771642951,finalStatus=FAILED
2015-02-12 12:07:29,839 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplicationAttempt(785)) - Application Attempt appattempt_1423771478362_0005_000001 is done. finalState=FINISHED
2015-02-12 12:07:29,840 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423771478362_0005 requests cleared
2015-02-12 12:07:29,840 INFO  capacity.LeafQueue (LeafQueue.java:removeApplicationAttempt(686)) - Application removed - appId: application_1423771478362_0005 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-02-12 12:07:29,840 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(411)) - Application removed - appId: application_1423771478362_0005 user: soberoi leaf-queue of parent: root #applications: 1
2015-02-12 12:07:29,842 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0005_000001 (auth:SIMPLE)
2015-02-12 12:07:29,844 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0005_01_000001
2015-02-12 12:07:29,844 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0005	CONTAINERID=container_1423771478362_0005_01_000001
2015-02-12 12:07:29,845 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0005_01_000001]
2015-02-12 12:07:29,845 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:29,845 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:07:29,845 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:29,845 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423771478362_0005
2015-02-12 12:07:29,846 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423771478362_0005
2015-02-12 12:07:29,846 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0005
2015-02-12 12:07:29,846 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:07:29,846 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0005, with delay of 10800 seconds
2015-02-12 12:07:29,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423771478362_0005
2015-02-12 12:07:29,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423771478362_0005
2015-02-12 12:07:30,153 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061
2015-02-12 12:07:30,154 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062
2015-02-12 12:07:30,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:07:30,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 12:07:30,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 12:07:30,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 12:07:30,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006	dst=null	perm=null	proto=rpc
2015-02-12 12:07:30,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:07:30,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:07:30,421 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1492)) - BLOCK* ask 127.0.0.1:55519 to replicate blk_1073741887_1063 to datanode(s) 127.0.0.1:55529
2015-02-12 12:07:30,421 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55519 to delete [blk_1073741858_1034, blk_1073741874_1050, blk_1073741875_1051, blk_1073741877_1053, blk_1073741848_1024, blk_1073741883_1059, blk_1073741884_1060, blk_1073741838_1014, blk_1073741871_1047]
2015-02-12 12:07:30,421 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741871_1047]
2015-02-12 12:07:30,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:30,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:30,739 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:07:30,740 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0005
2015-02-12 12:07:30,740 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0005
2015-02-12 12:07:30,740 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0005
2015-02-12 12:07:30,740 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0005
2015-02-12 12:07:30,741 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0005
2015-02-12 12:07:30,741 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:07:30,741 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0005, with delay of 10800 seconds
2015-02-12 12:07:30,847 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:31,100 INFO  datanode.DataNode (DataNode.java:transferBlock(1812)) - DatanodeRegistration(127.0.0.1, datanodeUuid=7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, infoPort=55520, ipcPort=55521, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) Starting thread to transfer BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063 to 127.0.0.1:55529 
2015-02-12 12:07:31,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741874 for deletion
2015-02-12 12:07:31,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741858 for deletion
2015-02-12 12:07:31,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741875 for deletion
2015-02-12 12:07:31,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741877 for deletion
2015-02-12 12:07:31,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741874
2015-02-12 12:07:31,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741848 for deletion
2015-02-12 12:07:31,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741883 for deletion
2015-02-12 12:07:31,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741875
2015-02-12 12:07:31,102 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741884 for deletion
2015-02-12 12:07:31,102 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741858
2015-02-12 12:07:31,102 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741877
2015-02-12 12:07:31,102 INFO  datanode.DataNode (DataNode.java:run(2020)) - DataTransfer: Transmitted BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063 (numBytes=254067) to /127.0.0.1:55529
2015-02-12 12:07:31,102 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741838 for deletion
2015-02-12 12:07:31,102 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741848
2015-02-12 12:07:31,102 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063 src: /127.0.0.1:56736 dest: /127.0.0.1:55529
2015-02-12 12:07:31,102 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741884
2015-02-12 12:07:31,103 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741883
2015-02-12 12:07:31,102 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741871 for deletion
2015-02-12 12:07:31,103 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741838
2015-02-12 12:07:31,103 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741871
2015-02-12 12:07:31,104 INFO  datanode.DataNode (DataXceiver.java:writeBlock(755)) - Received BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063 src: /127.0.0.1:56736 dest: /127.0.0.1:55529 of size 254067
2015-02-12 12:07:31,105 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741887_1063 size 254067
2015-02-12 12:07:31,414 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741886_1062
2015-02-12 12:07:31,415 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741879_1055
2015-02-12 12:07:31,415 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741885_1061
2015-02-12 12:07:31,416 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741884_1060
2015-02-12 12:07:31,431 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741871 for deletion
2015-02-12 12:07:31,431 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741871
2015-02-12 12:07:31,578 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:31,580 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(274)) - AM registration appattempt_1423771478362_0006_000001
2015-02-12 12:07:31,580 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(127)) - USER=soberoi	IP=10.1.1.68	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423771478362_0006	APPATTEMPTID=appattempt_1423771478362_0006_000001
2015-02-12 12:07:31,580 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0006_000001 State change from LAUNCHED to RUNNING
2015-02-12 12:07:31,580 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0006 State change from ACCEPTED to RUNNING
2015-02-12 12:07:31,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:31,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:07:31,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:31,931 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1_conf.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:07:31,982 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067 src: /127.0.0.1:56741 dest: /127.0.0.1:55526
2015-02-12 12:07:31,983 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067 src: /127.0.0.1:56743 dest: /127.0.0.1:55519
2015-02-12 12:07:31,985 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067 src: /127.0.0.1:56744 dest: /127.0.0.1:55522
2015-02-12 12:07:32,017 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56744, dest: /127.0.0.1:55522, bytes: 115922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067, duration: 29361000
2015-02-12 12:07:32,018 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:32,018 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:07:32,018 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56743, dest: /127.0.0.1:55519, bytes: 115922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067, duration: 30892000
2015-02-12 12:07:32,019 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:32,020 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56741, dest: /127.0.0.1:55526, bytes: 115922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067, duration: 32188000
2015-02-12 12:07:32,020 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:32,020 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:32,021 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:32,025 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1_conf.xml is closed by DFSClient_NONMAPREDUCE_298577711_1
2015-02-12 12:07:32,637 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:07:32,637 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000002
2015-02-12 12:07:32,637 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0006_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:07:32,638 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0006_000001 container=Container: [ContainerId: container_1423771478362_0006_01_000002, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:07:32,638 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:07:32,638 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:32,638 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:07:32,638 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000003
2015-02-12 12:07:32,639 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 12:07:32,639 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0006_000001 container=Container: [ContainerId: container_1423771478362_0006_01_000003, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:07:32,639 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:07:32,639 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:32,639 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:07:32,639 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000004
2015-02-12 12:07:32,640 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 12:07:32,640 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0006_000001 container=Container: [ContainerId: container_1423771478362_0006_01_000004, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:07:32,640 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:07:32,640 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:32,640 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:07:32,640 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000005
2015-02-12 12:07:32,641 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 12:07:32,641 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0006_000001 container=Container: [ContainerId: container_1423771478362_0006_01_000005, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:07:32,641 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-02-12 12:07:32,641 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:33,424 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55529 to delete [blk_1073741858_1034, blk_1073741874_1050, blk_1073741875_1051, blk_1073741876_1052, blk_1073741877_1053, blk_1073741878_1054, blk_1073741879_1055, blk_1073741884_1060, blk_1073741838_1014]
2015-02-12 12:07:33,424 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741871_1047]
2015-02-12 12:07:33,628 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55677 for container : container_1423771478362_0006_01_000002
2015-02-12 12:07:33,629 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:07:33,630 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:07:33,631 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:07:33,632 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:07:33,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,774 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:33,775 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:33,776 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:33,777 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:33,780 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0006_01_000005 by user soberoi
2015-02-12 12:07:33,780 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0006
2015-02-12 12:07:33,781 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0006_01_000004 by user soberoi
2015-02-12 12:07:33,781 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000005
2015-02-12 12:07:33,781 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from NEW to INITING
2015-02-12 12:07:33,782 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0006_01_000005 to application application_1423771478362_0006
2015-02-12 12:07:33,782 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0006_01_000004 to application application_1423771478362_0006
2015-02-12 12:07:33,781 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0006_01_000003 by user soberoi
2015-02-12 12:07:33,783 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from INITING to RUNNING
2015-02-12 12:07:33,783 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000003
2015-02-12 12:07:33,781 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0006_01_000002 by user soberoi
2015-02-12 12:07:33,783 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 12:07:33,786 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 12:07:33,786 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0006_01_000003 to application application_1423771478362_0006
2015-02-12 12:07:33,785 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000002
2015-02-12 12:07:33,781 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000004
2015-02-12 12:07:33,786 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0006
2015-02-12 12:07:33,788 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0006
2015-02-12 12:07:33,788 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:07:33,788 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0006
2015-02-12 12:07:33,789 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:07:33,789 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:07:33,789 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:07:33,790 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:07:33,790 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0006_01_000002 to application application_1423771478362_0006
2015-02-12 12:07:33,790 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0006
2015-02-12 12:07:33,790 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0006
2015-02-12 12:07:33,790 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:07:33,790 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0006
2015-02-12 12:07:33,791 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 12:07:33,791 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0006_01_000005
2015-02-12 12:07:33,791 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar, 1423771462433, FILE, null }
2015-02-12 12:07:33,793 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423771462045, FILE, null }
2015-02-12 12:07:33,794 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 12:07:33,795 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0006_01_000004
2015-02-12 12:07:33,795 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar, 1423771462433, FILE, null }
2015-02-12 12:07:33,795 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423771462045, FILE, null }
2015-02-12 12:07:33,795 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0006
2015-02-12 12:07:33,795 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0006
2015-02-12 12:07:33,795 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:07:33,795 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0006
2015-02-12 12:07:33,796 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0006
2015-02-12 12:07:33,796 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0006
2015-02-12 12:07:33,796 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:07:33,796 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0006
2015-02-12 12:07:33,796 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0006_01_000003
2015-02-12 12:07:33,797 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar, 1423771462433, FILE, null }
2015-02-12 12:07:33,797 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423771462045, FILE, null }
2015-02-12 12:07:33,797 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0006_01_000002
2015-02-12 12:07:33,800 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar, 1423771462433, FILE, null }
2015-02-12 12:07:33,800 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423771462045, FILE, null }
2015-02-12 12:07:33,820 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423771478362_0006_01_000005.tokens. Credentials list: 
2015-02-12 12:07:33,825 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423771478362_0006_01_000004.tokens. Credentials list: 
2015-02-12 12:07:33,828 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423771478362_0006_01_000002.tokens. Credentials list: 
2015-02-12 12:07:33,829 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423771478362_0006_01_000003.tokens. Credentials list: 
2015-02-12 12:07:33,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:33,907 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/filecache/10/hadoop-9144650672645034592.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:33,909 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:34,043 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:07:34,116 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741871 for deletion
2015-02-12 12:07:34,116 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741871
2015-02-12 12:07:34,159 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423771478362_0006_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000003.tokens
2015-02-12 12:07:34,160 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:07:34,166 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:07:34,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:34,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:34,300 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:07:34,309 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423771478362_0006_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000002.tokens
2015-02-12 12:07:34,310 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:07:34,335 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:07:34,357 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:34,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:34,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:34,445 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0006/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:34,445 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:07:34,445 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:07:34,446 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:07:34,446 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:07:34,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065
2015-02-12 12:07:34,469 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063
2015-02-12 12:07:34,470 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064
2015-02-12 12:07:34,472 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066
2015-02-12 12:07:34,474 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063
2015-02-12 12:07:34,474 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064
2015-02-12 12:07:34,498 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423771478362_0006_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000004.tokens
2015-02-12 12:07:34,500 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:07:34,510 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 12:07:34,510 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:34,519 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 12:07:34,519 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:34,531 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 12:07:34,531 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:34,532 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 12:07:34,532 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:34,542 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423771478362_0006_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000005.tokens
2015-02-12 12:07:34,542 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:07:34,642 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:07:34,642 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:07:34,642 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:07:34,642 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:07:34,643 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:07:34,734 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000002/default_container_executor.sh]
2015-02-12 12:07:34,736 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000004/default_container_executor.sh]
2015-02-12 12:07:34,741 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000003/default_container_executor.sh]
2015-02-12 12:07:34,749 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000005/default_container_executor.sh]
2015-02-12 12:07:35,362 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063
2015-02-12 12:07:35,363 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066
2015-02-12 12:07:35,364 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064
2015-02-12 12:07:35,364 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065
2015-02-12 12:07:35,810 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741874 for deletion
2015-02-12 12:07:35,810 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741858 for deletion
2015-02-12 12:07:35,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741875 for deletion
2015-02-12 12:07:35,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741876 for deletion
2015-02-12 12:07:35,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741877 for deletion
2015-02-12 12:07:35,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741874
2015-02-12 12:07:35,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741876
2015-02-12 12:07:35,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741878 for deletion
2015-02-12 12:07:35,812 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741879 for deletion
2015-02-12 12:07:35,812 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741884 for deletion
2015-02-12 12:07:35,812 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741838 for deletion
2015-02-12 12:07:35,812 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741878
2015-02-12 12:07:35,812 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741884
2015-02-12 12:07:35,812 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741838
2015-02-12 12:07:35,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741858
2015-02-12 12:07:35,813 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741875
2015-02-12 12:07:35,813 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741877
2015-02-12 12:07:35,814 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741879
2015-02-12 12:07:36,423 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741889_1065
2015-02-12 12:07:36,423 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741888_1064
2015-02-12 12:07:36,424 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741890_1066
2015-02-12 12:07:36,630 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741887_1063
2015-02-12 12:07:36,876 INFO  hs.JobHistory (JobHistory.java:run(188)) - Starting scan to move intermediate done files
2015-02-12 12:07:36,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:07:36,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:07:39,477 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067
2015-02-12 12:07:39,478 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067
2015-02-12 12:07:40,372 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741891_1067
2015-02-12 12:07:43,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:43,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:43,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:43,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:44,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:07:44,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:07:44,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:07:44,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:07:44,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:44,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:44,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:07:44,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/restartable/restartable/test/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:07:44,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0006_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:07:44,898 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:44,900 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0006_01_000002
2015-02-12 12:07:44,900 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000002
2015-02-12 12:07:44,901 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000002 transitioned from RUNNING to KILLING
2015-02-12 12:07:44,901 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0006_01_000002
2015-02-12 12:07:44,929 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0006_01_000002 is : 143
2015-02-12 12:07:44,945 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:07:44,945 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000002
2015-02-12 12:07:44,945 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000002
2015-02-12 12:07:44,946 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1.jhist. BP-1120419527-10.1.1.68-1423771456695 blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:07:44,946 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000002
2015-02-12 12:07:44,946 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:07:44,946 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000002
2015-02-12 12:07:44,947 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000002
2015-02-12 12:07:44,949 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0006_01_000002 from application application_1423771478362_0006
2015-02-12 12:07:44,960 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:44,960 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0006
2015-02-12 12:07:44,980 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741892_1068 src: /127.0.0.1:56816 dest: /127.0.0.1:55519
2015-02-12 12:07:44,982 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741892_1068 src: /127.0.0.1:56817 dest: /127.0.0.1:55522
2015-02-12 12:07:44,984 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741892_1068 src: /127.0.0.1:56818 dest: /127.0.0.1:55526
2015-02-12 12:07:45,005 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4450)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1.jhist for DFSClient_NONMAPREDUCE_298577711_1
2015-02-12 12:07:45,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0006_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:07:45,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0006_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:07:45,230 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:45,233 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0006_01_000005
2015-02-12 12:07:45,233 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000005
2015-02-12 12:07:45,234 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:07:45,234 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0006_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 12:07:45,234 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000002
2015-02-12 12:07:45,235 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0006_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 12:07:45,235 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-02-12 12:07:45,235 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000005 transitioned from RUNNING to KILLING
2015-02-12 12:07:45,238 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0006_01_000002, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 cluster=<memory:16384, vCores:32>
2015-02-12 12:07:45,240 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:45,240 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:07:45,240 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0006_000001 released container container_1423771478362_0006_01_000002 on node: host: 10.1.1.68:55677 #containers=3 available=1024 used=3072 with event: FINISHED
2015-02-12 12:07:45,240 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0006_01_000005
2015-02-12 12:07:45,241 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:45,243 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0006_01_000004
2015-02-12 12:07:45,244 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000004
2015-02-12 12:07:45,245 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:45,262 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0006_01_000005 is : 143
2015-02-12 12:07:45,278 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000004 transitioned from RUNNING to KILLING
2015-02-12 12:07:45,278 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:07:45,279 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0006_01_000004
2015-02-12 12:07:45,302 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0006_01_000004 is : 143
2015-02-12 12:07:45,344 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000005
2015-02-12 12:07:45,347 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000005
2015-02-12 12:07:45,348 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000005
2015-02-12 12:07:45,349 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000005
2015-02-12 12:07:45,350 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:07:45,351 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000005
2015-02-12 12:07:45,352 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:07:45,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000004
2015-02-12 12:07:45,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000004
2015-02-12 12:07:45,354 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000004
2015-02-12 12:07:45,354 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000004
2015-02-12 12:07:45,354 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0006_01_000005 from application application_1423771478362_0006
2015-02-12 12:07:45,355 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:45,355 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0006
2015-02-12 12:07:45,355 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000004
2015-02-12 12:07:45,355 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:07:45,356 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0006_01_000004 from application application_1423771478362_0006
2015-02-12 12:07:45,356 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:45,357 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0006
2015-02-12 12:07:45,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0006_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:07:45,433 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:45,435 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0006_01_000003
2015-02-12 12:07:45,435 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000003
2015-02-12 12:07:45,436 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000003 transitioned from RUNNING to KILLING
2015-02-12 12:07:45,437 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:45,437 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:07:45,437 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0006_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 12:07:45,437 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000004
2015-02-12 12:07:45,437 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 12:07:45,437 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-02-12 12:07:45,440 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0006_01_000003
2015-02-12 12:07:45,440 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0006_01_000004, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 cluster=<memory:16384, vCores:32>
2015-02-12 12:07:45,440 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:45,440 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:07:45,441 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0006_000001 released container container_1423771478362_0006_01_000004 on node: host: 10.1.1.68:55677 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 12:07:45,441 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:07:45,441 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0006_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 12:07:45,441 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000005
2015-02-12 12:07:45,441 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 12:07:45,441 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-02-12 12:07:45,442 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0006_01_000005, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 cluster=<memory:16384, vCores:32>
2015-02-12 12:07:45,442 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:45,442 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:07:45,443 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0006_000001 released container container_1423771478362_0006_01_000005 on node: host: 10.1.1.68:55677 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 12:07:45,466 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0006_01_000003 is : 143
2015-02-12 12:07:45,531 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:07:45,543 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000003
2015-02-12 12:07:45,551 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000003
2015-02-12 12:07:45,555 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000003
2015-02-12 12:07:45,568 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000003
2015-02-12 12:07:45,570 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000003
2015-02-12 12:07:45,572 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:07:45,575 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0006_01_000003 from application application_1423771478362_0006
2015-02-12 12:07:45,581 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:45,595 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0006
2015-02-12 12:07:46,438 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:46,439 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:07:46,439 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0006_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 12:07:46,439 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000003
2015-02-12 12:07:46,439 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:07:46,439 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:07:46,440 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0006_01_000003, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:07:46,440 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:46,440 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:07:46,441 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0006_000001 released container container_1423771478362_0006_01_000003 on node: host: 10.1.1.68:55677 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:07:46,441 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:46,441 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:46,791 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:07:46,791 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000006
2015-02-12 12:07:46,792 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:07:46,792 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0006_000001 container=Container: [ContainerId: container_1423771478362_0006_01_000006, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 10, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:07:46,792 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:07:46,792 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:47,441 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0006_01_000005, container_1423771478362_0006_01_000004, container_1423771478362_0006_01_000002]
2015-02-12 12:07:47,442 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:47,442 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:47,442 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:47,442 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:47,712 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55673 for container : container_1423771478362_0006_01_000006
2015-02-12 12:07:47,713 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:07:47,726 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:47,729 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0006_01_000006 by user soberoi
2015-02-12 12:07:47,730 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0006
2015-02-12 12:07:47,730 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000006
2015-02-12 12:07:47,730 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from NEW to INITING
2015-02-12 12:07:47,730 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0006_01_000006 to application application_1423771478362_0006
2015-02-12 12:07:47,731 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from INITING to RUNNING
2015-02-12 12:07:47,731 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 12:07:47,731 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0006
2015-02-12 12:07:47,731 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0006
2015-02-12 12:07:47,731 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:07:47,731 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0006
2015-02-12 12:07:47,731 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:07:47,732 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:07:47,732 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0006_01_000006
2015-02-12 12:07:47,752 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423771478362_0006_01_000006.tokens. Credentials list: 
2015-02-12 12:07:47,792 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:07:47,968 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:07:48,123 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423771478362_0006_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000006.tokens
2015-02-12 12:07:48,124 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:07:48,172 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30009 milliseconds
2015-02-12 12:07:48,173 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(201)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 12:07:48,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:48,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:48,338 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0006/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:48,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:48,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:48,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0006_01_000003]
2015-02-12 12:07:48,445 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:48,448 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0006/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:48,448 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:07:48,505 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 12:07:48,505 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:48,688 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000006/default_container_executor.sh]
2015-02-12 12:07:48,719 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:07:54,094 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:54,107 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:07:54,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0006_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:54,396 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0006_r_000000_0/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:07:54,483 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069 src: /127.0.0.1:56875 dest: /127.0.0.1:55526
2015-02-12 12:07:54,484 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069 src: /127.0.0.1:56876 dest: /127.0.0.1:55529
2015-02-12 12:07:54,486 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069 src: /127.0.0.1:56877 dest: /127.0.0.1:55522
2015-02-12 12:07:54,524 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56877, dest: /127.0.0.1:55522, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0006_r_000000_0_-1050277031_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069, duration: 36786000
2015-02-12 12:07:54,525 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:54,525 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56876, dest: /127.0.0.1:55529, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0006_r_000000_0_-1050277031_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069, duration: 37802000
2015-02-12 12:07:54,526 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:54,526 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:07:54,527 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56875, dest: /127.0.0.1:55526, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0006_r_000000_0_-1050277031_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069, duration: 39483000
2015-02-12 12:07:54,527 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:54,528 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:07:54,529 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:07:54,539 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0006_r_000000_0/part-00000 is closed by DFSClient_attempt_1423771478362_0006_r_000000_0_-1050277031_1
2015-02-12 12:07:54,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0006_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0006_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/task_1423771478362_0006_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/_temporary/attempt_1423771478362_0006_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/task_1423771478362_0006_r_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:07:54,584 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:07:54,586 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0006_01_000006
2015-02-12 12:07:54,586 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000006
2015-02-12 12:07:54,586 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000006 transitioned from RUNNING to KILLING
2015-02-12 12:07:54,587 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0006_01_000006
2015-02-12 12:07:54,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:54,596 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_298577711_1
2015-02-12 12:07:54,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,607 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0006_01_000006 is : 143
2015-02-12 12:07:54,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/task_1423771478362_0006_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary/1/task_1423771478362_0006_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:54,620 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:07:54,624 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000006
2015-02-12 12:07:54,624 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:07:54,624 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0006_01_000006 from application application_1423771478362_0006
2015-02-12 12:07:54,624 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000006
2015-02-12 12:07:54,625 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000006
2015-02-12 12:07:54,624 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:54,626 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0006
2015-02-12 12:07:54,626 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000006
2015-02-12 12:07:54,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,625 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000006
2015-02-12 12:07:54,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:54,634 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_SUCCESS is closed by DFSClient_NONMAPREDUCE_298577711_1
2015-02-12 12:07:54,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:54,637 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_298577711_1
2015-02-12 12:07:54,655 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56818, dest: /127.0.0.1:55526, bytes: 61221, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741892_1068, duration: 9668556000
2015-02-12 12:07:54,656 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741892_1068, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:54,656 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 15672
2015-02-12 12:07:54,657 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56817, dest: /127.0.0.1:55522, bytes: 61221, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741892_1068, duration: 9669923000
2015-02-12 12:07:54,657 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:54,657 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 15672
2015-02-12 12:07:54,658 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56816, dest: /127.0.0.1:55519, bytes: 61221, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741892_1068, duration: 9672106000
2015-02-12 12:07:54,659 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:54,659 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 15672
2015-02-12 12:07:54,660 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1.jhist is closed by DFSClient_NONMAPREDUCE_298577711_1
2015-02-12 12:07:54,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:54,665 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006.summary_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:07:54,667 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070 src: /127.0.0.1:56879 dest: /127.0.0.1:55522
2015-02-12 12:07:54,669 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070 src: /127.0.0.1:56880 dest: /127.0.0.1:55526
2015-02-12 12:07:54,671 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070 src: /127.0.0.1:56881 dest: /127.0.0.1:55529
2015-02-12 12:07:54,677 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56881, dest: /127.0.0.1:55529, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070, duration: 3094000
2015-02-12 12:07:54,677 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:54,678 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:07:54,678 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56880, dest: /127.0.0.1:55526, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070, duration: 3957000
2015-02-12 12:07:54,678 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:54,679 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56879, dest: /127.0.0.1:55522, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070, duration: 5095000
2015-02-12 12:07:54,679 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:54,680 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:07:54,681 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:07:54,683 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006.summary_tmp is closed by DFSClient_NONMAPREDUCE_298577711_1
2015-02-12 12:07:54,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:54,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006-1423771647651-soberoi-%5BE440EB5527C54899BDF78BD31232947E%2FECEC1677CE06478A-1423771674638-4-1-SUCCEEDED-default-1423771651615.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006-1423771647651-soberoi-%5BE440EB5527C54899BDF78BD31232947E%2FECEC1677CE06478A-1423771674638-4-1-SUCCEEDED-default-1423771651615.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006-1423771647651-soberoi-%5BE440EB5527C54899BDF78BD31232947E%2FECEC1677CE06478A-1423771674638-4-1-SUCCEEDED-default-1423771651615.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:54,710 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006-1423771647651-soberoi-%5BE440EB5527C54899BDF78BD31232947E%2FECEC1677CE06478A-1423771674638-4-1-SUCCEEDED-default-1423771651615.jhist_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:07:54,713 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071 src: /127.0.0.1:56883 dest: /127.0.0.1:55526
2015-02-12 12:07:54,715 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071 src: /127.0.0.1:56884 dest: /127.0.0.1:55519
2015-02-12 12:07:54,717 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071 src: /127.0.0.1:56885 dest: /127.0.0.1:55529
2015-02-12 12:07:54,723 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56885, dest: /127.0.0.1:55529, bytes: 61221, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071, duration: 2228000
2015-02-12 12:07:54,723 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:54,723 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:07:54,724 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56884, dest: /127.0.0.1:55519, bytes: 61221, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071, duration: 2943000
2015-02-12 12:07:54,724 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:54,725 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56883, dest: /127.0.0.1:55526, bytes: 61221, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071, duration: 4033000
2015-02-12 12:07:54,725 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:54,725 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:54,726 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:54,727 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006-1423771647651-soberoi-%5BE440EB5527C54899BDF78BD31232947E%2FECEC1677CE06478A-1423771674638-4-1-SUCCEEDED-default-1423771651615.jhist_tmp is closed by DFSClient_NONMAPREDUCE_298577711_1
2015-02-12 12:07:54,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006-1423771647651-soberoi-%5BE440EB5527C54899BDF78BD31232947E%2FECEC1677CE06478A-1423771674638-4-1-SUCCEEDED-default-1423771651615.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:54,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006/job_1423771478362_0006_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:54,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:07:54,746 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006_conf.xml_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:07:54,749 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072 src: /127.0.0.1:56887 dest: /127.0.0.1:55529
2015-02-12 12:07:54,751 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072 src: /127.0.0.1:56888 dest: /127.0.0.1:55522
2015-02-12 12:07:54,754 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072 src: /127.0.0.1:56889 dest: /127.0.0.1:55526
2015-02-12 12:07:54,758 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56889, dest: /127.0.0.1:55526, bytes: 115922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072, duration: 2878000
2015-02-12 12:07:54,759 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:54,759 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:54,760 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56888, dest: /127.0.0.1:55522, bytes: 115922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072, duration: 3304000
2015-02-12 12:07:54,760 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:54,761 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56887, dest: /127.0.0.1:55529, bytes: 115922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_298577711_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072, duration: 5031000
2015-02-12 12:07:54,761 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:54,761 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:54,761 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:07:54,763 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_298577711_1
2015-02-12 12:07:54,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:54,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:54,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:54,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006-1423771647651-soberoi-%5BE440EB5527C54899BDF78BD31232947E%2FECEC1677CE06478A-1423771674638-4-1-SUCCEEDED-default-1423771651615.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0006-1423771647651-soberoi-%5BE440EB5527C54899BDF78BD31232947E%2FECEC1677CE06478A-1423771674638-4-1-SUCCEEDED-default-1423771651615.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:07:54,789 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1129)) - Updating application attempt appattempt_1423771478362_0006_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 12:07:54,790 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0006_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 12:07:54,790 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(992)) - Updating application application_1423771478362_0006 with final state: FINISHING
2015-02-12 12:07:54,790 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0006 State change from RUNNING to FINAL_SAVING
2015-02-12 12:07:54,790 INFO  recovery.RMStateStore (RMStateStore.java:transition(161)) - Updating info for app: application_1423771478362_0006
2015-02-12 12:07:54,790 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0006_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 12:07:54,791 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0006 State change from FINAL_SAVING to FINISHING
2015-02-12 12:07:55,592 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:07:55,592 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0006_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 12:07:55,593 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000006
2015-02-12 12:07:55,593 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:07:55,593 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:07:55,595 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0006_01_000006, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:07:55,595 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:55,595 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:07:55,595 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0006_000001 released container container_1423771478362_0006_01_000006 on node: host: 10.1.1.68:55673 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:07:55,798 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(351)) - application_1423771478362_0006 unregistered successfully. 
2015-02-12 12:07:55,801 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741887_1063 127.0.0.1:55526 127.0.0.1:55522 127.0.0.1:55519 127.0.0.1:55529 
2015-02-12 12:07:55,802 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741888_1064 127.0.0.1:55522 127.0.0.1:55526 127.0.0.1:55529 127.0.0.1:55519 
2015-02-12 12:07:55,802 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741889_1065 127.0.0.1:55526 127.0.0.1:55529 127.0.0.1:55522 
2015-02-12 12:07:55,802 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741890_1066 127.0.0.1:55529 127.0.0.1:55526 127.0.0.1:55519 
2015-02-12 12:07:55,802 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741892_1068 127.0.0.1:55519 127.0.0.1:55522 127.0.0.1:55526 
2015-02-12 12:07:55,803 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741891_1067 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:07:55,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0006	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,836 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741869_1045 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:07:55,836 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741868_1044 127.0.0.1:55526 127.0.0.1:55522 127.0.0.1:55529 
2015-02-12 12:07:55,836 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741870_1046 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:07:55,836 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741866_1042 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:07:55,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/restartable/restartable/test	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,838 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary
2015-02-12 12:07:55,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,858 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 12:07:55,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,862 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/restartcheckpoint
2015-02-12 12:07:55,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/restartcheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,901 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 12:07:55,902 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 12:07:55,907 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/failcheckpointevery/tap
2015-02-12 12:07:55,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/failcheckpointevery/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,908 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/failcheckpointevery/sink
2015-02-12 12:07:55,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/failcheckpointevery/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,926 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 12:07:55,926 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 12:07:55,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,954 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-12 12:07:55,954 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-02-12 12:07:55,954 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint"]
2015-02-12 12:07:55,954 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  parallel execution is enabled: true
2015-02-12 12:07:55,955 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  starting jobs: 2
2015-02-12 12:07:55,955 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  allocating threads: 2
2015-02-12 12:07:55,957 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/2)
2015-02-12 12:07:55,972 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:07:55,986 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:07:55,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:07:55,997 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(286)) - Allocated new applicationId: 7
2015-02-12 12:07:55,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 12:07:56,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 12:07:56,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:56,006 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:07:56,008 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073 src: /127.0.0.1:56894 dest: /127.0.0.1:55529
2015-02-12 12:07:56,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073 src: /127.0.0.1:56895 dest: /127.0.0.1:55526
2015-02-12 12:07:56,011 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073 src: /127.0.0.1:56896 dest: /127.0.0.1:55519
2015-02-12 12:07:56,017 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56896, dest: /127.0.0.1:55519, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073, duration: 2827000
2015-02-12 12:07:56,017 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:56,017 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:07:56,018 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56895, dest: /127.0.0.1:55526, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073, duration: 3464000
2015-02-12 12:07:56,018 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:56,019 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56894, dest: /127.0.0.1:55529, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073, duration: 5342000
2015-02-12 12:07:56,019 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:07:56,020 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:56,023 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:07:56,024 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:07:56,025 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar
2015-02-12 12:07:56,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:56,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,038 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 12:07:56,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:56,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:56,044 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split
2015-02-12 12:07:56,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,046 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split. BP-1120419527-10.1.1.68-1423771456695 blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:07:56,048 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074 src: /127.0.0.1:56897 dest: /127.0.0.1:55522
2015-02-12 12:07:56,050 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074 src: /127.0.0.1:56898 dest: /127.0.0.1:55529
2015-02-12 12:07:56,051 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074 src: /127.0.0.1:56899 dest: /127.0.0.1:55526
2015-02-12 12:07:56,052 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074 src: /127.0.0.1:56900 dest: /127.0.0.1:55519
2015-02-12 12:07:56,056 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56900, dest: /127.0.0.1:55519, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074, duration: 2006000
2015-02-12 12:07:56,058 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:56,059 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:07:56,059 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56899, dest: /127.0.0.1:55526, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074, duration: 4192000
2015-02-12 12:07:56,059 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:56,060 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56898, dest: /127.0.0.1:55529, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074, duration: 5727000
2015-02-12 12:07:56,060 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:07:56,060 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:56,061 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:07:56,061 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56897, dest: /127.0.0.1:55522, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074, duration: 6884000
2015-02-12 12:07:56,061 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:56,062 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:07:56,064 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:07:56,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:56,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:56,070 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo. BP-1120419527-10.1.1.68-1423771456695 blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:07:56,073 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075 src: /127.0.0.1:56901 dest: /127.0.0.1:55522
2015-02-12 12:07:56,075 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075 src: /127.0.0.1:56902 dest: /127.0.0.1:55529
2015-02-12 12:07:56,076 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075 src: /127.0.0.1:56903 dest: /127.0.0.1:55519
2015-02-12 12:07:56,080 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56903, dest: /127.0.0.1:55519, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075, duration: 1634000
2015-02-12 12:07:56,080 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:56,080 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:07:56,080 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56902, dest: /127.0.0.1:55529, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075, duration: 2070000
2015-02-12 12:07:56,081 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:56,081 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:07:56,081 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56901, dest: /127.0.0.1:55522, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075, duration: 3029000
2015-02-12 12:07:56,082 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:56,084 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:07:56,085 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:07:56,085 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:4
2015-02-12 12:07:56,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:56,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:07:56,099 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:07:56,100 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076 src: /127.0.0.1:56904 dest: /127.0.0.1:55526
2015-02-12 12:07:56,102 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076 src: /127.0.0.1:56905 dest: /127.0.0.1:55519
2015-02-12 12:07:56,104 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076 src: /127.0.0.1:56906 dest: /127.0.0.1:55522
2015-02-12 12:07:56,107 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56906, dest: /127.0.0.1:55522, bytes: 97241, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076, duration: 2058000
2015-02-12 12:07:56,108 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:07:56,108 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:07:56,108 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56905, dest: /127.0.0.1:55519, bytes: 97241, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076, duration: 2488000
2015-02-12 12:07:56,109 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:56,109 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:07:56,109 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56904, dest: /127.0.0.1:55526, bytes: 97241, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076, duration: 3402000
2015-02-12 12:07:56,109 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:07:56,111 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:07:56,112 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:07:56,112 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_1423771478362_0007
2015-02-12 12:07:56,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,135 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(577)) - Application with id 7 submitted by user soberoi
2015-02-12 12:07:56,135 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(973)) - Storing application with id application_1423771478362_0007
2015-02-12 12:07:56,135 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	IP=10.1.1.68	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423771478362_0007
2015-02-12 12:07:56,136 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423771478362_0007
2015-02-12 12:07:56,135 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0007 State change from NEW to NEW_SAVING
2015-02-12 12:07:56,136 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0007 State change from NEW_SAVING to SUBMITTED
2015-02-12 12:07:56,136 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(386)) - Application added - appId: application_1423771478362_0007 user: soberoi leaf-queue of parent: root #applications: 2
2015-02-12 12:07:56,136 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(716)) - Accepted application application_1423771478362_0007 from user: soberoi, in queue: default
2015-02-12 12:07:56,137 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0007 State change from SUBMITTED to ACCEPTED
2015-02-12 12:07:56,137 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(251)) - Submitted application application_1423771478362_0007
2015-02-12 12:07:56,137 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(670)) - Registering app attempt : appattempt_1423771478362_0007_000001
2015-02-12 12:07:56,138 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0007_000001 State change from NEW to SUBMITTED
2015-02-12 12:07:56,138 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(626)) - Application application_1423771478362_0007 from user: soberoi activated in queue: default
2015-02-12 12:07:56,138 INFO  capacity.LeafQueue (LeafQueue.java:addApplicationAttempt(643)) - Application added - appId: application_1423771478362_0007 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@35816f1c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-02-12 12:07:56,138 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplicationAttempt(746)) - Added Application Attempt appattempt_1423771478362_0007_000001 to scheduler from user soberoi in queue default
2015-02-12 12:07:56,139 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0007_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 12:07:56,141 INFO  mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://Edinburgh.local:55663/proxy/application_1423771478362_0007/
2015-02-12 12:07:56,141 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_1423771478362_0007
2015-02-12 12:07:56,141 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://Edinburgh.local:55663/proxy/application_1423771478362_0007/
2015-02-12 12:07:56,471 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:07:56,472 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000001
2015-02-12 12:07:56,472 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55677, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 12:07:56,472 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0007_000001 container=Container: [ContainerId: container_1423771478362_0007_01_000001, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:07:56,472 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-02-12 12:07:56,473 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:07:56,474 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55677 for container : container_1423771478362_0007_01_000001
2015-02-12 12:07:56,475 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:07:56,475 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423771478362_0007_000001
2015-02-12 12:07:56,475 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1837)) - Storing attempt: AppId: application_1423771478362_0007 AttemptId: appattempt_1423771478362_0007_000001 MasterContainer: Container: [ContainerId: container_1423771478362_0007_01_000001, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ]
2015-02-12 12:07:56,475 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0007_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 12:07:56,476 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0007_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 12:07:56,476 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423771478362_0007_000001
2015-02-12 12:07:56,477 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423771478362_0007_01_000001, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] for AM appattempt_1423771478362_0007_000001
2015-02-12 12:07:56,477 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423771478362_0007_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 12:07:56,478 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423771478362_0007_000001
2015-02-12 12:07:56,478 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423771478362_0007_000001
2015-02-12 12:07:56,480 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0007_000001 (auth:SIMPLE)
2015-02-12 12:07:56,483 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0007_01_000001 by user soberoi
2015-02-12 12:07:56,483 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0007
2015-02-12 12:07:56,483 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000001
2015-02-12 12:07:56,484 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0007 transitioned from NEW to INITING
2015-02-12 12:07:56,484 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0007_01_000001 to application application_1423771478362_0007
2015-02-12 12:07:56,484 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423771478362_0007_01_000001, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] for AM appattempt_1423771478362_0007_000001
2015-02-12 12:07:56,484 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0007 transitioned from INITING to RUNNING
2015-02-12 12:07:56,484 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0007_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 12:07:56,484 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 12:07:56,484 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0007
2015-02-12 12:07:56,485 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:07:56,485 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 12:07:56,485 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split transitioned from INIT to DOWNLOADING
2015-02-12 12:07:56,485 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:07:56,485 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0007_01_000001
2015-02-12 12:07:56,494 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423771478362_0007_01_000001.tokens. Credentials list: 
2015-02-12 12:07:56,596 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:56,598 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:07:56,676 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423771478362_0007_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000001.tokens
2015-02-12 12:07:56,677 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0007
2015-02-12 12:07:56,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,798 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0007/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:56,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,861 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0007/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:56,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,908 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0007/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:56,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:07:56,964 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0007/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:07:56,965 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:07:57,003 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 12:07:57,003 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:07:57,106 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000001/default_container_executor.sh]
2015-02-12 12:07:57,437 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1492)) - BLOCK* ask 127.0.0.1:55529 to replicate blk_1073741897_1073 to datanode(s) 127.0.0.1:55522
2015-02-12 12:07:57,437 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55529 to delete [blk_1073741888_1064, blk_1073741889_1065, blk_1073741890_1066, blk_1073741866_1042, blk_1073741868_1044, blk_1073741869_1045, blk_1073741887_1063]
2015-02-12 12:07:57,437 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741888_1064, blk_1073741889_1065, blk_1073741890_1066, blk_1073741891_1067, blk_1073741892_1068, blk_1073741868_1044, blk_1073741870_1046, blk_1073741887_1063]
2015-02-12 12:07:57,474 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:07:57,596 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:58,445 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741888 for deletion
2015-02-12 12:07:58,445 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741889 for deletion
2015-02-12 12:07:58,445 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741890 for deletion
2015-02-12 12:07:58,445 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741891 for deletion
2015-02-12 12:07:58,445 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741888
2015-02-12 12:07:58,445 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741889
2015-02-12 12:07:58,445 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741890
2015-02-12 12:07:58,445 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741892 for deletion
2015-02-12 12:07:58,446 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741891
2015-02-12 12:07:58,446 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741868 for deletion
2015-02-12 12:07:58,446 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741892
2015-02-12 12:07:58,446 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741870 for deletion
2015-02-12 12:07:58,446 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741887 for deletion
2015-02-12 12:07:58,446 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741870
2015-02-12 12:07:58,447 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741868
2015-02-12 12:07:58,447 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741887
2015-02-12 12:07:58,597 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:59,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:07:59,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 12:07:59,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 12:07:59,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 12:07:59,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007	dst=null	perm=null	proto=rpc
2015-02-12 12:07:59,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:07:59,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:07:59,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:59,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:07:59,602 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:07:59,824 INFO  datanode.DataNode (DataNode.java:transferBlock(1812)) - DatanodeRegistration(127.0.0.1, datanodeUuid=de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, infoPort=55533, ipcPort=55546, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) Starting thread to transfer BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073 to 127.0.0.1:55522 
2015-02-12 12:07:59,825 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741888 for deletion
2015-02-12 12:07:59,825 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741889 for deletion
2015-02-12 12:07:59,825 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741890 for deletion
2015-02-12 12:07:59,825 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741866 for deletion
2015-02-12 12:07:59,825 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741888
2015-02-12 12:07:59,826 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741890
2015-02-12 12:07:59,826 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741866
2015-02-12 12:07:59,826 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741889
2015-02-12 12:07:59,825 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741868 for deletion
2015-02-12 12:07:59,826 INFO  datanode.DataNode (DataNode.java:run(2020)) - DataTransfer: Transmitted BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073 (numBytes=254067) to /127.0.0.1:55522
2015-02-12 12:07:59,826 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073 src: /127.0.0.1:56915 dest: /127.0.0.1:55522
2015-02-12 12:07:59,826 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741869 for deletion
2015-02-12 12:07:59,827 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741868
2015-02-12 12:07:59,827 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741887 for deletion
2015-02-12 12:07:59,827 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741869
2015-02-12 12:07:59,828 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741887
2015-02-12 12:07:59,829 INFO  datanode.DataNode (DataXceiver.java:writeBlock(755)) - Received BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073 src: /127.0.0.1:56915 dest: /127.0.0.1:55522 of size 254067
2015-02-12 12:07:59,829 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741897_1073 size 254067
2015-02-12 12:08:00,387 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070
2015-02-12 12:08:00,387 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072
2015-02-12 12:08:00,388 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069
2015-02-12 12:08:00,388 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071
2015-02-12 12:08:00,430 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0007_000001 (auth:SIMPLE)
2015-02-12 12:08:00,434 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(274)) - AM registration appattempt_1423771478362_0007_000001
2015-02-12 12:08:00,434 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(127)) - USER=soberoi	IP=10.1.1.68	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423771478362_0007	APPATTEMPTID=appattempt_1423771478362_0007_000001
2015-02-12 12:08:00,434 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0007_000001 State change from LAUNCHED to RUNNING
2015-02-12 12:08:00,435 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0007 State change from ACCEPTED to RUNNING
2015-02-12 12:08:00,441 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55519 to delete [blk_1073741888_1064, blk_1073741890_1066, blk_1073741891_1067, blk_1073741892_1068, blk_1073741866_1042, blk_1073741869_1045, blk_1073741870_1046, blk_1073741887_1063]
2015-02-12 12:08:00,442 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741888_1064, blk_1073741889_1065, blk_1073741891_1067, blk_1073741892_1068, blk_1073741866_1042, blk_1073741868_1044, blk_1073741869_1045, blk_1073741870_1046, blk_1073741887_1063]
2015-02-12 12:08:00,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:00,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:00,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:00,605 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:00,711 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1_conf.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:08:00,761 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077 src: /127.0.0.1:56919 dest: /127.0.0.1:55522
2015-02-12 12:08:00,764 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077 src: /127.0.0.1:56920 dest: /127.0.0.1:55526
2015-02-12 12:08:00,765 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077 src: /127.0.0.1:56921 dest: /127.0.0.1:55529
2015-02-12 12:08:00,807 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56921, dest: /127.0.0.1:55529, bytes: 114358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077, duration: 37128000
2015-02-12 12:08:00,807 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:00,809 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56920, dest: /127.0.0.1:55526, bytes: 114358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077, duration: 39150000
2015-02-12 12:08:00,809 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:00,812 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56919, dest: /127.0.0.1:55522, bytes: 114358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077, duration: 42299000
2015-02-12 12:08:00,812 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:00,816 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:08:00,817 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:08:00,818 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:00,832 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1482147884_1
2015-02-12 12:08:00,877 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(346)) - Container container_1423771478362_0006_01_000001 succeeded 
2015-02-12 12:08:00,877 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 12:08:00,877 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0006_01_000001
2015-02-12 12:08:00,901 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000001
2015-02-12 12:08:00,902 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000001
2015-02-12 12:08:00,903 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000001
2015-02-12 12:08:00,903 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0006/container_1423771478362_0006_01_000001
2015-02-12 12:08:00,904 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000001
2015-02-12 12:08:00,904 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0006_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 12:08:00,904 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0006_01_000001 from application application_1423771478362_0006
2015-02-12 12:08:00,905 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:00,905 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0006
2015-02-12 12:08:01,133 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741888 for deletion
2015-02-12 12:08:01,134 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741890 for deletion
2015-02-12 12:08:01,134 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741891 for deletion
2015-02-12 12:08:01,134 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741888
2015-02-12 12:08:01,134 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741890
2015-02-12 12:08:01,134 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741892 for deletion
2015-02-12 12:08:01,135 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741891
2015-02-12 12:08:01,135 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741866 for deletion
2015-02-12 12:08:01,135 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741869 for deletion
2015-02-12 12:08:01,135 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741870 for deletion
2015-02-12 12:08:01,135 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741887 for deletion
2015-02-12 12:08:01,135 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741892
2015-02-12 12:08:01,136 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741870
2015-02-12 12:08:01,136 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741866
2015-02-12 12:08:01,136 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741869
2015-02-12 12:08:01,137 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741887
2015-02-12 12:08:01,137 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741888 for deletion
2015-02-12 12:08:01,137 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741889 for deletion
2015-02-12 12:08:01,137 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741891 for deletion
2015-02-12 12:08:01,138 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741892 for deletion
2015-02-12 12:08:01,138 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741866 for deletion
2015-02-12 12:08:01,138 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741889
2015-02-12 12:08:01,138 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741868 for deletion
2015-02-12 12:08:01,138 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741869 for deletion
2015-02-12 12:08:01,138 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741870 for deletion
2015-02-12 12:08:01,139 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741887 for deletion
2015-02-12 12:08:01,138 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741888
2015-02-12 12:08:01,139 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741891
2015-02-12 12:08:01,138 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741892
2015-02-12 12:08:01,139 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741870
2015-02-12 12:08:01,140 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741866
2015-02-12 12:08:01,140 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741868
2015-02-12 12:08:01,140 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741869
2015-02-12 12:08:01,141 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741887
2015-02-12 12:08:01,485 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:01,485 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000002
2015-02-12 12:08:01,486 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 12:08:01,486 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0007_000001 container=Container: [ContainerId: container_1423771478362_0007_01_000002, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:01,486 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-02-12 12:08:01,487 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:01,487 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:01,487 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000003
2015-02-12 12:08:01,487 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0007_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 12:08:01,488 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0007_000001 container=Container: [ContainerId: container_1423771478362_0007_01_000003, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:01,488 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-02-12 12:08:01,488 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:01,610 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:01,610 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:01,611 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000004
2015-02-12 12:08:01,611 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0007_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:08:01,611 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0007_000001 container=Container: [ContainerId: container_1423771478362_0007_01_000004, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:01,612 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>, usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-02-12 12:08:01,612 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:01,612 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:01,613 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000005
2015-02-12 12:08:01,613 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0007_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 12:08:01,613 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0007_000001 container=Container: [ContainerId: container_1423771478362_0007_01_000005, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>, usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:01,613 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>, usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-02-12 12:08:01,613 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:01,649 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072
2015-02-12 12:08:01,649 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074
2015-02-12 12:08:01,652 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073
2015-02-12 12:08:01,652 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069
2015-02-12 12:08:01,652 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070
2015-02-12 12:08:01,828 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0006_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:01,828 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(676)) - Unregistering app attempt : appattempt_1423771478362_0006_000001
2015-02-12 12:08:01,829 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0006_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 12:08:01,829 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000001
2015-02-12 12:08:01,829 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423771478362_0006_000001
2015-02-12 12:08:01,829 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0006_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55664, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:08:01,830 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0006_000001 State change from FINISHING to FINISHED
2015-02-12 12:08:01,830 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-02-12 12:08:01,830 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0006 State change from FINISHING to FINISHED
2015-02-12 12:08:01,830 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0006_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:01,831 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423771478362_0006
2015-02-12 12:08:01,831 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(179)) - appId=application_1423771478362_0006,name=[E440EB5527C54899BDF78BD31232947E/ECEC1677CE06478A8F73AF8A407D2203] restartable/(2/2) ...latform/restartcheckpoint,user=soberoi,queue=default,state=FINISHED,trackingUrl=http://Edinburgh.local:55663/proxy/application_1423771478362_0006/jobhistory/job/job_1423771478362_0006,appMasterHost=10.1.1.68,startTime=1423771647651,finishTime=1423771674790,finalStatus=SUCCEEDED
2015-02-12 12:08:01,831 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423771478362_0006_000001
2015-02-12 12:08:01,831 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:01,832 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-02-12 12:08:01,832 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0006_000001 released container container_1423771478362_0006_01_000001 on node: host: 10.1.1.68:55664 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:08:01,832 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplicationAttempt(785)) - Application Attempt appattempt_1423771478362_0006_000001 is done. finalState=FINISHED
2015-02-12 12:08:01,832 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423771478362_0006 requests cleared
2015-02-12 12:08:01,832 INFO  capacity.LeafQueue (LeafQueue.java:removeApplicationAttempt(686)) - Application removed - appId: application_1423771478362_0006 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-02-12 12:08:01,832 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(411)) - Application removed - appId: application_1423771478362_0006 user: soberoi leaf-queue of parent: root #applications: 1
2015-02-12 12:08:01,836 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0006_000001 (auth:SIMPLE)
2015-02-12 12:08:01,838 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0006_01_000001
2015-02-12 12:08:01,838 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0006	CONTAINERID=container_1423771478362_0006_01_000001
2015-02-12 12:08:01,838 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0006_01_000001]
2015-02-12 12:08:01,839 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:01,839 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:08:01,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:01,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:01,840 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0006
2015-02-12 12:08:01,840 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:01,841 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:08:01,841 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:01,841 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0006, with delay of 10800 seconds
2015-02-12 12:08:01,854 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071
2015-02-12 12:08:01,855 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075
2015-02-12 12:08:02,478 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55677 for container : container_1423771478362_0007_01_000002
2015-02-12 12:08:02,479 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:02,480 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:02,481 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55673 for container : container_1423771478362_0007_01_000004
2015-02-12 12:08:02,481 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:02,482 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:02,486 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:08:02,486 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:02,486 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:02,487 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0006
2015-02-12 12:08:02,487 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:02,487 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:02,487 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:08:02,488 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0006, with delay of 10800 seconds
2015-02-12 12:08:02,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:02,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:02,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:02,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:02,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:02,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:02,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:02,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:02,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:02,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:02,612 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:08:02,612 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:02,613 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:02,614 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:02,614 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:02,614 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0006
2015-02-12 12:08:02,614 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:08:02,615 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0006, with delay of 10800 seconds
2015-02-12 12:08:02,614 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0006
2015-02-12 12:08:02,640 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0007_000001 (auth:SIMPLE)
2015-02-12 12:08:02,640 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0007_000001 (auth:SIMPLE)
2015-02-12 12:08:02,641 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0007_000001 (auth:SIMPLE)
2015-02-12 12:08:02,641 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0007_000001 (auth:SIMPLE)
2015-02-12 12:08:02,645 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0007_01_000005 by user soberoi
2015-02-12 12:08:02,646 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0007_01_000002 by user soberoi
2015-02-12 12:08:02,646 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0007_01_000004 by user soberoi
2015-02-12 12:08:02,646 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0007_01_000003 by user soberoi
2015-02-12 12:08:02,646 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0007_01_000002 to application application_1423771478362_0007
2015-02-12 12:08:02,647 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0007_01_000003 to application application_1423771478362_0007
2015-02-12 12:08:02,647 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 12:08:02,648 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 12:08:02,648 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0007
2015-02-12 12:08:02,648 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0007_01_000004 to application application_1423771478362_0007
2015-02-12 12:08:02,646 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0007
2015-02-12 12:08:02,649 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000005
2015-02-12 12:08:02,648 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0007
2015-02-12 12:08:02,649 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:02,649 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0007
2015-02-12 12:08:02,650 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0007
2015-02-12 12:08:02,650 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0007
2015-02-12 12:08:02,650 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0007 transitioned from NEW to INITING
2015-02-12 12:08:02,651 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0007_01_000005 to application application_1423771478362_0007
2015-02-12 12:08:02,651 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0007 transitioned from INITING to RUNNING
2015-02-12 12:08:02,651 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 12:08:02,648 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000002
2015-02-12 12:08:02,651 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 12:08:02,652 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0007
2015-02-12 12:08:02,652 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0007
2015-02-12 12:08:02,652 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:02,652 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0007
2015-02-12 12:08:02,652 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:08:02,652 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:08:02,653 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0007
2015-02-12 12:08:02,653 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0007
2015-02-12 12:08:02,647 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000003
2015-02-12 12:08:02,646 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000004
2015-02-12 12:08:02,653 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:02,655 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0007
2015-02-12 12:08:02,656 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0007_01_000004
2015-02-12 12:08:02,650 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:02,656 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0007
2015-02-12 12:08:02,657 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:02,657 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:02,658 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0007_01_000005
2015-02-12 12:08:02,702 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423771478362_0007_01_000004.tokens. Credentials list: 
2015-02-12 12:08:02,702 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423771478362_0007_01_000005.tokens. Credentials list: 
2015-02-12 12:08:02,716 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:02,716 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:02,723 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:02,723 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:02,856 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000002/default_container_executor.sh]
2015-02-12 12:08:02,871 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:02,871 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000003/default_container_executor.sh]
2015-02-12 12:08:03,018 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:03,025 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423771478362_0007_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000004.tokens
2015-02-12 12:08:03,026 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0007
2015-02-12 12:08:03,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:03,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:03,163 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423771478362_0007_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000005.tokens
2015-02-12 12:08:03,167 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0007
2015-02-12 12:08:03,213 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0007/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:03,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:03,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:03,295 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0007/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:03,295 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:03,295 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:03,349 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:03,349 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:03,350 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:03,350 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:03,489 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:03,490 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:03,497 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:08:03,502 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000005/default_container_executor.sh]
2015-02-12 12:08:03,511 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000004/default_container_executor.sh]
2015-02-12 12:08:03,614 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:03,614 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:03,614 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:04,494 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741893_1069
2015-02-12 12:08:04,495 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074
2015-02-12 12:08:04,495 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741895_1071
2015-02-12 12:08:04,496 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076
2015-02-12 12:08:04,496 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741896_1072
2015-02-12 12:08:04,496 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074
2015-02-12 12:08:04,496 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075
2015-02-12 12:08:04,497 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076
2015-02-12 12:08:04,498 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741894_1070
2015-02-12 12:08:04,698 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073
2015-02-12 12:08:04,699 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741899_1075
2015-02-12 12:08:05,394 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741900_1076
2015-02-12 12:08:05,396 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073
2015-02-12 12:08:05,397 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741898_1074
2015-02-12 12:08:06,860 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077
2015-02-12 12:08:09,503 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077
2015-02-12 12:08:09,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:09,707 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741897_1073
2015-02-12 12:08:09,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:08:09,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:09,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:10,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:10,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:10,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:08:10,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:10,283 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000000_0/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:08:10,351 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078 src: /127.0.0.1:56942 dest: /127.0.0.1:55526
2015-02-12 12:08:10,352 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078 src: /127.0.0.1:56944 dest: /127.0.0.1:55519
2015-02-12 12:08:10,354 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078 src: /127.0.0.1:56945 dest: /127.0.0.1:55522
2015-02-12 12:08:10,387 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56945, dest: /127.0.0.1:55522, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000000_0_-1193682093_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078, duration: 30830000
2015-02-12 12:08:10,387 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:10,389 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56944, dest: /127.0.0.1:55519, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000000_0_-1193682093_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078, duration: 32598000
2015-02-12 12:08:10,390 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:10,391 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56942, dest: /127.0.0.1:55526, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000000_0_-1193682093_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078, duration: 35169000
2015-02-12 12:08:10,391 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:10,391 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:10,392 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:10,393 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:10,397 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000000_0/part-00000 is closed by DFSClient_attempt_1423771478362_0007_m_000000_0_-1193682093_1
2015-02-12 12:08:10,401 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741901_1077
2015-02-12 12:08:10,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:10,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:10,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:10,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000000_0	dst=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:10,455 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0007_000001 (auth:SIMPLE)
2015-02-12 12:08:10,460 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0007_01_000002
2015-02-12 12:08:10,460 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000002
2015-02-12 12:08:10,460 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000002 transitioned from RUNNING to KILLING
2015-02-12 12:08:10,460 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0007_01_000002
2015-02-12 12:08:10,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:08:10,478 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1.jhist. BP-1120419527-10.1.1.68-1423771456695 blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:08:10,479 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0007_01_000002 is : 143
2015-02-12 12:08:10,481 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741903_1079 src: /127.0.0.1:56947 dest: /127.0.0.1:55529
2015-02-12 12:08:10,482 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741903_1079 src: /127.0.0.1:56948 dest: /127.0.0.1:55522
2015-02-12 12:08:10,484 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741903_1079 src: /127.0.0.1:56949 dest: /127.0.0.1:55519
2015-02-12 12:08:10,489 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4450)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1.jhist for DFSClient_NONMAPREDUCE_-1482147884_1
2015-02-12 12:08:10,489 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:10,491 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000002
2015-02-12 12:08:10,491 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:10,491 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0007_01_000002 from application application_1423771478362_0007
2015-02-12 12:08:10,491 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:10,491 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0007
2015-02-12 12:08:10,491 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000002
2015-02-12 12:08:10,493 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000002
2015-02-12 12:08:10,494 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000002
2015-02-12 12:08:10,494 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000002
2015-02-12 12:08:10,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:10,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:08:10,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:10,686 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000001_0/part-00001. BP-1120419527-10.1.1.68-1423771456695 blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:08:10,758 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080 src: /127.0.0.1:56951 dest: /127.0.0.1:55519
2015-02-12 12:08:10,759 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080 src: /127.0.0.1:56952 dest: /127.0.0.1:55522
2015-02-12 12:08:10,761 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080 src: /127.0.0.1:56953 dest: /127.0.0.1:55529
2015-02-12 12:08:10,796 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56953, dest: /127.0.0.1:55529, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000001_0_1889155533_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080, duration: 33747000
2015-02-12 12:08:10,796 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:10,797 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:08:10,797 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56952, dest: /127.0.0.1:55522, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000001_0_1889155533_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080, duration: 34468000
2015-02-12 12:08:10,797 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:10,798 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56951, dest: /127.0.0.1:55519, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000001_0_1889155533_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080, duration: 35591000
2015-02-12 12:08:10,798 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:10,799 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:08:10,800 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:08:10,811 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000001_0/part-00001 is closed by DFSClient_attempt_1423771478362_0007_m_000001_0_1889155533_1
2015-02-12 12:08:10,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:10,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:10,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000001	dst=null	perm=null	proto=rpc
2015-02-12 12:08:10,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000001_0	dst=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000001	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:10,860 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0007_000001 (auth:SIMPLE)
2015-02-12 12:08:10,863 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0007_01_000003
2015-02-12 12:08:10,863 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000003
2015-02-12 12:08:10,863 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000003 transitioned from RUNNING to KILLING
2015-02-12 12:08:10,863 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0007_01_000003
2015-02-12 12:08:10,864 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:10,864 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0007_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 12:08:10,864 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000002
2015-02-12 12:08:10,865 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 12:08:10,865 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-02-12 12:08:10,866 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0007_01_000002, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:10,866 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:10,866 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:08:10,866 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0007_000001 released container container_1423771478362_0007_01_000002 on node: host: 10.1.1.68:55677 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 12:08:10,881 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0007_01_000003 is : 143
2015-02-12 12:08:10,896 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:10,897 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000003
2015-02-12 12:08:10,899 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000003
2015-02-12 12:08:10,900 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000003
2015-02-12 12:08:10,901 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000003
2015-02-12 12:08:10,904 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000003
2015-02-12 12:08:10,905 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:10,905 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0007_01_000003 from application application_1423771478362_0007
2015-02-12 12:08:10,905 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:10,905 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0007
2015-02-12 12:08:10,946 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000003_0/part-00003. BP-1120419527-10.1.1.68-1423771456695 blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:08:11,027 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081 src: /127.0.0.1:56955 dest: /127.0.0.1:55529
2015-02-12 12:08:11,029 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081 src: /127.0.0.1:56956 dest: /127.0.0.1:55519
2015-02-12 12:08:11,030 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081 src: /127.0.0.1:56957 dest: /127.0.0.1:55522
2015-02-12 12:08:11,036 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000002_0/part-00002. BP-1120419527-10.1.1.68-1423771456695 blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:08:11,062 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56957, dest: /127.0.0.1:55522, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000003_0_1198841116_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081, duration: 30101000
2015-02-12 12:08:11,064 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:11,065 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:08:11,065 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56956, dest: /127.0.0.1:55519, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000003_0_1198841116_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081, duration: 32104000
2015-02-12 12:08:11,065 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,066 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:11,066 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56955, dest: /127.0.0.1:55529, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000003_0_1198841116_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081, duration: 33870000
2015-02-12 12:08:11,066 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,067 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:11,109 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000003_0/part-00003 is closed by DFSClient_attempt_1423771478362_0007_m_000003_0_1198841116_1
2015-02-12 12:08:11,111 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082 src: /127.0.0.1:56958 dest: /127.0.0.1:55529
2015-02-12 12:08:11,113 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082 src: /127.0.0.1:56959 dest: /127.0.0.1:55519
2015-02-12 12:08:11,114 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082 src: /127.0.0.1:56960 dest: /127.0.0.1:55522
2015-02-12 12:08:11,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000003	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000003_0	dst=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000003	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:11,151 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56960, dest: /127.0.0.1:55522, bytes: 152, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000002_0_1760925763_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082, duration: 35218000
2015-02-12 12:08:11,151 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:11,152 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:11,152 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56959, dest: /127.0.0.1:55519, bytes: 152, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000002_0_1760925763_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082, duration: 36205000
2015-02-12 12:08:11,152 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,153 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:11,153 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56958, dest: /127.0.0.1:55529, bytes: 152, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0007_m_000002_0_1760925763_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082, duration: 37588000
2015-02-12 12:08:11,154 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,154 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:11,166 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0007_000001 (auth:SIMPLE)
2015-02-12 12:08:11,168 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000002_0/part-00002 is closed by DFSClient_attempt_1423771478362_0007_m_000002_0_1760925763_1
2015-02-12 12:08:11,168 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0007_01_000005
2015-02-12 12:08:11,168 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000005
2015-02-12 12:08:11,168 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000005 transitioned from RUNNING to KILLING
2015-02-12 12:08:11,169 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0007_01_000005
2015-02-12 12:08:11,190 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0007_01_000005 is : 143
2015-02-12 12:08:11,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,210 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:11,211 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000005
2015-02-12 12:08:11,211 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000005
2015-02-12 12:08:11,212 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000005
2015-02-12 12:08:11,212 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000005
2015-02-12 12:08:11,213 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000005
2015-02-12 12:08:11,213 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:11,214 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0007_01_000005 from application application_1423771478362_0007
2015-02-12 12:08:11,214 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:11,214 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0007
2015-02-12 12:08:11,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000002	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/_temporary/attempt_1423771478362_0007_m_000002_0	dst=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000002	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:11,233 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0007_000001 (auth:SIMPLE)
2015-02-12 12:08:11,235 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0007_01_000004
2015-02-12 12:08:11,236 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000004
2015-02-12 12:08:11,236 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000004 transitioned from RUNNING to KILLING
2015-02-12 12:08:11,236 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:11,236 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0007_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 12:08:11,237 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000005
2015-02-12 12:08:11,237 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0007_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 12:08:11,237 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-02-12 12:08:11,236 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0007_01_000004
2015-02-12 12:08:11,238 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0007_01_000005, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:11,238 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:11,239 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:08:11,239 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0007_000001 released container container_1423771478362_0007_01_000005 on node: host: 10.1.1.68:55673 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 12:08:11,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:11,242 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1482147884_1
2015-02-12 12:08:11,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,256 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0007_01_000004 is : 143
2015-02-12 12:08:11,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000000/part-00000	dst=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:11,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000001	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000001/part-00001	dst=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00001	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:11,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000002	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,277 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:11,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,278 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000004
2015-02-12 12:08:11,278 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000004
2015-02-12 12:08:11,279 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000004
2015-02-12 12:08:11,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000002/part-00002	dst=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00002	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:11,279 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000004
2015-02-12 12:08:11,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,281 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000004
2015-02-12 12:08:11,281 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:11,282 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0007_01_000004 from application application_1423771478362_0007
2015-02-12 12:08:11,282 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:11,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,282 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0007
2015-02-12 12:08:11,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000003	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary/1/task_1423771478362_0007_m_000003/part-00003	dst=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00003	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:11,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:11,295 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1482147884_1
2015-02-12 12:08:11,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:11,299 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1482147884_1
2015-02-12 12:08:11,312 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56949, dest: /127.0.0.1:55519, bytes: 47534, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741903_1079, duration: 826549000
2015-02-12 12:08:11,313 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741903_1079, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:11,316 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 15494
2015-02-12 12:08:11,316 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56948, dest: /127.0.0.1:55522, bytes: 47534, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741903_1079, duration: 829554000
2015-02-12 12:08:11,316 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,316 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 15494
2015-02-12 12:08:11,317 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56947, dest: /127.0.0.1:55529, bytes: 47534, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741903_1079, duration: 830593000
2015-02-12 12:08:11,317 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,317 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 15494
2015-02-12 12:08:11,318 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1.jhist is closed by DFSClient_NONMAPREDUCE_-1482147884_1
2015-02-12 12:08:11,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:11,324 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007.summary_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:08:11,326 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083 src: /127.0.0.1:56963 dest: /127.0.0.1:55519
2015-02-12 12:08:11,328 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083 src: /127.0.0.1:56964 dest: /127.0.0.1:55522
2015-02-12 12:08:11,330 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083 src: /127.0.0.1:56965 dest: /127.0.0.1:55529
2015-02-12 12:08:11,333 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56965, dest: /127.0.0.1:55529, bytes: 404, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083, duration: 1504000
2015-02-12 12:08:11,333 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:11,333 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:11,333 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56964, dest: /127.0.0.1:55522, bytes: 404, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083, duration: 2215000
2015-02-12 12:08:11,334 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,334 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:11,334 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56963, dest: /127.0.0.1:55519, bytes: 404, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083, duration: 3069000
2015-02-12 12:08:11,334 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,335 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:11,338 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1482147884_1
2015-02-12 12:08:11,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:11,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007-1423771676135-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F98C72D2071E84765-1423771691300-4-0-SUCCEEDED-default-1423771680457.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007-1423771676135-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F98C72D2071E84765-1423771691300-4-0-SUCCEEDED-default-1423771680457.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007-1423771676135-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F98C72D2071E84765-1423771691300-4-0-SUCCEEDED-default-1423771680457.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:11,365 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007-1423771676135-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F98C72D2071E84765-1423771691300-4-0-SUCCEEDED-default-1423771680457.jhist_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:08:11,367 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084 src: /127.0.0.1:56967 dest: /127.0.0.1:55522
2015-02-12 12:08:11,369 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084 src: /127.0.0.1:56968 dest: /127.0.0.1:55519
2015-02-12 12:08:11,370 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084 src: /127.0.0.1:56969 dest: /127.0.0.1:55529
2015-02-12 12:08:11,373 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56969, dest: /127.0.0.1:55529, bytes: 47534, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084, duration: 1771000
2015-02-12 12:08:11,374 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:11,374 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:11,375 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56968, dest: /127.0.0.1:55519, bytes: 47534, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084, duration: 2742000
2015-02-12 12:08:11,375 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,376 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:11,377 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56967, dest: /127.0.0.1:55522, bytes: 47534, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084, duration: 4533000
2015-02-12 12:08:11,377 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,379 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:11,381 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007-1423771676135-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F98C72D2071E84765-1423771691300-4-0-SUCCEEDED-default-1423771680457.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1482147884_1
2015-02-12 12:08:11,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007-1423771676135-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F98C72D2071E84765-1423771691300-4-0-SUCCEEDED-default-1423771680457.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:11,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007/job_1423771478362_0007_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:11,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:11,409 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007_conf.xml_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:08:11,411 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085 src: /127.0.0.1:56971 dest: /127.0.0.1:55522
2015-02-12 12:08:11,412 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085 src: /127.0.0.1:56972 dest: /127.0.0.1:55529
2015-02-12 12:08:11,414 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085 src: /127.0.0.1:56973 dest: /127.0.0.1:55519
2015-02-12 12:08:11,418 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56973, dest: /127.0.0.1:55519, bytes: 114358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085, duration: 1853000
2015-02-12 12:08:11,418 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:11,418 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56972, dest: /127.0.0.1:55529, bytes: 114358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085, duration: 2519000
2015-02-12 12:08:11,419 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,419 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:08:11,419 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56971, dest: /127.0.0.1:55522, bytes: 114358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1482147884_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085, duration: 3585000
2015-02-12 12:08:11,420 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:11,420 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:11,421 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:11,424 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1482147884_1
2015-02-12 12:08:11,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:11,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:11,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:11,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007-1423771676135-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F98C72D2071E84765-1423771691300-4-0-SUCCEEDED-default-1423771680457.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0007-1423771676135-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F98C72D2071E84765-1423771691300-4-0-SUCCEEDED-default-1423771680457.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:11,438 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1129)) - Updating application attempt appattempt_1423771478362_0007_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 12:08:11,439 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0007_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 12:08:11,439 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(992)) - Updating application application_1423771478362_0007 with final state: FINISHING
2015-02-12 12:08:11,439 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0007 State change from RUNNING to FINAL_SAVING
2015-02-12 12:08:11,439 INFO  recovery.RMStateStore (RMStateStore.java:transition(161)) - Updating info for app: application_1423771478362_0007
2015-02-12 12:08:11,439 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0007_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 12:08:11,440 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0007 State change from FINAL_SAVING to FINISHING
2015-02-12 12:08:11,868 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:11,869 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:11,869 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0007_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 12:08:11,869 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000003
2015-02-12 12:08:11,869 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0007_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 12:08:11,870 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-02-12 12:08:11,870 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0007_01_000003, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:11,870 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:11,871 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:08:11,871 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0007_000001 released container container_1423771478362_0007_01_000003 on node: host: 10.1.1.68:55677 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 12:08:12,239 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:12,239 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0007_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 12:08:12,239 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000004
2015-02-12 12:08:12,240 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0007_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:08:12,240 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:08:12,241 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0007_01_000004, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:12,242 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:12,242 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:08:12,242 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0007_000001 released container container_1423771478362_0007_01_000004 on node: host: 10.1.1.68:55673 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:08:12,242 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:12,445 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(351)) - application_1423771478362_0007 unregistered successfully. 
2015-02-12 12:08:12,447 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741897_1073 127.0.0.1:55529 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:08:12,448 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741898_1074 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55526 127.0.0.1:55519 
2015-02-12 12:08:12,448 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741899_1075 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55519 
2015-02-12 12:08:12,448 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741900_1076 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:08:12,448 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741903_1079 127.0.0.1:55529 127.0.0.1:55522 127.0.0.1:55519 
2015-02-12 12:08:12,449 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741901_1077 127.0.0.1:55526 127.0.0.1:55522 127.0.0.1:55529 
2015-02-12 12:08:12,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0007	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,450 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741897_1073, blk_1073741898_1074, blk_1073741900_1076, blk_1073741901_1077]
2015-02-12 12:08:12,450 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55519 to delete [blk_1073741897_1073, blk_1073741898_1074, blk_1073741899_1075, blk_1073741900_1076, blk_1073741903_1079]
2015-02-12 12:08:12,482 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (2/2) ...platform/simplecheckpoint
2015-02-12 12:08:12,495 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:08:12,506 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:08:12,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,516 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(286)) - Allocated new applicationId: 8
2015-02-12 12:08:12,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 12:08:12,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 12:08:12,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:12,524 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:08:12,525 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086 src: /127.0.0.1:56976 dest: /127.0.0.1:55526
2015-02-12 12:08:12,527 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086 src: /127.0.0.1:56977 dest: /127.0.0.1:55519
2015-02-12 12:08:12,528 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086 src: /127.0.0.1:56978 dest: /127.0.0.1:55522
2015-02-12 12:08:12,533 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56978, dest: /127.0.0.1:55522, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086, duration: 3326000
2015-02-12 12:08:12,533 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:12,534 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:08:12,534 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56977, dest: /127.0.0.1:55519, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086, duration: 3695000
2015-02-12 12:08:12,534 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:12,535 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56976, dest: /127.0.0.1:55526, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086, duration: 5599000
2015-02-12 12:08:12,535 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:12,538 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:12,542 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:12,543 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:12,544 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar
2015-02-12 12:08:12,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:12,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,561 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 4
2015-02-12 12:08:12,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:12,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:12,565 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split
2015-02-12 12:08:12,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,567 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split. BP-1120419527-10.1.1.68-1423771456695 blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:08:12,568 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087 src: /127.0.0.1:56979 dest: /127.0.0.1:55519
2015-02-12 12:08:12,570 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087 src: /127.0.0.1:56980 dest: /127.0.0.1:55529
2015-02-12 12:08:12,571 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087 src: /127.0.0.1:56981 dest: /127.0.0.1:55522
2015-02-12 12:08:12,572 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087 src: /127.0.0.1:56982 dest: /127.0.0.1:55526
2015-02-12 12:08:12,576 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56982, dest: /127.0.0.1:55526, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087, duration: 1726000
2015-02-12 12:08:12,576 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:12,577 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56981, dest: /127.0.0.1:55522, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087, duration: 2638000
2015-02-12 12:08:12,577 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:12,578 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56980, dest: /127.0.0.1:55529, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087, duration: 4452000
2015-02-12 12:08:12,579 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:12,577 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:12,584 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56979, dest: /127.0.0.1:55519, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087, duration: 7108000
2015-02-12 12:08:12,584 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:12,589 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:12,596 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:12,598 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:12,599 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741911_1087 size 1383
2015-02-12 12:08:12,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:12,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:12,604 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo. BP-1120419527-10.1.1.68-1423771456695 blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:08:12,607 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088 src: /127.0.0.1:56983 dest: /127.0.0.1:55529
2015-02-12 12:08:12,609 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088 src: /127.0.0.1:56984 dest: /127.0.0.1:55519
2015-02-12 12:08:12,611 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088 src: /127.0.0.1:56985 dest: /127.0.0.1:55526
2015-02-12 12:08:12,615 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56985, dest: /127.0.0.1:55526, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088, duration: 1853000
2015-02-12 12:08:12,615 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:12,616 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:12,616 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56984, dest: /127.0.0.1:55519, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088, duration: 2375000
2015-02-12 12:08:12,616 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:12,617 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56983, dest: /127.0.0.1:55529, bytes: 151, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088, duration: 3409000
2015-02-12 12:08:12,617 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:12,617 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:12,619 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:12,620 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:12,621 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:4
2015-02-12 12:08:12,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:12,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:12,644 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:08:12,646 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089 src: /127.0.0.1:56986 dest: /127.0.0.1:55529
2015-02-12 12:08:12,648 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089 src: /127.0.0.1:56987 dest: /127.0.0.1:55519
2015-02-12 12:08:12,649 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089 src: /127.0.0.1:56988 dest: /127.0.0.1:55522
2015-02-12 12:08:12,653 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56988, dest: /127.0.0.1:55522, bytes: 98679, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089, duration: 1681000
2015-02-12 12:08:12,653 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:12,654 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:12,654 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56987, dest: /127.0.0.1:55519, bytes: 98679, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089, duration: 2456000
2015-02-12 12:08:12,654 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:12,656 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:56986, dest: /127.0.0.1:55529, bytes: 98679, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089, duration: 3930000
2015-02-12 12:08:12,656 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:12,657 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:12,659 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:12,662 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:12,662 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_1423771478362_0008
2015-02-12 12:08:12,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:12,683 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(577)) - Application with id 8 submitted by user soberoi
2015-02-12 12:08:12,683 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	IP=10.1.1.68	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423771478362_0008
2015-02-12 12:08:12,683 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(973)) - Storing application with id application_1423771478362_0008
2015-02-12 12:08:12,684 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0008 State change from NEW to NEW_SAVING
2015-02-12 12:08:12,684 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423771478362_0008
2015-02-12 12:08:12,684 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0008 State change from NEW_SAVING to SUBMITTED
2015-02-12 12:08:12,684 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(386)) - Application added - appId: application_1423771478362_0008 user: soberoi leaf-queue of parent: root #applications: 2
2015-02-12 12:08:12,684 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(716)) - Accepted application application_1423771478362_0008 from user: soberoi, in queue: default
2015-02-12 12:08:12,685 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0008 State change from SUBMITTED to ACCEPTED
2015-02-12 12:08:12,685 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(670)) - Registering app attempt : appattempt_1423771478362_0008_000001
2015-02-12 12:08:12,685 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(251)) - Submitted application application_1423771478362_0008
2015-02-12 12:08:12,685 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0008_000001 State change from NEW to SUBMITTED
2015-02-12 12:08:12,686 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(626)) - Application application_1423771478362_0008 from user: soberoi activated in queue: default
2015-02-12 12:08:12,686 INFO  capacity.LeafQueue (LeafQueue.java:addApplicationAttempt(643)) - Application added - appId: application_1423771478362_0008 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@35816f1c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-02-12 12:08:12,686 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplicationAttempt(746)) - Added Application Attempt appattempt_1423771478362_0008_000001 to scheduler from user soberoi in queue default
2015-02-12 12:08:12,687 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0008_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 12:08:12,689 INFO  mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://Edinburgh.local:55663/proxy/application_1423771478362_0008/
2015-02-12 12:08:12,689 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_1423771478362_0008
2015-02-12 12:08:12,689 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://Edinburgh.local:55663/proxy/application_1423771478362_0008/
2015-02-12 12:08:12,860 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:12,861 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000001
2015-02-12 12:08:12,861 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55664, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 12:08:12,861 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0008_000001 container=Container: [ContainerId: container_1423771478362_0008_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:12,861 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-02-12 12:08:12,862 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:12,863 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55664 for container : container_1423771478362_0008_01_000001
2015-02-12 12:08:12,863 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:12,864 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423771478362_0008_000001
2015-02-12 12:08:12,864 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1837)) - Storing attempt: AppId: application_1423771478362_0008 AttemptId: appattempt_1423771478362_0008_000001 MasterContainer: Container: [ContainerId: container_1423771478362_0008_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ]
2015-02-12 12:08:12,864 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0008_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 12:08:12,865 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0008_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 12:08:12,865 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423771478362_0008_000001
2015-02-12 12:08:12,866 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423771478362_0008_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] for AM appattempt_1423771478362_0008_000001
2015-02-12 12:08:12,866 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423771478362_0008_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 12:08:12,866 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423771478362_0008_000001
2015-02-12 12:08:12,866 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423771478362_0008_000001
2015-02-12 12:08:12,869 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:12,871 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:12,871 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:12,871 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0008_01_000001 by user soberoi
2015-02-12 12:08:12,872 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0008
2015-02-12 12:08:12,872 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000001
2015-02-12 12:08:12,872 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0008 transitioned from NEW to INITING
2015-02-12 12:08:12,872 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0008_01_000001 to application application_1423771478362_0008
2015-02-12 12:08:12,872 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423771478362_0008_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] for AM appattempt_1423771478362_0008_000001
2015-02-12 12:08:12,872 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0008 transitioned from INITING to RUNNING
2015-02-12 12:08:12,873 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0008_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 12:08:12,873 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 12:08:12,873 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0008
2015-02-12 12:08:12,873 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:08:12,873 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 12:08:12,873 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split transitioned from INIT to DOWNLOADING
2015-02-12 12:08:12,874 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:08:12,874 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0008_01_000001
2015-02-12 12:08:12,883 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423771478362_0008_01_000001.tokens. Credentials list: 
2015-02-12 12:08:12,998 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:13,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423771478362_0008_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000001.tokens
2015-02-12 12:08:13,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0008
2015-02-12 12:08:13,141 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741897 for deletion
2015-02-12 12:08:13,142 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741898 for deletion
2015-02-12 12:08:13,142 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741899 for deletion
2015-02-12 12:08:13,142 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741897
2015-02-12 12:08:13,142 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741900 for deletion
2015-02-12 12:08:13,142 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741903 for deletion
2015-02-12 12:08:13,142 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741899
2015-02-12 12:08:13,143 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741898
2015-02-12 12:08:13,143 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741900
2015-02-12 12:08:13,143 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741903
2015-02-12 12:08:13,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:13,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:13,195 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0008/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:13,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:13,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:13,242 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:13,243 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:13,250 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0008/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:13,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:13,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:13,302 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0008/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:13,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:13,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:13,357 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0008/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:13,357 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:13,390 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:13,391 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:13,460 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741897 for deletion
2015-02-12 12:08:13,460 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741898 for deletion
2015-02-12 12:08:13,460 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741900 for deletion
2015-02-12 12:08:13,461 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741901 for deletion
2015-02-12 12:08:13,461 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741898
2015-02-12 12:08:13,460 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741897
2015-02-12 12:08:13,461 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741901
2015-02-12 12:08:13,461 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741900
2015-02-12 12:08:13,492 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000001/default_container_executor.sh]
2015-02-12 12:08:13,865 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:13,876 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:13,876 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:14,244 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:14,244 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:14,876 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:14,876 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:15,244 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:15,245 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:15,404 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078
2015-02-12 12:08:15,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:08:15,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 12:08:15,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 12:08:15,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 12:08:15,455 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1492)) - BLOCK* ask 127.0.0.1:55522 to replicate blk_1073741910_1086 to datanode(s) 127.0.0.1:55529
2015-02-12 12:08:15,455 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741897_1073, blk_1073741898_1074, blk_1073741899_1075, blk_1073741900_1076, blk_1073741901_1077, blk_1073741903_1079]
2015-02-12 12:08:15,456 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55529 to delete [blk_1073741897_1073, blk_1073741898_1074, blk_1073741899_1075, blk_1073741901_1077, blk_1073741903_1079]
2015-02-12 12:08:15,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008	dst=null	perm=null	proto=rpc
2015-02-12 12:08:15,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:08:15,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:08:15,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:15,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:15,877 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:15,878 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:16,142 INFO  datanode.DataNode (DataNode.java:transferBlock(1812)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, infoPort=55523, ipcPort=55525, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) Starting thread to transfer BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086 to 127.0.0.1:55529 
2015-02-12 12:08:16,143 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741897 for deletion
2015-02-12 12:08:16,143 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741898 for deletion
2015-02-12 12:08:16,143 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741899 for deletion
2015-02-12 12:08:16,143 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741897
2015-02-12 12:08:16,144 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741899
2015-02-12 12:08:16,144 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741898
2015-02-12 12:08:16,144 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741900 for deletion
2015-02-12 12:08:16,144 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741901 for deletion
2015-02-12 12:08:16,144 INFO  datanode.DataNode (DataNode.java:run(2020)) - DataTransfer: Transmitted BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086 (numBytes=254067) to /127.0.0.1:55529
2015-02-12 12:08:16,144 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741903 for deletion
2015-02-12 12:08:16,145 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741900
2015-02-12 12:08:16,145 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086 src: /127.0.0.1:56999 dest: /127.0.0.1:55529
2015-02-12 12:08:16,145 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741901
2015-02-12 12:08:16,145 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741903
2015-02-12 12:08:16,147 INFO  datanode.DataNode (DataXceiver.java:writeBlock(755)) - Received BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086 src: /127.0.0.1:56999 dest: /127.0.0.1:55529 of size 254067
2015-02-12 12:08:16,147 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741910_1086 size 254067
2015-02-12 12:08:16,245 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:16,245 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:16,716 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:16,718 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(274)) - AM registration appattempt_1423771478362_0008_000001
2015-02-12 12:08:16,718 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(127)) - USER=soberoi	IP=10.1.1.68	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423771478362_0008	APPATTEMPTID=appattempt_1423771478362_0008_000001
2015-02-12 12:08:16,718 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0008_000001 State change from LAUNCHED to RUNNING
2015-02-12 12:08:16,718 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0008 State change from ACCEPTED to RUNNING
2015-02-12 12:08:16,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:16,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:16,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:16,872 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084
2015-02-12 12:08:16,872 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085
2015-02-12 12:08:16,873 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741903_1079
2015-02-12 12:08:16,873 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080
2015-02-12 12:08:16,874 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081
2015-02-12 12:08:16,874 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083
2015-02-12 12:08:16,874 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082
2015-02-12 12:08:16,882 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:16,882 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:16,943 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1_conf.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:08:16,991 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090 src: /127.0.0.1:57003 dest: /127.0.0.1:55526
2015-02-12 12:08:16,993 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090 src: /127.0.0.1:57004 dest: /127.0.0.1:55519
2015-02-12 12:08:16,995 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090 src: /127.0.0.1:57005 dest: /127.0.0.1:55522
2015-02-12 12:08:17,024 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57005, dest: /127.0.0.1:55522, bytes: 115754, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090, duration: 27383000
2015-02-12 12:08:17,024 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:17,025 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57004, dest: /127.0.0.1:55519, bytes: 115754, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090, duration: 28083000
2015-02-12 12:08:17,025 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:17,025 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:17,026 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57003, dest: /127.0.0.1:55526, bytes: 115754, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090, duration: 29357000
2015-02-12 12:08:17,026 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:17,026 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:17,027 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:17,035 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1015806188_1
2015-02-12 12:08:17,250 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:17,250 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:17,592 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(346)) - Container container_1423771478362_0007_01_000001 succeeded 
2015-02-12 12:08:17,592 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 12:08:17,592 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0007_01_000001
2015-02-12 12:08:17,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000001
2015-02-12 12:08:17,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000001
2015-02-12 12:08:17,606 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000001
2015-02-12 12:08:17,606 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0007_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 12:08:17,606 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0007_01_000001 from application application_1423771478362_0007
2015-02-12 12:08:17,606 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:17,606 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000001
2015-02-12 12:08:17,606 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0007
2015-02-12 12:08:17,606 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0007/container_1423771478362_0007_01_000001
2015-02-12 12:08:17,841 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741897 for deletion
2015-02-12 12:08:17,841 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741898 for deletion
2015-02-12 12:08:17,841 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741899 for deletion
2015-02-12 12:08:17,842 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741898
2015-02-12 12:08:17,841 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741897
2015-02-12 12:08:17,842 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741901 for deletion
2015-02-12 12:08:17,842 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741899
2015-02-12 12:08:17,842 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741903 for deletion
2015-02-12 12:08:17,843 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741901
2015-02-12 12:08:17,843 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741903
2015-02-12 12:08:17,880 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:17,881 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000002
2015-02-12 12:08:17,881 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 12:08:17,881 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0008_000001 container=Container: [ContainerId: container_1423771478362_0008_01_000002, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:17,881 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-02-12 12:08:17,881 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:17,882 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:17,882 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000003
2015-02-12 12:08:17,882 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 12:08:17,882 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0008_000001 container=Container: [ContainerId: container_1423771478362_0008_01_000003, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:17,882 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-02-12 12:08:17,882 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:17,884 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0007_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:17,884 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(676)) - Unregistering app attempt : appattempt_1423771478362_0007_000001
2015-02-12 12:08:17,884 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423771478362_0007_000001
2015-02-12 12:08:17,884 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0007_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 12:08:17,884 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0007_000001 State change from FINISHING to FINISHED
2015-02-12 12:08:17,884 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0007 State change from FINISHING to FINISHED
2015-02-12 12:08:17,884 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000001
2015-02-12 12:08:17,885 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423771478362_0007
2015-02-12 12:08:17,885 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(179)) - appId=application_1423771478362_0007,name=[E1F1A5DA35464F33B8F07A32B761380A/98C72D2071E84765ACDBBF6B012C2601] test/(1/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=http://Edinburgh.local:55663/proxy/application_1423771478362_0007/jobhistory/job/job_1423771478362_0007,appMasterHost=10.1.1.68,startTime=1423771676135,finishTime=1423771691439,finalStatus=SUCCEEDED
2015-02-12 12:08:17,885 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55677, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:08:17,885 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-02-12 12:08:17,885 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423771478362_0007_000001
2015-02-12 12:08:17,885 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0007_01_000001, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:17,886 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:17,886 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-02-12 12:08:17,886 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0007_000001 released container container_1423771478362_0007_01_000001 on node: host: 10.1.1.68:55677 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:08:17,886 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:17,886 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:17,886 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:17,887 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000004
2015-02-12 12:08:17,887 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:08:17,887 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0008_000001 container=Container: [ContainerId: container_1423771478362_0008_01_000004, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:17,887 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4
2015-02-12 12:08:17,887 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:17,888 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:17,888 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000005
2015-02-12 12:08:17,888 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 12:08:17,889 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0008_000001 container=Container: [ContainerId: container_1423771478362_0008_01_000005, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:17,889 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-02-12 12:08:17,889 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:17,889 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplicationAttempt(785)) - Application Attempt appattempt_1423771478362_0007_000001 is done. finalState=FINISHED
2015-02-12 12:08:17,889 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423771478362_0007 requests cleared
2015-02-12 12:08:17,889 INFO  capacity.LeafQueue (LeafQueue.java:removeApplicationAttempt(686)) - Application removed - appId: application_1423771478362_0007 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-02-12 12:08:17,889 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(411)) - Application removed - appId: application_1423771478362_0007 user: soberoi leaf-queue of parent: root #applications: 1
2015-02-12 12:08:17,890 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0007_000001 (auth:SIMPLE)
2015-02-12 12:08:17,891 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0007_01_000001
2015-02-12 12:08:17,891 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0007	CONTAINERID=container_1423771478362_0007_01_000001
2015-02-12 12:08:17,892 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0007_01_000001]
2015-02-12 12:08:17,892 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:17,892 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:17,892 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:08:17,892 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:17,893 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0007
2015-02-12 12:08:17,894 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0007
2015-02-12 12:08:17,894 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0007
2015-02-12 12:08:17,894 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:08:17,894 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0007, with delay of 10800 seconds
2015-02-12 12:08:17,895 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0007
2015-02-12 12:08:17,893 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0007
2015-02-12 12:08:18,178 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30006 milliseconds
2015-02-12 12:08:18,179 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(201)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 12:08:18,250 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:08:18,250 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:18,250 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:18,251 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0007
2015-02-12 12:08:18,251 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0007
2015-02-12 12:08:18,252 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0007
2015-02-12 12:08:18,252 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0007
2015-02-12 12:08:18,252 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0007
2015-02-12 12:08:18,252 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:08:18,252 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0007, with delay of 10800 seconds
2015-02-12 12:08:18,761 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55664 for container : container_1423771478362_0008_01_000002
2015-02-12 12:08:18,762 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:18,763 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:18,764 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55677 for container : container_1423771478362_0008_01_000004
2015-02-12 12:08:18,764 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:18,765 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:18,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:18,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:18,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:18,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:18,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:18,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:18,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:18,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:18,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:18,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:18,897 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:18,897 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:18,902 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:18,902 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:18,903 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:18,903 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:18,907 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0008_01_000004 by user soberoi
2015-02-12 12:08:18,907 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0008
2015-02-12 12:08:18,907 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0008_01_000002 by user soberoi
2015-02-12 12:08:18,908 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0008_01_000003 by user soberoi
2015-02-12 12:08:18,908 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000004
2015-02-12 12:08:18,908 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000003
2015-02-12 12:08:18,908 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0008_01_000002 to application application_1423771478362_0008
2015-02-12 12:08:18,908 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000002
2015-02-12 12:08:18,908 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0008 transitioned from NEW to INITING
2015-02-12 12:08:18,909 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0008_01_000004 to application application_1423771478362_0008
2015-02-12 12:08:18,909 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0008 transitioned from INITING to RUNNING
2015-02-12 12:08:18,909 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 12:08:18,910 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0008
2015-02-12 12:08:18,910 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0008
2015-02-12 12:08:18,910 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:18,908 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0008_01_000005 by user soberoi
2015-02-12 12:08:18,910 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000005
2015-02-12 12:08:18,910 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0008
2015-02-12 12:08:18,911 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:08:18,911 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:08:18,911 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0008_01_000005 to application application_1423771478362_0008
2015-02-12 12:08:18,911 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0008_01_000004
2015-02-12 12:08:18,908 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0008_01_000003 to application application_1423771478362_0008
2015-02-12 12:08:18,912 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 12:08:18,912 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 12:08:18,912 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0008
2015-02-12 12:08:18,913 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0008
2015-02-12 12:08:18,913 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:18,913 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0008
2015-02-12 12:08:18,913 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0008
2015-02-12 12:08:18,914 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0008
2015-02-12 12:08:18,914 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:18,914 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0008
2015-02-12 12:08:18,915 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:18,915 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:18,915 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 12:08:18,916 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0008
2015-02-12 12:08:18,916 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0008
2015-02-12 12:08:18,916 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:18,916 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0008
2015-02-12 12:08:18,916 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0008_01_000005
2015-02-12 12:08:18,944 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423771478362_0008_01_000004.tokens. Credentials list: 
2015-02-12 12:08:18,946 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423771478362_0008_01_000005.tokens. Credentials list: 
2015-02-12 12:08:18,971 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:18,972 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:18,973 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:18,973 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:19,106 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:19,118 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000003/default_container_executor.sh]
2015-02-12 12:08:19,119 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000002/default_container_executor.sh]
2015-02-12 12:08:19,251 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:19,251 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:19,255 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:19,264 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423771478362_0008_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000004.tokens
2015-02-12 12:08:19,265 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0008
2015-02-12 12:08:19,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:19,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:19,388 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423771478362_0008_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000005.tokens
2015-02-12 12:08:19,389 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0008
2015-02-12 12:08:19,444 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0008/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:19,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:19,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:19,529 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0008/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:19,529 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:19,529 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:19,582 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:19,582 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:19,582 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:19,582 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:19,709 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083
2015-02-12 12:08:19,710 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081
2015-02-12 12:08:19,711 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089
2015-02-12 12:08:19,711 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082
2015-02-12 12:08:19,711 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088
2015-02-12 12:08:19,712 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078
2015-02-12 12:08:19,713 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085
2015-02-12 12:08:19,714 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084
2015-02-12 12:08:19,718 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741908_1084
2015-02-12 12:08:19,719 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087
2015-02-12 12:08:19,720 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741909_1085
2015-02-12 12:08:19,720 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741905_1081
2015-02-12 12:08:19,721 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089
2015-02-12 12:08:19,722 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741902_1078
2015-02-12 12:08:19,722 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741906_1082
2015-02-12 12:08:19,722 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080
2015-02-12 12:08:19,736 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000005/default_container_executor.sh]
2015-02-12 12:08:19,737 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000004/default_container_executor.sh]
2015-02-12 12:08:19,778 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:08:19,883 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:19,883 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:19,898 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:19,898 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:19,917 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086
2015-02-12 12:08:19,917 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741904_1080
2015-02-12 12:08:19,918 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087
2015-02-12 12:08:19,924 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086
2015-02-12 12:08:19,924 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741907_1083
2015-02-12 12:08:20,408 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087
2015-02-12 12:08:20,410 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086
2015-02-12 12:08:20,410 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088
2015-02-12 12:08:21,877 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741913_1089
2015-02-12 12:08:21,878 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741911_1087
2015-02-12 12:08:21,878 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741912_1088
2015-02-12 12:08:22,078 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741910_1086
2015-02-12 12:08:24,922 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090
2015-02-12 12:08:24,928 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090
2015-02-12 12:08:25,419 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741914_1090
2015-02-12 12:08:25,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:25,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:25,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/_temporary/attempt_1423771478362_0008_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,553 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:26,555 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0008_01_000002
2015-02-12 12:08:26,555 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000002
2015-02-12 12:08:26,556 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000002 transitioned from RUNNING to KILLING
2015-02-12 12:08:26,556 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0008_01_000002
2015-02-12 12:08:26,572 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1.jhist. BP-1120419527-10.1.1.68-1423771456695 blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:08:26,575 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741915_1091 src: /127.0.0.1:57045 dest: /127.0.0.1:55529
2015-02-12 12:08:26,577 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741915_1091 src: /127.0.0.1:57046 dest: /127.0.0.1:55522
2015-02-12 12:08:26,579 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0008_01_000002 is : 143
2015-02-12 12:08:26,580 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741915_1091 src: /127.0.0.1:57047 dest: /127.0.0.1:55526
2015-02-12 12:08:26,587 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:26,588 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000002
2015-02-12 12:08:26,588 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000002
2015-02-12 12:08:26,589 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000002
2015-02-12 12:08:26,589 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000002
2015-02-12 12:08:26,589 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000002
2015-02-12 12:08:26,589 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:26,589 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0008_01_000002 from application application_1423771478362_0008
2015-02-12 12:08:26,589 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:26,589 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0008
2015-02-12 12:08:26,589 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4450)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1.jhist for DFSClient_NONMAPREDUCE_1015806188_1
2015-02-12 12:08:26,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/_temporary/attempt_1423771478362_0008_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,717 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:26,719 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0008_01_000003
2015-02-12 12:08:26,719 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000003
2015-02-12 12:08:26,719 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000003 transitioned from RUNNING to KILLING
2015-02-12 12:08:26,719 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0008_01_000003
2015-02-12 12:08:26,720 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:26,720 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0008_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 12:08:26,720 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000002
2015-02-12 12:08:26,720 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 12:08:26,720 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-02-12 12:08:26,721 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0008_01_000002, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:26,721 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:26,721 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:08:26,722 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0008_000001 released container container_1423771478362_0008_01_000002 on node: host: 10.1.1.68:55664 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 12:08:26,737 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0008_01_000003 is : 143
2015-02-12 12:08:26,749 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:26,751 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000003
2015-02-12 12:08:26,752 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000003
2015-02-12 12:08:26,753 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000003
2015-02-12 12:08:26,753 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000003
2015-02-12 12:08:26,754 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000003
2015-02-12 12:08:26,755 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:26,755 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0008_01_000003 from application application_1423771478362_0008
2015-02-12 12:08:26,755 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:26,755 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0008
2015-02-12 12:08:26,758 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/_temporary/attempt_1423771478362_0008_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,774 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:26,801 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0008_01_000004
2015-02-12 12:08:26,801 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000004
2015-02-12 12:08:26,802 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000004 transitioned from RUNNING to KILLING
2015-02-12 12:08:26,802 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0008_01_000004
2015-02-12 12:08:26,821 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0008_01_000004 is : 143
2015-02-12 12:08:26,837 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:26,838 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000004
2015-02-12 12:08:26,838 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000004
2015-02-12 12:08:26,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000004
2015-02-12 12:08:26,840 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000004
2015-02-12 12:08:26,840 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000004
2015-02-12 12:08:26,841 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:26,843 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0008_01_000004 from application application_1423771478362_0008
2015-02-12 12:08:26,843 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:26,844 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0008
2015-02-12 12:08:26,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/_temporary/attempt_1423771478362_0008_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:26,934 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:26,936 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0008_01_000005
2015-02-12 12:08:26,937 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000005
2015-02-12 12:08:26,937 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000005 transitioned from RUNNING to KILLING
2015-02-12 12:08:26,937 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0008_01_000005
2015-02-12 12:08:26,937 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:26,938 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0008_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 12:08:26,938 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000004
2015-02-12 12:08:26,938 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 12:08:26,938 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-02-12 12:08:26,939 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0008_01_000004, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:26,939 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:26,940 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:08:26,940 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0008_000001 released container container_1423771478362_0008_01_000004 on node: host: 10.1.1.68:55677 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 12:08:26,951 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0008_01_000005 is : 143
2015-02-12 12:08:26,963 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:26,964 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000005
2015-02-12 12:08:26,964 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000005
2015-02-12 12:08:26,964 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:26,964 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000005
2015-02-12 12:08:26,965 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000005
2015-02-12 12:08:26,965 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000005
2015-02-12 12:08:26,964 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0008_01_000005 from application application_1423771478362_0008
2015-02-12 12:08:26,966 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:26,966 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0008
2015-02-12 12:08:27,723 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:27,723 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:27,723 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0008_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 12:08:27,724 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000003
2015-02-12 12:08:27,724 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 12:08:27,724 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-02-12 12:08:27,725 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0008_01_000003, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:27,725 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:27,725 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:08:27,726 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0008_000001 released container container_1423771478362_0008_01_000003 on node: host: 10.1.1.68:55664 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 12:08:27,941 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:27,941 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:27,941 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0008_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 12:08:27,941 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000005
2015-02-12 12:08:27,941 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:08:27,942 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:08:27,942 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0008_01_000005, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:27,943 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:27,943 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:08:27,943 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0008_000001 released container container_1423771478362_0008_01_000005 on node: host: 10.1.1.68:55677 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:08:27,944 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:27,944 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000006
2015-02-12 12:08:27,944 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:08:27,944 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0008_000001 container=Container: [ContainerId: container_1423771478362_0008_01_000006, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 10, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:27,944 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:08:27,945 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:28,726 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0008_01_000002]
2015-02-12 12:08:28,726 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:28,726 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:28,814 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:28,824 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:28,826 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0008_01_000006 by user soberoi
2015-02-12 12:08:28,827 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000006
2015-02-12 12:08:28,827 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0008_01_000006 to application application_1423771478362_0008
2015-02-12 12:08:28,827 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 12:08:28,827 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0008
2015-02-12 12:08:28,827 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0008
2015-02-12 12:08:28,827 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:28,827 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0008
2015-02-12 12:08:28,828 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:28,857 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:28,858 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:28,941 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0008_01_000004]
2015-02-12 12:08:28,942 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:28,942 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:28,942 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:28,994 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000006/default_container_executor.sh]
2015-02-12 12:08:29,728 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0008_01_000003]
2015-02-12 12:08:29,729 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:29,817 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:08:29,946 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0008_01_000005]
2015-02-12 12:08:29,947 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:31,305 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:08:31,306 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:08:31,319 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:08:31,320 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:08:31,531 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(691)) - Number of transactions: 762 Total time for transactions(ms): 82 Number of transactions batched in Syncs: 1 Number of syncs: 509 SyncTimes(ms): 19 6 
2015-02-12 12:08:31,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/_temporary/attempt_1423771478362_0008_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:31,592 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/_temporary/attempt_1423771478362_0008_r_000000_0/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:08:31,670 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092 src: /127.0.0.1:57058 dest: /127.0.0.1:55519
2015-02-12 12:08:31,672 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092 src: /127.0.0.1:57059 dest: /127.0.0.1:55529
2015-02-12 12:08:31,673 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092 src: /127.0.0.1:57060 dest: /127.0.0.1:55522
2015-02-12 12:08:31,706 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57060, dest: /127.0.0.1:55522, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0008_r_000000_0_1295731145_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092, duration: 31496000
2015-02-12 12:08:31,707 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:31,708 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:08:31,708 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57059, dest: /127.0.0.1:55529, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0008_r_000000_0_1295731145_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092, duration: 32241000
2015-02-12 12:08:31,708 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:31,709 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57058, dest: /127.0.0.1:55519, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0008_r_000000_0_1295731145_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092, duration: 33663000
2015-02-12 12:08:31,709 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:31,711 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:08:31,711 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:31,715 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/_temporary/attempt_1423771478362_0008_r_000000_0/part-00000 is closed by DFSClient_attempt_1423771478362_0008_r_000000_0_1295731145_1
2015-02-12 12:08:31,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/_temporary/attempt_1423771478362_0008_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/_temporary/attempt_1423771478362_0008_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/task_1423771478362_0008_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/_temporary/attempt_1423771478362_0008_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/task_1423771478362_0008_r_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:31,750 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:31,752 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0008_01_000006
2015-02-12 12:08:31,752 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000006
2015-02-12 12:08:31,752 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000006 transitioned from RUNNING to KILLING
2015-02-12 12:08:31,753 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0008_01_000006
2015-02-12 12:08:31,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:31,769 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1015806188_1
2015-02-12 12:08:31,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,781 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0008_01_000006 is : 143
2015-02-12 12:08:31,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/task_1423771478362_0008_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary/1/task_1423771478362_0008_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:31,794 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:31,794 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000006
2015-02-12 12:08:31,795 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000006
2015-02-12 12:08:31,795 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:31,795 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0008_01_000006 from application application_1423771478362_0008
2015-02-12 12:08:31,795 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:31,795 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0008
2015-02-12 12:08:31,796 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000006
2015-02-12 12:08:31,796 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000006
2015-02-12 12:08:31,796 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000006
2015-02-12 12:08:31,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:31,804 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1015806188_1
2015-02-12 12:08:31,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:31,809 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1015806188_1
2015-02-12 12:08:31,831 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57047, dest: /127.0.0.1:55526, bytes: 61276, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741915_1091, duration: 5246289000
2015-02-12 12:08:31,832 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741915_1091, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:31,833 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 15684
2015-02-12 12:08:31,833 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57046, dest: /127.0.0.1:55522, bytes: 61276, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741915_1091, duration: 5246636000
2015-02-12 12:08:31,833 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:31,835 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 15684
2015-02-12 12:08:31,835 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57045, dest: /127.0.0.1:55529, bytes: 61276, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741915_1091, duration: 5249786000
2015-02-12 12:08:31,835 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:31,836 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 15684
2015-02-12 12:08:31,837 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1.jhist is closed by DFSClient_NONMAPREDUCE_1015806188_1
2015-02-12 12:08:31,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:31,843 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008.summary_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:08:31,845 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093 src: /127.0.0.1:57062 dest: /127.0.0.1:55529
2015-02-12 12:08:31,847 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093 src: /127.0.0.1:57063 dest: /127.0.0.1:55522
2015-02-12 12:08:31,848 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093 src: /127.0.0.1:57064 dest: /127.0.0.1:55526
2015-02-12 12:08:31,858 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57064, dest: /127.0.0.1:55526, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093, duration: 7578000
2015-02-12 12:08:31,858 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:31,859 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57063, dest: /127.0.0.1:55522, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093, duration: 8369000
2015-02-12 12:08:31,859 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:31,859 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:31,861 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57062, dest: /127.0.0.1:55529, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093, duration: 5685000
2015-02-12 12:08:31,861 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:31,863 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:31,863 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:31,864 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008.summary_tmp is closed by DFSClient_NONMAPREDUCE_1015806188_1
2015-02-12 12:08:31,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:31,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008-1423771692683-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F8AAA6B21FDD343C0-1423771711811-4-1-SUCCEEDED-default-1423771696732.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008-1423771692683-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F8AAA6B21FDD343C0-1423771711811-4-1-SUCCEEDED-default-1423771696732.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008-1423771692683-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F8AAA6B21FDD343C0-1423771711811-4-1-SUCCEEDED-default-1423771696732.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:31,896 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008-1423771692683-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F8AAA6B21FDD343C0-1423771711811-4-1-SUCCEEDED-default-1423771696732.jhist_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:08:31,898 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094 src: /127.0.0.1:57066 dest: /127.0.0.1:55522
2015-02-12 12:08:31,900 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094 src: /127.0.0.1:57067 dest: /127.0.0.1:55529
2015-02-12 12:08:31,902 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094 src: /127.0.0.1:57068 dest: /127.0.0.1:55526
2015-02-12 12:08:31,908 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57068, dest: /127.0.0.1:55526, bytes: 61276, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094, duration: 3805000
2015-02-12 12:08:31,908 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:31,910 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57067, dest: /127.0.0.1:55529, bytes: 61276, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094, duration: 5036000
2015-02-12 12:08:31,910 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:31,911 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57066, dest: /127.0.0.1:55522, bytes: 61276, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094, duration: 7010000
2015-02-12 12:08:31,912 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:31,911 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:08:31,912 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:31,913 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:31,915 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008-1423771692683-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F8AAA6B21FDD343C0-1423771711811-4-1-SUCCEEDED-default-1423771696732.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1015806188_1
2015-02-12 12:08:31,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008-1423771692683-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F8AAA6B21FDD343C0-1423771711811-4-1-SUCCEEDED-default-1423771696732.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:31,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008/job_1423771478362_0008_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:31,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:31,931 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008_conf.xml_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:08:31,934 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095 src: /127.0.0.1:57070 dest: /127.0.0.1:55526
2015-02-12 12:08:31,936 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095 src: /127.0.0.1:57071 dest: /127.0.0.1:55522
2015-02-12 12:08:31,938 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095 src: /127.0.0.1:57072 dest: /127.0.0.1:55519
2015-02-12 12:08:31,942 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57072, dest: /127.0.0.1:55519, bytes: 115754, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095, duration: 1966000
2015-02-12 12:08:31,942 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:31,943 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:31,943 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57071, dest: /127.0.0.1:55522, bytes: 115754, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095, duration: 2667000
2015-02-12 12:08:31,943 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:31,943 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:31,944 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57070, dest: /127.0.0.1:55526, bytes: 115754, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1015806188_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095, duration: 3636000
2015-02-12 12:08:31,944 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:31,944 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:31,946 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1015806188_1
2015-02-12 12:08:31,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:31,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:31,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:31,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008-1423771692683-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F8AAA6B21FDD343C0-1423771711811-4-1-SUCCEEDED-default-1423771696732.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0008-1423771692683-soberoi-%5BE1F1A5DA35464F33B8F07A32B761380A%2F8AAA6B21FDD343C0-1423771711811-4-1-SUCCEEDED-default-1423771696732.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:31,962 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1129)) - Updating application attempt appattempt_1423771478362_0008_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 12:08:31,962 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0008_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 12:08:31,962 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(992)) - Updating application application_1423771478362_0008 with final state: FINISHING
2015-02-12 12:08:31,962 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0008 State change from RUNNING to FINAL_SAVING
2015-02-12 12:08:31,963 INFO  recovery.RMStateStore (RMStateStore.java:transition(161)) - Updating info for app: application_1423771478362_0008
2015-02-12 12:08:31,964 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0008_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 12:08:31,964 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0008 State change from FINAL_SAVING to FINISHING
2015-02-12 12:08:32,758 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:32,758 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0008_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 12:08:32,759 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000006
2015-02-12 12:08:32,759 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55677, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:08:32,759 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:08:32,763 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0008_01_000006, NodeId: 10.1.1.68:55677, NodeHttpAddress: 10.1.1.68:55680, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.68:55677 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:32,763 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:32,763 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:08:32,763 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0008_000001 released container container_1423771478362_0008_01_000006 on node: host: 10.1.1.68:55677 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:08:32,966 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(351)) - application_1423771478362_0008 unregistered successfully. 
2015-02-12 12:08:32,969 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741910_1086 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55522 127.0.0.1:55529 
2015-02-12 12:08:32,969 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741911_1087 127.0.0.1:55529 127.0.0.1:55522 127.0.0.1:55526 127.0.0.1:55519 
2015-02-12 12:08:32,969 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741912_1088 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55526 
2015-02-12 12:08:32,970 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741913_1089 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:08:32,970 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741915_1091 127.0.0.1:55529 127.0.0.1:55522 127.0.0.1:55526 
2015-02-12 12:08:32,970 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741914_1090 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:08:32,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0008	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,009 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741902_1078 127.0.0.1:55526 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:08:33,010 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741904_1080 127.0.0.1:55519 127.0.0.1:55522 127.0.0.1:55529 
2015-02-12 12:08:33,010 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741906_1082 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:08:33,010 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741905_1081 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55522 
2015-02-12 12:08:33,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/4767548493_test_FF5F36EF6BB243F7AFFF122286ED48C3	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,014 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary
2015-02-12 12:08:33,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,030 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 12:08:33,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,033 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/simplecheckpoint
2015-02-12 12:08:33,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/simplecheckpoint/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,056 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 12:08:33,056 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 12:08:33,061 INFO  planner.FlowPlanner (FlowPlanner.java:insertTempTapAfter(642)) - found checkpoint: checkpoint, using tap: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap"]
2015-02-12 12:08:33,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,084 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [] starting
2015-02-12 12:08:33,084 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-02-12 12:08:33,084 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink"]
2015-02-12 12:08:33,084 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  parallel execution is enabled: true
2015-02-12 12:08:33,084 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  starting jobs: 2
2015-02-12 12:08:33,084 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  allocating threads: 2
2015-02-12 12:08:33,086 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] starting step: (1/2) ...ntplatform/checkpoint/tap
2015-02-12 12:08:33,098 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:08:33,109 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:08:33,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,115 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(286)) - Allocated new applicationId: 9
2015-02-12 12:08:33,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 12:08:33,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 12:08:33,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:33,124 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:08:33,125 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096 src: /127.0.0.1:57077 dest: /127.0.0.1:55522
2015-02-12 12:08:33,127 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096 src: /127.0.0.1:57078 dest: /127.0.0.1:55529
2015-02-12 12:08:33,128 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096 src: /127.0.0.1:57079 dest: /127.0.0.1:55519
2015-02-12 12:08:33,132 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57079, dest: /127.0.0.1:55519, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096, duration: 1965000
2015-02-12 12:08:33,133 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:33,133 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:08:33,133 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57078, dest: /127.0.0.1:55529, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096, duration: 2383000
2015-02-12 12:08:33,134 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:33,134 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:08:33,134 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57077, dest: /127.0.0.1:55522, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096, duration: 3850000
2015-02-12 12:08:33,135 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:33,136 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:08:33,137 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:33,138 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar
2015-02-12 12:08:33,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:33,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,150 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 12:08:33,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:33,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:33,155 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split
2015-02-12 12:08:33,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,158 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split. BP-1120419527-10.1.1.68-1423771456695 blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:08:33,161 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097 src: /127.0.0.1:57080 dest: /127.0.0.1:55519
2015-02-12 12:08:33,163 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097 src: /127.0.0.1:57081 dest: /127.0.0.1:55522
2015-02-12 12:08:33,164 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097 src: /127.0.0.1:57082 dest: /127.0.0.1:55529
2015-02-12 12:08:33,166 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097 src: /127.0.0.1:57083 dest: /127.0.0.1:55526
2015-02-12 12:08:33,169 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57083, dest: /127.0.0.1:55526, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097, duration: 1906000
2015-02-12 12:08:33,169 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:33,170 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:08:33,171 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57082, dest: /127.0.0.1:55529, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097, duration: 2107000
2015-02-12 12:08:33,171 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:33,172 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57081, dest: /127.0.0.1:55522, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097, duration: 3784000
2015-02-12 12:08:33,172 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:33,172 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:33,174 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57080, dest: /127.0.0.1:55519, bytes: 1439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097, duration: 5450000
2015-02-12 12:08:33,174 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:33,174 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:33,175 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:33,176 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:33,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:33,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:33,181 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo. BP-1120419527-10.1.1.68-1423771456695 blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:08:33,183 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098 src: /127.0.0.1:57084 dest: /127.0.0.1:55526
2015-02-12 12:08:33,185 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098 src: /127.0.0.1:57085 dest: /127.0.0.1:55529
2015-02-12 12:08:33,187 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098 src: /127.0.0.1:57086 dest: /127.0.0.1:55522
2015-02-12 12:08:33,190 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57086, dest: /127.0.0.1:55522, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098, duration: 1640000
2015-02-12 12:08:33,191 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:33,191 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:08:33,191 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57085, dest: /127.0.0.1:55529, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098, duration: 2171000
2015-02-12 12:08:33,192 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:33,193 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57084, dest: /127.0.0.1:55526, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098, duration: 3429000
2015-02-12 12:08:33,193 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:33,193 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:33,195 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:33,196 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:33,196 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:4
2015-02-12 12:08:33,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:33,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:33,226 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:08:33,228 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099 src: /127.0.0.1:57087 dest: /127.0.0.1:55522
2015-02-12 12:08:33,229 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099 src: /127.0.0.1:57088 dest: /127.0.0.1:55529
2015-02-12 12:08:33,231 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099 src: /127.0.0.1:57089 dest: /127.0.0.1:55526
2015-02-12 12:08:33,235 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57089, dest: /127.0.0.1:55526, bytes: 97703, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099, duration: 2204000
2015-02-12 12:08:33,235 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:33,235 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:33,236 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57088, dest: /127.0.0.1:55529, bytes: 97703, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099, duration: 2528000
2015-02-12 12:08:33,236 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:33,237 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57087, dest: /127.0.0.1:55522, bytes: 97703, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099, duration: 3850000
2015-02-12 12:08:33,237 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:33,237 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:33,241 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:33,242 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:33,243 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_1423771478362_0009
2015-02-12 12:08:33,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,251 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,264 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(577)) - Application with id 9 submitted by user soberoi
2015-02-12 12:08:33,264 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(973)) - Storing application with id application_1423771478362_0009
2015-02-12 12:08:33,264 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	IP=10.1.1.68	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423771478362_0009
2015-02-12 12:08:33,264 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423771478362_0009
2015-02-12 12:08:33,264 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0009 State change from NEW to NEW_SAVING
2015-02-12 12:08:33,264 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0009 State change from NEW_SAVING to SUBMITTED
2015-02-12 12:08:33,265 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(386)) - Application added - appId: application_1423771478362_0009 user: soberoi leaf-queue of parent: root #applications: 2
2015-02-12 12:08:33,265 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(716)) - Accepted application application_1423771478362_0009 from user: soberoi, in queue: default
2015-02-12 12:08:33,265 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0009 State change from SUBMITTED to ACCEPTED
2015-02-12 12:08:33,265 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(251)) - Submitted application application_1423771478362_0009
2015-02-12 12:08:33,265 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(670)) - Registering app attempt : appattempt_1423771478362_0009_000001
2015-02-12 12:08:33,265 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0009_000001 State change from NEW to SUBMITTED
2015-02-12 12:08:33,266 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(626)) - Application application_1423771478362_0009 from user: soberoi activated in queue: default
2015-02-12 12:08:33,266 INFO  capacity.LeafQueue (LeafQueue.java:addApplicationAttempt(643)) - Application added - appId: application_1423771478362_0009 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@35816f1c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-02-12 12:08:33,266 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplicationAttempt(746)) - Added Application Attempt appattempt_1423771478362_0009_000001 to scheduler from user soberoi in queue default
2015-02-12 12:08:33,267 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0009_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 12:08:33,269 INFO  mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://Edinburgh.local:55663/proxy/application_1423771478362_0009/
2015-02-12 12:08:33,269 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] submitted hadoop job: job_1423771478362_0009
2015-02-12 12:08:33,269 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] tracking url: http://Edinburgh.local:55663/proxy/application_1423771478362_0009/
2015-02-12 12:08:33,289 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:33,289 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000001
2015-02-12 12:08:33,289 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55673, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 12:08:33,290 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0009_000001 container=Container: [ContainerId: container_1423771478362_0009_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:33,290 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-02-12 12:08:33,290 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:33,291 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55673 for container : container_1423771478362_0009_01_000001
2015-02-12 12:08:33,291 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:33,292 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423771478362_0009_000001
2015-02-12 12:08:33,292 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1837)) - Storing attempt: AppId: application_1423771478362_0009 AttemptId: appattempt_1423771478362_0009_000001 MasterContainer: Container: [ContainerId: container_1423771478362_0009_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ]
2015-02-12 12:08:33,292 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0009_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 12:08:33,292 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0009_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 12:08:33,292 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423771478362_0009_000001
2015-02-12 12:08:33,294 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423771478362_0009_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] for AM appattempt_1423771478362_0009_000001
2015-02-12 12:08:33,294 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423771478362_0009_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 12:08:33,294 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423771478362_0009_000001
2015-02-12 12:08:33,295 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423771478362_0009_000001
2015-02-12 12:08:33,297 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0009_000001 (auth:SIMPLE)
2015-02-12 12:08:33,299 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0009_01_000001 by user soberoi
2015-02-12 12:08:33,299 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0009
2015-02-12 12:08:33,300 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000001
2015-02-12 12:08:33,300 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0009 transitioned from NEW to INITING
2015-02-12 12:08:33,300 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0009_01_000001 to application application_1423771478362_0009
2015-02-12 12:08:33,300 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423771478362_0009_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] for AM appattempt_1423771478362_0009_000001
2015-02-12 12:08:33,300 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0009 transitioned from INITING to RUNNING
2015-02-12 12:08:33,300 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0009_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 12:08:33,301 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 12:08:33,301 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0009
2015-02-12 12:08:33,301 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:08:33,301 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 12:08:33,301 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split transitioned from INIT to DOWNLOADING
2015-02-12 12:08:33,301 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:08:33,302 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0009_01_000001
2015-02-12 12:08:33,313 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423771478362_0009_01_000001.tokens. Credentials list: 
2015-02-12 12:08:33,412 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:33,471 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1492)) - BLOCK* ask 127.0.0.1:55522 to replicate blk_1073741920_1096 to datanode(s) 127.0.0.1:55526
2015-02-12 12:08:33,471 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741910_1086, blk_1073741911_1087, blk_1073741912_1088, blk_1073741914_1090, blk_1073741915_1091, blk_1073741902_1078]
2015-02-12 12:08:33,471 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55529 to delete [blk_1073741904_1080, blk_1073741905_1081, blk_1073741906_1082, blk_1073741910_1086, blk_1073741911_1087, blk_1073741912_1088, blk_1073741913_1089, blk_1073741915_1091]
2015-02-12 12:08:33,488 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423771478362_0009_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000001.tokens
2015-02-12 12:08:33,488 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0009
2015-02-12 12:08:33,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,597 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0009/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:33,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,645 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0009/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:33,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,695 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0009/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:33,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:33,745 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0009/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:33,745 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:33,760 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:33,778 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:33,778 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:33,870 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000001/default_container_executor.sh]
2015-02-12 12:08:34,159 INFO  datanode.DataNode (DataNode.java:transferBlock(1812)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, infoPort=55523, ipcPort=55525, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) Starting thread to transfer BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096 to 127.0.0.1:55526 
2015-02-12 12:08:34,160 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096 src: /127.0.0.1:57094 dest: /127.0.0.1:55526
2015-02-12 12:08:34,161 INFO  datanode.DataNode (DataNode.java:run(2020)) - DataTransfer: Transmitted BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096 (numBytes=254067) to /127.0.0.1:55526
2015-02-12 12:08:34,162 INFO  datanode.DataNode (DataXceiver.java:writeBlock(755)) - Received BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096 src: /127.0.0.1:57094 dest: /127.0.0.1:55526 of size 254067
2015-02-12 12:08:34,162 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741920_1096 size 254067
2015-02-12 12:08:34,294 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:34,473 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741910 for deletion
2015-02-12 12:08:34,473 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741911 for deletion
2015-02-12 12:08:34,473 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741912 for deletion
2015-02-12 12:08:34,473 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741914 for deletion
2015-02-12 12:08:34,473 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741911
2015-02-12 12:08:34,473 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741915 for deletion
2015-02-12 12:08:34,473 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741902 for deletion
2015-02-12 12:08:34,473 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741914
2015-02-12 12:08:34,473 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741910
2015-02-12 12:08:34,474 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741902
2015-02-12 12:08:34,474 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741912
2015-02-12 12:08:34,474 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741915
2015-02-12 12:08:34,763 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:35,765 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:35,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:08:35,858 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741904 for deletion
2015-02-12 12:08:35,858 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741905 for deletion
2015-02-12 12:08:35,859 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741906 for deletion
2015-02-12 12:08:35,859 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741904
2015-02-12 12:08:35,859 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741910 for deletion
2015-02-12 12:08:35,859 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741905
2015-02-12 12:08:35,859 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741911 for deletion
2015-02-12 12:08:35,859 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741906
2015-02-12 12:08:35,859 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741910
2015-02-12 12:08:35,859 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741911
2015-02-12 12:08:35,859 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741912 for deletion
2015-02-12 12:08:35,860 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741913 for deletion
2015-02-12 12:08:35,860 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741915 for deletion
2015-02-12 12:08:35,860 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741912
2015-02-12 12:08:35,860 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741913
2015-02-12 12:08:35,861 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741915
2015-02-12 12:08:35,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 12:08:35,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 12:08:35,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 12:08:35,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009	dst=null	perm=null	proto=rpc
2015-02-12 12:08:35,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:08:35,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:08:36,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:36,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:36,476 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741904_1080, blk_1073741905_1081, blk_1073741906_1082, blk_1073741910_1086, blk_1073741911_1087, blk_1073741913_1089, blk_1073741914_1090, blk_1073741915_1091, blk_1073741902_1078]
2015-02-12 12:08:36,476 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55519 to delete [blk_1073741904_1080, blk_1073741905_1081, blk_1073741906_1082, blk_1073741910_1086, blk_1073741911_1087, blk_1073741912_1088, blk_1073741913_1089, blk_1073741914_1090, blk_1073741902_1078]
2015-02-12 12:08:36,769 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:37,093 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094
2015-02-12 12:08:37,094 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092
2015-02-12 12:08:37,094 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093
2015-02-12 12:08:37,161 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741904 for deletion
2015-02-12 12:08:37,161 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741905 for deletion
2015-02-12 12:08:37,162 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741906 for deletion
2015-02-12 12:08:37,162 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741910 for deletion
2015-02-12 12:08:37,162 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741904
2015-02-12 12:08:37,162 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741906
2015-02-12 12:08:37,162 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741910
2015-02-12 12:08:37,163 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741905
2015-02-12 12:08:37,162 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741911 for deletion
2015-02-12 12:08:37,163 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741912 for deletion
2015-02-12 12:08:37,163 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741913 for deletion
2015-02-12 12:08:37,163 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741914 for deletion
2015-02-12 12:08:37,163 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741902 for deletion
2015-02-12 12:08:37,163 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741904 for deletion
2015-02-12 12:08:37,164 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741911
2015-02-12 12:08:37,164 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741912
2015-02-12 12:08:37,164 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741914
2015-02-12 12:08:37,164 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741905 for deletion
2015-02-12 12:08:37,165 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741906 for deletion
2015-02-12 12:08:37,165 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741902
2015-02-12 12:08:37,164 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741913
2015-02-12 12:08:37,164 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741904
2015-02-12 12:08:37,165 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741905
2015-02-12 12:08:37,165 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741906
2015-02-12 12:08:37,165 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741910 for deletion
2015-02-12 12:08:37,165 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741911 for deletion
2015-02-12 12:08:37,166 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741913 for deletion
2015-02-12 12:08:37,166 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741914 for deletion
2015-02-12 12:08:37,166 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741915 for deletion
2015-02-12 12:08:37,166 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741902 for deletion
2015-02-12 12:08:37,166 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741910
2015-02-12 12:08:37,167 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741911
2015-02-12 12:08:37,167 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741913
2015-02-12 12:08:37,167 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741915
2015-02-12 12:08:37,167 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741914
2015-02-12 12:08:37,167 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741902
2015-02-12 12:08:37,217 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0009_000001 (auth:SIMPLE)
2015-02-12 12:08:37,218 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(274)) - AM registration appattempt_1423771478362_0009_000001
2015-02-12 12:08:37,218 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(127)) - USER=soberoi	IP=10.1.1.68	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423771478362_0009	APPATTEMPTID=appattempt_1423771478362_0009_000001
2015-02-12 12:08:37,219 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0009_000001 State change from LAUNCHED to RUNNING
2015-02-12 12:08:37,219 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0009 State change from ACCEPTED to RUNNING
2015-02-12 12:08:37,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:37,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:37,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:37,503 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1_conf.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:08:37,545 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100 src: /127.0.0.1:57102 dest: /127.0.0.1:55522
2015-02-12 12:08:37,548 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100 src: /127.0.0.1:57103 dest: /127.0.0.1:55526
2015-02-12 12:08:37,550 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100 src: /127.0.0.1:57104 dest: /127.0.0.1:55529
2015-02-12 12:08:37,591 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57104, dest: /127.0.0.1:55529, bytes: 114682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100, duration: 36234000
2015-02-12 12:08:37,591 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:37,592 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:08:37,592 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57103, dest: /127.0.0.1:55526, bytes: 114682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100, duration: 37545000
2015-02-12 12:08:37,592 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:37,592 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:37,593 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57102, dest: /127.0.0.1:55522, bytes: 114682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100, duration: 38826000
2015-02-12 12:08:37,593 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:37,594 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:37,599 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-2072844285_1
2015-02-12 12:08:37,771 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:38,108 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(346)) - Container container_1423771478362_0008_01_000001 succeeded 
2015-02-12 12:08:38,108 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 12:08:38,108 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0008_01_000001
2015-02-12 12:08:38,122 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000001
2015-02-12 12:08:38,122 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000001
2015-02-12 12:08:38,123 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000001
2015-02-12 12:08:38,123 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0008/container_1423771478362_0008_01_000001
2015-02-12 12:08:38,123 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000001
2015-02-12 12:08:38,123 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0008_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 12:08:38,124 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0008_01_000001 from application application_1423771478362_0008
2015-02-12 12:08:38,124 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:38,124 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0008
2015-02-12 12:08:38,309 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:38,309 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000002
2015-02-12 12:08:38,309 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 12:08:38,309 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0009_000001 container=Container: [ContainerId: container_1423771478362_0009_01_000002, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:38,310 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-02-12 12:08:38,310 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:38,310 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:38,311 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000003
2015-02-12 12:08:38,311 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 12:08:38,311 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0009_000001 container=Container: [ContainerId: container_1423771478362_0009_01_000003, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:38,311 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-02-12 12:08:38,312 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:38,757 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0008_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:38,757 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(676)) - Unregistering app attempt : appattempt_1423771478362_0008_000001
2015-02-12 12:08:38,758 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0008_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 12:08:38,758 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000001
2015-02-12 12:08:38,758 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423771478362_0008_000001
2015-02-12 12:08:38,758 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55664, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:08:38,759 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0008_000001 State change from FINISHING to FINISHED
2015-02-12 12:08:38,759 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-02-12 12:08:38,759 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0008_01_000001, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:38,759 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0008 State change from FINISHING to FINISHED
2015-02-12 12:08:38,759 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:38,760 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423771478362_0008_000001
2015-02-12 12:08:38,760 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423771478362_0008
2015-02-12 12:08:38,761 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(179)) - appId=application_1423771478362_0008,name=[E1F1A5DA35464F33B8F07A32B761380A/8AAA6B21FDD343C08369A2CB4018341F] test/(2/2) ...platform/simplecheckpoint,user=soberoi,queue=default,state=FINISHED,trackingUrl=http://Edinburgh.local:55663/proxy/application_1423771478362_0008/jobhistory/job/job_1423771478362_0008,appMasterHost=10.1.1.68,startTime=1423771692683,finishTime=1423771711962,finalStatus=SUCCEEDED
2015-02-12 12:08:38,760 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-02-12 12:08:38,761 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0008_000001 released container container_1423771478362_0008_01_000001 on node: host: 10.1.1.68:55664 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:08:38,761 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:38,761 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000004
2015-02-12 12:08:38,762 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:08:38,762 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0009_000001 container=Container: [ContainerId: container_1423771478362_0009_01_000004, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:38,762 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4
2015-02-12 12:08:38,762 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:38,763 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:38,763 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000005
2015-02-12 12:08:38,763 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 12:08:38,763 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0009_000001 container=Container: [ContainerId: container_1423771478362_0009_01_000005, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:38,763 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-02-12 12:08:38,763 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:38,764 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplicationAttempt(785)) - Application Attempt appattempt_1423771478362_0008_000001 is done. finalState=FINISHED
2015-02-12 12:08:38,764 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423771478362_0008 requests cleared
2015-02-12 12:08:38,764 INFO  capacity.LeafQueue (LeafQueue.java:removeApplicationAttempt(686)) - Application removed - appId: application_1423771478362_0008 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-02-12 12:08:38,764 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(411)) - Application removed - appId: application_1423771478362_0008 user: soberoi leaf-queue of parent: root #applications: 1
2015-02-12 12:08:38,765 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0008_000001 (auth:SIMPLE)
2015-02-12 12:08:38,766 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0008_01_000001
2015-02-12 12:08:38,767 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0008	CONTAINERID=container_1423771478362_0008_01_000001
2015-02-12 12:08:38,767 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0008_01_000001]
2015-02-12 12:08:38,767 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:38,767 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:08:38,768 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0008
2015-02-12 12:08:38,768 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0008
2015-02-12 12:08:38,769 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0008
2015-02-12 12:08:38,769 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:08:38,769 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0008, with delay of 10800 seconds
2015-02-12 12:08:38,769 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0008
2015-02-12 12:08:38,769 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0008
2015-02-12 12:08:38,772 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:08:38,773 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:38,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423771478362_0008
2015-02-12 12:08:38,774 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0008
2015-02-12 12:08:38,774 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:08:38,774 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0008, with delay of 10800 seconds
2015-02-12 12:08:38,774 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423771478362_0008
2015-02-12 12:08:38,775 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423771478362_0008
2015-02-12 12:08:38,774 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423771478362_0008
2015-02-12 12:08:39,270 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55673 for container : container_1423771478362_0009_01_000002
2015-02-12 12:08:39,271 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:39,272 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:39,272 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55664 for container : container_1423771478362_0009_01_000004
2015-02-12 12:08:39,273 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:39,274 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:39,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,406 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0009_000001 (auth:SIMPLE)
2015-02-12 12:08:39,406 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0009_000001 (auth:SIMPLE)
2015-02-12 12:08:39,407 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0009_000001 (auth:SIMPLE)
2015-02-12 12:08:39,407 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0009_000001 (auth:SIMPLE)
2015-02-12 12:08:39,410 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0009_01_000002 by user soberoi
2015-02-12 12:08:39,411 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000002
2015-02-12 12:08:39,411 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0009_01_000002 to application application_1423771478362_0009
2015-02-12 12:08:39,411 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 12:08:39,412 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0009
2015-02-12 12:08:39,412 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0009
2015-02-12 12:08:39,412 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:39,412 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0009
2015-02-12 12:08:39,412 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0009_01_000005 by user soberoi
2015-02-12 12:08:39,412 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0009
2015-02-12 12:08:39,412 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000005
2015-02-12 12:08:39,412 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:39,413 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0009 transitioned from NEW to INITING
2015-02-12 12:08:39,413 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0009_01_000005 to application application_1423771478362_0009
2015-02-12 12:08:39,413 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0009 transitioned from INITING to RUNNING
2015-02-12 12:08:39,414 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 12:08:39,414 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0009
2015-02-12 12:08:39,414 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0009
2015-02-12 12:08:39,414 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:39,414 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0009
2015-02-12 12:08:39,414 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:08:39,414 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0009_01_000003 by user soberoi
2015-02-12 12:08:39,414 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0009_01_000004 by user soberoi
2015-02-12 12:08:39,414 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000003
2015-02-12 12:08:39,414 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:08:39,416 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0009_01_000005
2015-02-12 12:08:39,416 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0009_01_000003 to application application_1423771478362_0009
2015-02-12 12:08:39,417 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 12:08:39,417 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0009
2015-02-12 12:08:39,417 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0009
2015-02-12 12:08:39,417 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:39,417 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0009
2015-02-12 12:08:39,418 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:39,414 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000004
2015-02-12 12:08:39,419 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0009_01_000004 to application application_1423771478362_0009
2015-02-12 12:08:39,419 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 12:08:39,419 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0009
2015-02-12 12:08:39,419 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0009
2015-02-12 12:08:39,419 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:39,419 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0009
2015-02-12 12:08:39,420 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0009_01_000004
2015-02-12 12:08:39,440 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423771478362_0009_01_000005.tokens. Credentials list: 
2015-02-12 12:08:39,440 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423771478362_0009_01_000004.tokens. Credentials list: 
2015-02-12 12:08:39,471 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:39,471 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:39,480 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:39,480 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:39,610 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:39,634 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000002/default_container_executor.sh]
2015-02-12 12:08:39,646 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000003/default_container_executor.sh]
2015-02-12 12:08:39,767 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:39,767 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423771478362_0009_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000005.tokens
2015-02-12 12:08:39,767 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0009
2015-02-12 12:08:39,768 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:39,768 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:39,775 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:39,890 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:39,896 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423771478362_0009_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000004.tokens
2015-02-12 12:08:39,896 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0009
2015-02-12 12:08:39,934 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092
2015-02-12 12:08:39,935 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095
2015-02-12 12:08:39,936 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097
2015-02-12 12:08:39,944 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098
2015-02-12 12:08:39,944 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093
2015-02-12 12:08:39,946 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095
2015-02-12 12:08:39,946 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741916_1092
2015-02-12 12:08:39,948 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099
2015-02-12 12:08:39,949 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094
2015-02-12 12:08:39,964 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0009/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:40,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:40,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:40,062 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0009/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:40,062 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:40,062 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:40,114 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:40,114 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:40,114 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:40,114 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:40,136 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096
2015-02-12 12:08:40,152 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096
2015-02-12 12:08:40,152 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097
2015-02-12 12:08:40,259 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000005/default_container_executor.sh]
2015-02-12 12:08:40,260 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000004/default_container_executor.sh]
2015-02-12 12:08:40,285 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:08:40,313 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:40,314 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:40,430 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741918_1094
2015-02-12 12:08:40,431 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097
2015-02-12 12:08:40,432 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741919_1095
2015-02-12 12:08:40,432 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741917_1093
2015-02-12 12:08:40,432 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098
2015-02-12 12:08:40,433 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099
2015-02-12 12:08:40,637 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096
2015-02-12 12:08:42,099 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741921_1097
2015-02-12 12:08:42,100 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741923_1099
2015-02-12 12:08:42,300 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741920_1096
2015-02-12 12:08:42,301 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741922_1098
2015-02-12 12:08:45,158 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100
2015-02-12 12:08:45,642 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100
2015-02-12 12:08:46,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:46,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:46,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:46,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:08:46,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:08:46,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:46,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:46,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:46,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:08:46,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:46,882 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000000_0/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:08:46,934 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101 src: /127.0.0.1:57129 dest: /127.0.0.1:55522
2015-02-12 12:08:46,935 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101 src: /127.0.0.1:57130 dest: /127.0.0.1:55526
2015-02-12 12:08:46,937 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101 src: /127.0.0.1:57131 dest: /127.0.0.1:55519
2015-02-12 12:08:46,968 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57131, dest: /127.0.0.1:55519, bytes: 33, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000000_0_-1826059581_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101, duration: 28267000
2015-02-12 12:08:46,968 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:46,969 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:08:46,969 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57130, dest: /127.0.0.1:55526, bytes: 33, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000000_0_-1826059581_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101, duration: 29032000
2015-02-12 12:08:46,969 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:46,970 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57129, dest: /127.0.0.1:55522, bytes: 33, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000000_0_-1826059581_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101, duration: 30714000
2015-02-12 12:08:46,971 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:46,972 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:08:46,973 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:08:46,976 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000000_0/part-00000 is closed by DFSClient_attempt_1423771478362_0009_m_000000_0_-1826059581_1
2015-02-12 12:08:46,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:46,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:46,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:47,029 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0009_000001 (auth:SIMPLE)
2015-02-12 12:08:47,031 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0009_01_000002
2015-02-12 12:08:47,031 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000002
2015-02-12 12:08:47,031 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000002 transitioned from RUNNING to KILLING
2015-02-12 12:08:47,031 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0009_01_000002
2015-02-12 12:08:47,057 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0009_01_000002 is : 143
2015-02-12 12:08:47,064 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:47,065 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000002
2015-02-12 12:08:47,066 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000002
2015-02-12 12:08:47,068 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000002
2015-02-12 12:08:47,068 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000002
2015-02-12 12:08:47,069 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000002
2015-02-12 12:08:47,069 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:47,069 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0009_01_000002 from application application_1423771478362_0009
2015-02-12 12:08:47,070 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:47,070 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0009
2015-02-12 12:08:47,086 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1.jhist. BP-1120419527-10.1.1.68-1423771456695 blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:08:47,088 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741926_1102 src: /127.0.0.1:57133 dest: /127.0.0.1:55526
2015-02-12 12:08:47,090 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741926_1102 src: /127.0.0.1:57134 dest: /127.0.0.1:55522
2015-02-12 12:08:47,091 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741926_1102 src: /127.0.0.1:57135 dest: /127.0.0.1:55519
2015-02-12 12:08:47,099 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4450)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1.jhist for DFSClient_NONMAPREDUCE_-2072844285_1
2015-02-12 12:08:47,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:47,204 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000001_0/part-00001. BP-1120419527-10.1.1.68-1423771456695 blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:08:47,256 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103 src: /127.0.0.1:57138 dest: /127.0.0.1:55519
2015-02-12 12:08:47,258 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103 src: /127.0.0.1:57139 dest: /127.0.0.1:55529
2015-02-12 12:08:47,260 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103 src: /127.0.0.1:57140 dest: /127.0.0.1:55522
2015-02-12 12:08:47,308 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741924_1100
2015-02-12 12:08:47,320 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57140, dest: /127.0.0.1:55522, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000001_0_-1890903410_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103, duration: 58603000
2015-02-12 12:08:47,320 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:47,322 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57139, dest: /127.0.0.1:55529, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000001_0_-1890903410_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103, duration: 59530000
2015-02-12 12:08:47,322 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,323 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:08:47,323 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:08:47,323 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57138, dest: /127.0.0.1:55519, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000001_0_-1890903410_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103, duration: 61468000
2015-02-12 12:08:47,323 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,324 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:08:47,328 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000001_0/part-00001 is closed by DFSClient_attempt_1423771478362_0009_m_000001_0_-1890903410_1
2015-02-12 12:08:47,329 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000003_0/part-00003. BP-1120419527-10.1.1.68-1423771456695 blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:08:47,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000001	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000001	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:47,377 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0009_000001 (auth:SIMPLE)
2015-02-12 12:08:47,379 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0009_01_000003
2015-02-12 12:08:47,379 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000003
2015-02-12 12:08:47,379 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000003 transitioned from RUNNING to KILLING
2015-02-12 12:08:47,379 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0009_01_000003
2015-02-12 12:08:47,380 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:47,380 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0009_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 12:08:47,380 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000002
2015-02-12 12:08:47,381 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 12:08:47,381 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-02-12 12:08:47,382 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0009_01_000002, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:47,382 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:47,382 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:08:47,382 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0009_000001 released container container_1423771478362_0009_01_000002 on node: host: 10.1.1.68:55673 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 12:08:47,399 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0009_01_000003 is : 143
2015-02-12 12:08:47,400 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104 src: /127.0.0.1:57141 dest: /127.0.0.1:55522
2015-02-12 12:08:47,402 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104 src: /127.0.0.1:57143 dest: /127.0.0.1:55519
2015-02-12 12:08:47,404 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104 src: /127.0.0.1:57144 dest: /127.0.0.1:55529
2015-02-12 12:08:47,414 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:47,415 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000003
2015-02-12 12:08:47,415 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000003
2015-02-12 12:08:47,415 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000003
2015-02-12 12:08:47,415 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000003
2015-02-12 12:08:47,415 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000003
2015-02-12 12:08:47,416 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:47,416 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0009_01_000003 from application application_1423771478362_0009
2015-02-12 12:08:47,416 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:47,416 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0009
2015-02-12 12:08:47,438 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57144, dest: /127.0.0.1:55529, bytes: 32, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000003_0_503813831_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104, duration: 31617000
2015-02-12 12:08:47,439 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:47,441 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57143, dest: /127.0.0.1:55519, bytes: 32, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000003_0_503813831_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104, duration: 33939000
2015-02-12 12:08:47,441 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:08:47,441 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,442 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57141, dest: /127.0.0.1:55522, bytes: 32, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000003_0_503813831_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104, duration: 34816000
2015-02-12 12:08:47,442 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,443 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:47,444 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:47,449 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000003_0/part-00003 is closed by DFSClient_attempt_1423771478362_0009_m_000003_0_503813831_1
2015-02-12 12:08:47,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000003	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000003	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:47,485 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0009_000001 (auth:SIMPLE)
2015-02-12 12:08:47,487 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0009_01_000005
2015-02-12 12:08:47,487 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000005
2015-02-12 12:08:47,487 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000005 transitioned from RUNNING to KILLING
2015-02-12 12:08:47,488 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0009_01_000005
2015-02-12 12:08:47,511 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0009_01_000005 is : 143
2015-02-12 12:08:47,518 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:47,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000005
2015-02-12 12:08:47,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000005
2015-02-12 12:08:47,519 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000005
2015-02-12 12:08:47,520 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:47,520 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000005
2015-02-12 12:08:47,520 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000005
2015-02-12 12:08:47,520 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0009_01_000005 from application application_1423771478362_0009
2015-02-12 12:08:47,520 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:47,520 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0009
2015-02-12 12:08:47,549 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000002_0/part-00002. BP-1120419527-10.1.1.68-1423771456695 blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:08:47,590 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105 src: /127.0.0.1:57146 dest: /127.0.0.1:55526
2015-02-12 12:08:47,592 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105 src: /127.0.0.1:57147 dest: /127.0.0.1:55519
2015-02-12 12:08:47,594 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105 src: /127.0.0.1:57148 dest: /127.0.0.1:55529
2015-02-12 12:08:47,624 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57148, dest: /127.0.0.1:55529, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000002_0_-753426950_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105, duration: 28683000
2015-02-12 12:08:47,625 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:47,625 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:08:47,625 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57147, dest: /127.0.0.1:55519, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000002_0_-753426950_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105, duration: 29312000
2015-02-12 12:08:47,626 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,626 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:08:47,626 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57146, dest: /127.0.0.1:55526, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0009_m_000002_0_-753426950_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105, duration: 30166000
2015-02-12 12:08:47,626 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,627 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:08:47,630 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000002_0/part-00002 is closed by DFSClient_attempt_1423771478362_0009_m_000002_0_-753426950_1
2015-02-12 12:08:47,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000002	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/_temporary/attempt_1423771478362_0009_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000002	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:47,666 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0009_000001 (auth:SIMPLE)
2015-02-12 12:08:47,667 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0009_01_000004
2015-02-12 12:08:47,668 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000004
2015-02-12 12:08:47,668 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000004 transitioned from RUNNING to KILLING
2015-02-12 12:08:47,668 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0009_01_000004
2015-02-12 12:08:47,669 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:47,669 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0009_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 12:08:47,669 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000005
2015-02-12 12:08:47,669 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 12:08:47,669 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-02-12 12:08:47,670 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0009_01_000005, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:47,670 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:47,670 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:08:47,671 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0009_000001 released container container_1423771478362_0009_01_000005 on node: host: 10.1.1.68:55664 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 12:08:47,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:47,675 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-2072844285_1
2015-02-12 12:08:47,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,692 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0009_01_000004 is : 143
2015-02-12 12:08:47,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:47,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000001	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00001	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:47,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000002	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,715 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:08:47,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00002	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:47,720 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000004
2015-02-12 12:08:47,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,722 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000004
2015-02-12 12:08:47,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000003	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,724 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000004
2015-02-12 12:08:47,725 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000004
2015-02-12 12:08:47,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,727 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000004
2015-02-12 12:08:47,727 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:08:47,727 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0009_01_000004 from application application_1423771478362_0009
2015-02-12 12:08:47,727 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:47,727 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0009
2015-02-12 12:08:47,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary/1/task_1423771478362_0009_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00003	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:47,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:47,738 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2072844285_1
2015-02-12 12:08:47,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:47,742 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2072844285_1
2015-02-12 12:08:47,758 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57135, dest: /127.0.0.1:55519, bytes: 47549, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741926_1102, duration: 664281000
2015-02-12 12:08:47,758 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741926_1102, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:47,760 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 15522
2015-02-12 12:08:47,760 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57134, dest: /127.0.0.1:55522, bytes: 47549, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741926_1102, duration: 665753000
2015-02-12 12:08:47,760 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,761 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 15522
2015-02-12 12:08:47,762 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57133, dest: /127.0.0.1:55526, bytes: 47549, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741926_1102, duration: 668349000
2015-02-12 12:08:47,762 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,763 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 15522
2015-02-12 12:08:47,764 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1.jhist is closed by DFSClient_NONMAPREDUCE_-2072844285_1
2015-02-12 12:08:47,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:47,770 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009.summary_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:08:47,772 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106 src: /127.0.0.1:57150 dest: /127.0.0.1:55522
2015-02-12 12:08:47,773 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106 src: /127.0.0.1:57151 dest: /127.0.0.1:55526
2015-02-12 12:08:47,775 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106 src: /127.0.0.1:57152 dest: /127.0.0.1:55519
2015-02-12 12:08:47,778 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57152, dest: /127.0.0.1:55519, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106, duration: 1527000
2015-02-12 12:08:47,778 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:47,779 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:08:47,779 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57151, dest: /127.0.0.1:55526, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106, duration: 2331000
2015-02-12 12:08:47,779 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,780 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW]]} size 0
2015-02-12 12:08:47,780 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57150, dest: /127.0.0.1:55522, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106, duration: 3432000
2015-02-12 12:08:47,780 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,781 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:47,783 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009.summary_tmp is closed by DFSClient_NONMAPREDUCE_-2072844285_1
2015-02-12 12:08:47,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:47,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009-1423771713263-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2F74A1F672509542E2-1423771727743-4-0-SUCCEEDED-default-1423771717264.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009-1423771713263-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2F74A1F672509542E2-1423771727743-4-0-SUCCEEDED-default-1423771717264.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009-1423771713263-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2F74A1F672509542E2-1423771727743-4-0-SUCCEEDED-default-1423771717264.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:47,809 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009-1423771713263-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2F74A1F672509542E2-1423771727743-4-0-SUCCEEDED-default-1423771717264.jhist_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:08:47,811 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107 src: /127.0.0.1:57154 dest: /127.0.0.1:55522
2015-02-12 12:08:47,813 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107 src: /127.0.0.1:57155 dest: /127.0.0.1:55519
2015-02-12 12:08:47,814 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107 src: /127.0.0.1:57156 dest: /127.0.0.1:55526
2015-02-12 12:08:47,818 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57156, dest: /127.0.0.1:55526, bytes: 47549, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107, duration: 1978000
2015-02-12 12:08:47,819 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:47,819 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:47,820 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57155, dest: /127.0.0.1:55519, bytes: 47549, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107, duration: 3547000
2015-02-12 12:08:47,820 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,821 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:47,822 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57154, dest: /127.0.0.1:55522, bytes: 47549, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107, duration: 5119000
2015-02-12 12:08:47,822 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,823 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:47,825 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009-1423771713263-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2F74A1F672509542E2-1423771727743-4-0-SUCCEEDED-default-1423771717264.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-2072844285_1
2015-02-12 12:08:47,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009-1423771713263-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2F74A1F672509542E2-1423771727743-4-0-SUCCEEDED-default-1423771717264.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:47,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009/job_1423771478362_0009_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:47,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:47,842 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009_conf.xml_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:08:47,844 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108 src: /127.0.0.1:57158 dest: /127.0.0.1:55522
2015-02-12 12:08:47,845 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108 src: /127.0.0.1:57159 dest: /127.0.0.1:55526
2015-02-12 12:08:47,847 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108 src: /127.0.0.1:57160 dest: /127.0.0.1:55519
2015-02-12 12:08:47,851 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57160, dest: /127.0.0.1:55519, bytes: 114682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108, duration: 2364000
2015-02-12 12:08:47,851 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:47,851 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:47,852 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57159, dest: /127.0.0.1:55526, bytes: 114682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108, duration: 2783000
2015-02-12 12:08:47,852 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,853 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57158, dest: /127.0.0.1:55522, bytes: 114682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2072844285_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108, duration: 3906000
2015-02-12 12:08:47,853 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:47,853 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:47,854 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:47,856 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-2072844285_1
2015-02-12 12:08:47,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:47,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:47,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:47,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009-1423771713263-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2F74A1F672509542E2-1423771727743-4-0-SUCCEEDED-default-1423771717264.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0009-1423771713263-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2F74A1F672509542E2-1423771727743-4-0-SUCCEEDED-default-1423771717264.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:08:47,872 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1129)) - Updating application attempt appattempt_1423771478362_0009_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 12:08:47,872 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0009_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 12:08:47,872 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(992)) - Updating application application_1423771478362_0009 with final state: FINISHING
2015-02-12 12:08:47,872 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0009 State change from RUNNING to FINAL_SAVING
2015-02-12 12:08:47,872 INFO  recovery.RMStateStore (RMStateStore.java:transition(161)) - Updating info for app: application_1423771478362_0009
2015-02-12 12:08:47,873 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0009_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 12:08:47,873 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0009 State change from FINAL_SAVING to FINISHING
2015-02-12 12:08:48,183 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30005 milliseconds
2015-02-12 12:08:48,183 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(201)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 12:08:48,384 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:48,384 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:48,385 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0009_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 12:08:48,385 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000003
2015-02-12 12:08:48,385 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 12:08:48,385 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-02-12 12:08:48,386 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0009_01_000003, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:48,387 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:48,387 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:08:48,387 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0009_000001 released container container_1423771478362_0009_01_000003 on node: host: 10.1.1.68:55673 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 12:08:48,673 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:48,674 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0009_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 12:08:48,674 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000004
2015-02-12 12:08:48,674 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:08:48,674 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:08:48,675 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0009_01_000004, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:48,676 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:48,676 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:08:48,676 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0009_000001 released container container_1423771478362_0009_01_000004 on node: host: 10.1.1.68:55664 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:08:48,676 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:48,876 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(351)) - application_1423771478362_0009 unregistered successfully. 
2015-02-12 12:08:48,879 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741920_1096 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55519 127.0.0.1:55526 
2015-02-12 12:08:48,879 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741921_1097 127.0.0.1:55519 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55526 
2015-02-12 12:08:48,880 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741922_1098 127.0.0.1:55526 127.0.0.1:55529 127.0.0.1:55522 
2015-02-12 12:08:48,880 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741923_1099 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55526 
2015-02-12 12:08:48,880 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741926_1102 127.0.0.1:55526 127.0.0.1:55522 127.0.0.1:55519 
2015-02-12 12:08:48,880 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741924_1100 127.0.0.1:55522 127.0.0.1:55526 127.0.0.1:55529 
2015-02-12 12:08:48,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0009	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,921 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] starting step: (2/2) ...tplatform/checkpoint/sink
2015-02-12 12:08:48,933 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:08:48,945 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.68:55658
2015-02-12 12:08:48,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,954 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(286)) - Allocated new applicationId: 10
2015-02-12 12:08:48,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 12:08:48,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 12:08:48,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:48,965 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar. BP-1120419527-10.1.1.68-1423771456695 blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:08:48,966 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109 src: /127.0.0.1:57163 dest: /127.0.0.1:55519
2015-02-12 12:08:48,968 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109 src: /127.0.0.1:57164 dest: /127.0.0.1:55529
2015-02-12 12:08:48,969 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109 src: /127.0.0.1:57165 dest: /127.0.0.1:55522
2015-02-12 12:08:48,973 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57165, dest: /127.0.0.1:55522, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109, duration: 2351000
2015-02-12 12:08:48,973 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:48,974 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:08:48,974 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57164, dest: /127.0.0.1:55529, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109, duration: 3015000
2015-02-12 12:08:48,974 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:48,975 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:48,975 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57163, dest: /127.0.0.1:55519, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109, duration: 3946000
2015-02-12 12:08:48,975 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:48,978 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:48,979 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:48,980 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar
2015-02-12 12:08:48,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:48,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:08:48,995 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 4
2015-02-12 12:08:48,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:48,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:48,999 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2710)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split
2015-02-12 12:08:48,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,000 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split. BP-1120419527-10.1.1.68-1423771456695 blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:08:49,002 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110 src: /127.0.0.1:57166 dest: /127.0.0.1:55526
2015-02-12 12:08:49,003 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110 src: /127.0.0.1:57167 dest: /127.0.0.1:55522
2015-02-12 12:08:49,004 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110 src: /127.0.0.1:57168 dest: /127.0.0.1:55519
2015-02-12 12:08:49,006 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110 src: /127.0.0.1:57169 dest: /127.0.0.1:55529
2015-02-12 12:08:49,009 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57169, dest: /127.0.0.1:55529, bytes: 2383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110, duration: 2038000
2015-02-12 12:08:49,010 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:49,011 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57168, dest: /127.0.0.1:55519, bytes: 2383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110, duration: 3097000
2015-02-12 12:08:49,011 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:49,012 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW]]} size 0
2015-02-12 12:08:49,013 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57167, dest: /127.0.0.1:55522, bytes: 2383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110, duration: 4963000
2015-02-12 12:08:49,013 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:49,015 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57166, dest: /127.0.0.1:55526, bytes: 2383, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110, duration: 6421000
2015-02-12 12:08:49,015 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:49,015 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:08:49,018 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:49,019 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|FINALIZED]]} size 0
2015-02-12 12:08:49,020 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:49,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:49,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:49,025 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo. BP-1120419527-10.1.1.68-1423771456695 blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:08:49,026 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111 src: /127.0.0.1:57170 dest: /127.0.0.1:55519
2015-02-12 12:08:49,028 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111 src: /127.0.0.1:57171 dest: /127.0.0.1:55529
2015-02-12 12:08:49,030 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111 src: /127.0.0.1:57172 dest: /127.0.0.1:55526
2015-02-12 12:08:49,033 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57172, dest: /127.0.0.1:55526, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111, duration: 1482000
2015-02-12 12:08:49,033 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:49,033 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:08:49,034 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57171, dest: /127.0.0.1:55529, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111, duration: 2119000
2015-02-12 12:08:49,034 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:49,035 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57170, dest: /127.0.0.1:55519, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111, duration: 3129000
2015-02-12 12:08:49,035 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:49,035 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:49,037 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:49,039 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:49,040 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:6
2015-02-12 12:08:49,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:49,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 12:08:49,051 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:08:49,053 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112 src: /127.0.0.1:57173 dest: /127.0.0.1:55519
2015-02-12 12:08:49,055 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112 src: /127.0.0.1:57174 dest: /127.0.0.1:55529
2015-02-12 12:08:49,057 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112 src: /127.0.0.1:57175 dest: /127.0.0.1:55526
2015-02-12 12:08:49,060 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57175, dest: /127.0.0.1:55526, bytes: 98973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112, duration: 1695000
2015-02-12 12:08:49,060 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:49,061 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:08:49,061 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57174, dest: /127.0.0.1:55529, bytes: 98973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112, duration: 2207000
2015-02-12 12:08:49,061 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:49,062 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:49,062 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57173, dest: /127.0.0.1:55519, bytes: 98973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-304444045_9, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112, duration: 3091000
2015-02-12 12:08:49,062 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:49,064 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:08:49,066 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml is closed by DFSClient_NONMAPREDUCE_-304444045_9
2015-02-12 12:08:49,067 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_1423771478362_0010
2015-02-12 12:08:49,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,085 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,087 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(577)) - Application with id 10 submitted by user soberoi
2015-02-12 12:08:49,087 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(973)) - Storing application with id application_1423771478362_0010
2015-02-12 12:08:49,087 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	IP=10.1.1.68	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423771478362_0010
2015-02-12 12:08:49,088 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423771478362_0010
2015-02-12 12:08:49,088 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0010 State change from NEW to NEW_SAVING
2015-02-12 12:08:49,088 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0010 State change from NEW_SAVING to SUBMITTED
2015-02-12 12:08:49,088 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(386)) - Application added - appId: application_1423771478362_0010 user: soberoi leaf-queue of parent: root #applications: 2
2015-02-12 12:08:49,088 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(716)) - Accepted application application_1423771478362_0010 from user: soberoi, in queue: default
2015-02-12 12:08:49,089 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0010 State change from SUBMITTED to ACCEPTED
2015-02-12 12:08:49,089 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(251)) - Submitted application application_1423771478362_0010
2015-02-12 12:08:49,089 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(670)) - Registering app attempt : appattempt_1423771478362_0010_000001
2015-02-12 12:08:49,089 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0010_000001 State change from NEW to SUBMITTED
2015-02-12 12:08:49,089 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(626)) - Application application_1423771478362_0010 from user: soberoi activated in queue: default
2015-02-12 12:08:49,090 INFO  capacity.LeafQueue (LeafQueue.java:addApplicationAttempt(643)) - Application added - appId: application_1423771478362_0010 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@35816f1c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-02-12 12:08:49,090 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplicationAttempt(746)) - Added Application Attempt appattempt_1423771478362_0010_000001 to scheduler from user soberoi in queue default
2015-02-12 12:08:49,091 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0010_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 12:08:49,092 INFO  mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://Edinburgh.local:55663/proxy/application_1423771478362_0010/
2015-02-12 12:08:49,092 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] submitted hadoop job: job_1423771478362_0010
2015-02-12 12:08:49,092 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] tracking url: http://Edinburgh.local:55663/proxy/application_1423771478362_0010/
2015-02-12 12:08:49,388 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:49,388 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:49,389 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:49,389 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000001
2015-02-12 12:08:49,389 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0010_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55673, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 12:08:49,389 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0010_000001 container=Container: [ContainerId: container_1423771478362_0010_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:49,390 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-02-12 12:08:49,390 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:49,391 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55673 for container : container_1423771478362_0010_01_000001
2015-02-12 12:08:49,391 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:49,392 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423771478362_0010_000001
2015-02-12 12:08:49,392 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1837)) - Storing attempt: AppId: application_1423771478362_0010 AttemptId: appattempt_1423771478362_0010_000001 MasterContainer: Container: [ContainerId: container_1423771478362_0010_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ]
2015-02-12 12:08:49,392 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0010_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 12:08:49,392 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0010_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 12:08:49,392 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423771478362_0010_000001
2015-02-12 12:08:49,394 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423771478362_0010_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] for AM appattempt_1423771478362_0010_000001
2015-02-12 12:08:49,394 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423771478362_0010_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 12:08:49,394 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423771478362_0010_000001
2015-02-12 12:08:49,394 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423771478362_0010_000001
2015-02-12 12:08:49,396 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:08:49,399 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0010_01_000001 by user soberoi
2015-02-12 12:08:49,399 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0010
2015-02-12 12:08:49,399 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000001
2015-02-12 12:08:49,399 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0010 transitioned from NEW to INITING
2015-02-12 12:08:49,400 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0010_01_000001 to application application_1423771478362_0010
2015-02-12 12:08:49,400 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423771478362_0010_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] for AM appattempt_1423771478362_0010_000001
2015-02-12 12:08:49,400 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0010 transitioned from INITING to RUNNING
2015-02-12 12:08:49,400 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0010_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 12:08:49,400 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 12:08:49,401 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0010
2015-02-12 12:08:49,401 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:08:49,401 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 12:08:49,401 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split transitioned from INIT to DOWNLOADING
2015-02-12 12:08:49,401 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:08:49,401 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0010_01_000001
2015-02-12 12:08:49,410 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423771478362_0010_01_000001.tokens. Credentials list: 
2015-02-12 12:08:49,511 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:49,585 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423771478362_0010_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000001.tokens
2015-02-12 12:08:49,585 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0010
2015-02-12 12:08:49,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,674 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:49,674 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:49,699 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0010/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:49,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,750 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0010/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:49,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,801 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0010/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:49,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:49,852 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0010/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:49,852 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:49,889 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:49,889 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:49,995 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000001/default_container_executor.sh]
2015-02-12 12:08:50,391 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:50,391 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:50,391 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:50,677 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:50,677 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:51,395 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:51,395 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:51,485 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1492)) - BLOCK* ask 127.0.0.1:55519 to replicate blk_1073741933_1109 to datanode(s) 127.0.0.1:55526
2015-02-12 12:08:51,485 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55519 to delete [blk_1073741920_1096, blk_1073741921_1097, blk_1073741926_1102]
2015-02-12 12:08:51,485 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55526 to delete [blk_1073741920_1096, blk_1073741921_1097, blk_1073741922_1098, blk_1073741923_1099, blk_1073741924_1100, blk_1073741926_1102]
2015-02-12 12:08:51,677 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:51,677 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:51,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 12:08:52,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 12:08:52,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 12:08:52,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 12:08:52,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010	dst=null	perm=null	proto=rpc
2015-02-12 12:08:52,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 12:08:52,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 12:08:52,173 INFO  datanode.DataNode (DataNode.java:transferBlock(1812)) - DatanodeRegistration(127.0.0.1, datanodeUuid=7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, infoPort=55520, ipcPort=55521, storageInfo=lv=-56;cid=testClusterID;nsid=1159844277;c=0) Starting thread to transfer BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109 to 127.0.0.1:55526 
2015-02-12 12:08:52,173 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741920_1096 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741920 for deletion
2015-02-12 12:08:52,173 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741921 for deletion
2015-02-12 12:08:52,174 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741926 for deletion
2015-02-12 12:08:52,174 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741920_1096 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data1/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741920
2015-02-12 12:08:52,174 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741921
2015-02-12 12:08:52,175 INFO  datanode.DataNode (DataNode.java:run(2020)) - DataTransfer: Transmitted BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109 (numBytes=254067) to /127.0.0.1:55526
2015-02-12 12:08:52,175 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data2/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741926
2015-02-12 12:08:52,175 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109 src: /127.0.0.1:57182 dest: /127.0.0.1:55526
2015-02-12 12:08:52,177 INFO  datanode.DataNode (DataXceiver.java:writeBlock(755)) - Received BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109 src: /127.0.0.1:57182 dest: /127.0.0.1:55526 of size 254067
2015-02-12 12:08:52,178 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741933_1109 size 254067
2015-02-12 12:08:52,397 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:52,397 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:52,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:52,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 12:08:52,487 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741920_1096 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741920 for deletion
2015-02-12 12:08:52,487 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741921 for deletion
2015-02-12 12:08:52,488 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741922 for deletion
2015-02-12 12:08:52,488 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741920_1096 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741920
2015-02-12 12:08:52,488 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741923 for deletion
2015-02-12 12:08:52,488 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741924 for deletion
2015-02-12 12:08:52,488 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data6/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741922
2015-02-12 12:08:52,488 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741926 for deletion
2015-02-12 12:08:52,488 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741921
2015-02-12 12:08:52,489 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741923
2015-02-12 12:08:52,489 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741924
2015-02-12 12:08:52,490 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data5/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741926
2015-02-12 12:08:52,677 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:52,678 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:53,311 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:08:53,312 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(274)) - AM registration appattempt_1423771478362_0010_000001
2015-02-12 12:08:53,312 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(127)) - USER=soberoi	IP=10.1.1.68	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423771478362_0010	APPATTEMPTID=appattempt_1423771478362_0010_000001
2015-02-12 12:08:53,313 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0010_000001 State change from LAUNCHED to RUNNING
2015-02-12 12:08:53,313 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0010 State change from ACCEPTED to RUNNING
2015-02-12 12:08:53,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:53,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:08:53,401 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:53,401 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:53,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:08:53,575 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1_conf.xml. BP-1120419527-10.1.1.68-1423771456695 blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:08:53,627 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113 src: /127.0.0.1:57189 dest: /127.0.0.1:55529
2015-02-12 12:08:53,628 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113 src: /127.0.0.1:57190 dest: /127.0.0.1:55522
2015-02-12 12:08:53,630 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113 src: /127.0.0.1:57191 dest: /127.0.0.1:55526
2015-02-12 12:08:53,666 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57191, dest: /127.0.0.1:55526, bytes: 116048, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113, duration: 34529000
2015-02-12 12:08:53,667 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:08:53,667 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:08:53,667 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57190, dest: /127.0.0.1:55522, bytes: 116048, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113, duration: 35436000
2015-02-12 12:08:53,668 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:53,668 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57189, dest: /127.0.0.1:55529, bytes: 116048, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113, duration: 36499000
2015-02-12 12:08:53,669 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:08:53,670 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:08:53,670 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:08:53,673 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-2052970901_1
2015-02-12 12:08:53,678 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:53,678 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:54,025 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(346)) - Container container_1423771478362_0009_01_000001 succeeded 
2015-02-12 12:08:54,025 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 12:08:54,025 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0009_01_000001
2015-02-12 12:08:54,039 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000001
2015-02-12 12:08:54,039 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000001
2015-02-12 12:08:54,039 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000001
2015-02-12 12:08:54,040 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000001
2015-02-12 12:08:54,040 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0009_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 12:08:54,040 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0009_01_000001 from application application_1423771478362_0009
2015-02-12 12:08:54,040 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:54,040 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0009/container_1423771478362_0009_01_000001
2015-02-12 12:08:54,041 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0009
2015-02-12 12:08:54,402 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0009_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:08:54,402 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(676)) - Unregistering app attempt : appattempt_1423771478362_0009_000001
2015-02-12 12:08:54,403 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0009_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 12:08:54,403 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000001
2015-02-12 12:08:54,403 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.68:55673, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 12:08:54,403 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423771478362_0009_000001
2015-02-12 12:08:54,404 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:08:54,404 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0009_000001 State change from FINISHING to FINISHED
2015-02-12 12:08:54,404 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0009_01_000001, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:08:54,404 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0009 State change from FINISHING to FINISHED
2015-02-12 12:08:54,404 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:54,404 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-02-12 12:08:54,405 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0009_000001 released container container_1423771478362_0009_01_000001 on node: host: 10.1.1.68:55673 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 12:08:54,405 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:54,405 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:54,404 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423771478362_0009_000001
2015-02-12 12:08:54,404 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(148)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423771478362_0009
2015-02-12 12:08:54,405 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:54,405 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000002
2015-02-12 12:08:54,405 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 12:08:54,406 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0010_000001 container=Container: [ContainerId: container_1423771478362_0010_01_000002, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:54,405 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(179)) - appId=application_1423771478362_0009,name=[F4B13C8AB332459A84BF1470AC8CEF2E/74A1F672509542E28023C235E629AB55] null/(1/2) ...ntplatform/checkpoint/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=http://Edinburgh.local:55663/proxy/application_1423771478362_0009/jobhistory/job/job_1423771478362_0009,appMasterHost=10.1.1.68,startTime=1423771713263,finishTime=1423771727872,finalStatus=SUCCEEDED
2015-02-12 12:08:54,406 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-02-12 12:08:54,406 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:54,409 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:54,409 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000003
2015-02-12 12:08:54,409 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 12:08:54,410 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0010_000001 container=Container: [ContainerId: container_1423771478362_0010_01_000003, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:54,410 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-02-12 12:08:54,410 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:54,410 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplicationAttempt(785)) - Application Attempt appattempt_1423771478362_0009_000001 is done. finalState=FINISHED
2015-02-12 12:08:54,410 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423771478362_0009 requests cleared
2015-02-12 12:08:54,410 INFO  capacity.LeafQueue (LeafQueue.java:removeApplicationAttempt(686)) - Application removed - appId: application_1423771478362_0009 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-02-12 12:08:54,411 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(411)) - Application removed - appId: application_1423771478362_0009 user: soberoi leaf-queue of parent: root #applications: 1
2015-02-12 12:08:54,411 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0009_000001 (auth:SIMPLE)
2015-02-12 12:08:54,413 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0009_01_000001
2015-02-12 12:08:54,413 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0009	CONTAINERID=container_1423771478362_0009_01_000001
2015-02-12 12:08:54,414 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0009_01_000001]
2015-02-12 12:08:54,414 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:54,414 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:08:54,414 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:54,414 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:54,414 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0009
2015-02-12 12:08:54,415 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0009
2015-02-12 12:08:54,415 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0009
2015-02-12 12:08:54,415 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:08:54,415 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0009, with delay of 10800 seconds
2015-02-12 12:08:54,415 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0009
2015-02-12 12:08:54,416 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0009
2015-02-12 12:08:54,486 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55522 to delete [blk_1073741920_1096, blk_1073741921_1097, blk_1073741922_1098, blk_1073741923_1099, blk_1073741924_1100, blk_1073741926_1102]
2015-02-12 12:08:54,486 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3398)) - BLOCK* BlockManager: ask 127.0.0.1:55529 to delete [blk_1073741920_1096, blk_1073741921_1097, blk_1073741922_1098, blk_1073741923_1099, blk_1073741924_1100]
2015-02-12 12:08:54,678 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 12:08:54,678 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:54,679 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:54,679 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0009
2015-02-12 12:08:54,679 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:54,679 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000004
2015-02-12 12:08:54,680 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:08:54,680 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0010_000001 container=Container: [ContainerId: container_1423771478362_0010_01_000004, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:54,680 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423771478362_0009
2015-02-12 12:08:54,680 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:08:54,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0009
2015-02-12 12:08:54,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0009
2015-02-12 12:08:54,681 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0009
2015-02-12 12:08:54,681 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:54,682 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:54,682 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000005
2015-02-12 12:08:54,682 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 12:08:54,680 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 12:08:54,683 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423771478362_0009, with delay of 10800 seconds
2015-02-12 12:08:54,682 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0010_000001 container=Container: [ContainerId: container_1423771478362_0010_01_000005, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:54,683 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-02-12 12:08:54,683 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:54,683 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:54,684 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000006
2015-02-12 12:08:54,684 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 12:08:54,684 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0010_000001 container=Container: [ContainerId: container_1423771478362_0010_01_000006, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:54,684 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>, usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-02-12 12:08:54,684 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:54,685 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:08:54,685 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000007
2015-02-12 12:08:54,685 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0010_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 12:08:54,685 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0010_000001 container=Container: [ContainerId: container_1423771478362_0010_01_000007, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>, usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:08:54,685 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:7>, usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=1, numContainers=7
2015-02-12 12:08:54,686 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:7> cluster=<memory:16384, vCores:32>
2015-02-12 12:08:55,144 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103
2015-02-12 12:08:55,144 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111
2015-02-12 12:08:55,145 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107
2015-02-12 12:08:55,146 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108
2015-02-12 12:08:55,147 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105
2015-02-12 12:08:55,147 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101
2015-02-12 12:08:55,147 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110
2015-02-12 12:08:55,148 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106
2015-02-12 12:08:55,148 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104
2015-02-12 12:08:55,169 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106
2015-02-12 12:08:55,170 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104
2015-02-12 12:08:55,171 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108
2015-02-12 12:08:55,172 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101
2015-02-12 12:08:55,172 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107
2015-02-12 12:08:55,173 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741926_1102
2015-02-12 12:08:55,174 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103
2015-02-12 12:08:55,174 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110
2015-02-12 12:08:55,174 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741920_1096 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741920 for deletion
2015-02-12 12:08:55,175 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741921 for deletion
2015-02-12 12:08:55,175 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741922 for deletion
2015-02-12 12:08:55,175 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741923 for deletion
2015-02-12 12:08:55,175 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741924 for deletion
2015-02-12 12:08:55,175 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741920_1096 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741920
2015-02-12 12:08:55,175 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741922
2015-02-12 12:08:55,175 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741926 for deletion
2015-02-12 12:08:55,176 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741924
2015-02-12 12:08:55,176 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741921
2015-02-12 12:08:55,176 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data4/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741926
2015-02-12 12:08:55,176 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data3/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741923
2015-02-12 12:08:55,352 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109
2015-02-12 12:08:55,354 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112
2015-02-12 12:08:55,360 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55673 for container : container_1423771478362_0010_01_000002
2015-02-12 12:08:55,361 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:55,362 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:55,362 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.68:55664 for container : container_1423771478362_0010_01_000004
2015-02-12 12:08:55,363 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:55,364 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:55,364 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:55,365 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:08:55,378 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109
2015-02-12 12:08:55,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:55,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:55,415 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:55,415 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:55,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:55,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:55,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:55,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:55,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:55,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:55,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:55,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-9144650672645034592.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:55,503 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:08:55,503 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:08:55,504 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:08:55,504 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:08:55,505 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:08:55,506 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:08:55,510 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0010_01_000004 by user soberoi
2015-02-12 12:08:55,510 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0010_01_000003 by user soberoi
2015-02-12 12:08:55,510 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000003
2015-02-12 12:08:55,510 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1423771478362_0010
2015-02-12 12:08:55,511 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000004
2015-02-12 12:08:55,511 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0010_01_000003 to application application_1423771478362_0010
2015-02-12 12:08:55,512 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0010 transitioned from NEW to INITING
2015-02-12 12:08:55,512 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0010_01_000004 to application application_1423771478362_0010
2015-02-12 12:08:55,512 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 12:08:55,512 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1423771478362_0010 transitioned from INITING to RUNNING
2015-02-12 12:08:55,512 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 12:08:55,512 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,512 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,512 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:55,513 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0010
2015-02-12 12:08:55,513 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 12:08:55,513 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 12:08:55,513 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0010_01_000004
2015-02-12 12:08:55,513 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0010_01_000007 by user soberoi
2015-02-12 12:08:55,514 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000007
2015-02-12 12:08:55,512 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,514 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,514 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:55,514 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0010
2015-02-12 12:08:55,515 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:55,515 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0010_01_000007 to application application_1423771478362_0010
2015-02-12 12:08:55,515 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 12:08:55,515 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,515 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,515 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:55,516 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0010
2015-02-12 12:08:55,516 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0010_01_000007
2015-02-12 12:08:55,523 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0010_01_000002 by user soberoi
2015-02-12 12:08:55,523 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000002
2015-02-12 12:08:55,526 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0010_01_000002 to application application_1423771478362_0010
2015-02-12 12:08:55,526 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 12:08:55,526 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,527 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,527 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:55,527 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0010
2015-02-12 12:08:55,527 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:55,528 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0010_01_000006 by user soberoi
2015-02-12 12:08:55,529 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000006
2015-02-12 12:08:55,531 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0010_01_000005 by user soberoi
2015-02-12 12:08:55,531 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000005
2015-02-12 12:08:55,532 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0010_01_000006 to application application_1423771478362_0010
2015-02-12 12:08:55,533 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0010_01_000005 to application application_1423771478362_0010
2015-02-12 12:08:55,533 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 12:08:55,534 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 12:08:55,534 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,534 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,534 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:55,534 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0010
2015-02-12 12:08:55,534 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,534 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0010
2015-02-12 12:08:55,534 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:08:55,535 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0010
2015-02-12 12:08:55,535 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0010_01_000006
2015-02-12 12:08:55,539 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423771478362_0010_01_000005
2015-02-12 12:08:55,567 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423771478362_0010_01_000004.tokens. Credentials list: 
2015-02-12 12:08:55,570 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423771478362_0010_01_000007.tokens. Credentials list: 
2015-02-12 12:08:55,574 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423771478362_0010_01_000006.tokens. Credentials list: 
2015-02-12 12:08:55,576 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423771478362_0010_01_000005.tokens. Credentials list: 
2015-02-12 12:08:55,596 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:55,596 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:55,598 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:55,598 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:55,653 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741931_1107
2015-02-12 12:08:55,654 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105
2015-02-12 12:08:55,654 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741930_1106
2015-02-12 12:08:55,655 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111
2015-02-12 12:08:55,655 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741925_1101
2015-02-12 12:08:55,656 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110
2015-02-12 12:08:55,657 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741932_1108
2015-02-12 12:08:55,658 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112
2015-02-12 12:08:55,679 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:55,679 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:55,679 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:55,680 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:55,680 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:55,680 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:08:55,757 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:55,767 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000003/default_container_executor.sh]
2015-02-12 12:08:55,769 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000002/default_container_executor.sh]
2015-02-12 12:08:55,910 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:55,919 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423771478362_0010_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000004.tokens
2015-02-12 12:08:55,920 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0010
2015-02-12 12:08:56,049 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:56,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:56,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 12:08:56,073 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423771478362_0010_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000005.tokens
2015-02-12 12:08:56,073 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010
2015-02-12 12:08:56,141 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:56,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:56,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:08:56,218 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user soberoi
2015-02-12 12:08:56,263 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423771478362_0010_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000006.tokens
2015-02-12 12:08:56,264 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010
2015-02-12 12:08:56,265 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:55518/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0010/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 12:08:56,265 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:56,265 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:56,266 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:56,266 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:08:56,328 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:56,328 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:56,329 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:56,329 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:56,330 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:56,330 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:56,343 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 12:08:56,343 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:08:56,376 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:08:56,416 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:56,416 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:08:56,478 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423771478362_0010_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000007.tokens
2015-02-12 12:08:56,480 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0010
2015-02-12 12:08:56,587 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000005/default_container_executor.sh]
2015-02-12 12:08:56,608 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000004/default_container_executor.sh]
2015-02-12 12:08:56,615 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000006/default_container_executor.sh]
2015-02-12 12:08:56,644 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000007/default_container_executor.sh]
2015-02-12 12:08:56,878 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741920_1096 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741920 for deletion
2015-02-12 12:08:56,878 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741921 for deletion
2015-02-12 12:08:56,878 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741922 for deletion
2015-02-12 12:08:56,878 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741920_1096 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741920
2015-02-12 12:08:56,878 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741923 for deletion
2015-02-12 12:08:56,878 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741924 for deletion
2015-02-12 12:08:56,879 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741921
2015-02-12 12:08:56,879 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741922
2015-02-12 12:08:56,879 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data8/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741923
2015-02-12 12:08:56,879 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1120419527-10.1.1.68-1423771456695 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/data/dfs/data/data7/current/BP-1120419527-10.1.1.68-1423771456695/current/finalized/subdir0/subdir0/blk_1073741924
2015-02-12 12:08:57,319 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741928_1104
2015-02-12 12:08:57,521 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109
2015-02-12 12:08:57,522 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741927_1103
2015-02-12 12:08:57,523 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741936_1112
2015-02-12 12:08:57,523 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741929_1105
2015-02-12 12:08:57,523 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741934_1110
2015-02-12 12:08:57,524 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741935_1111
2015-02-12 12:09:00,386 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113
2015-02-12 12:09:00,664 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741933_1109
2015-02-12 12:09:00,867 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113
2015-02-12 12:09:02,532 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1120419527-10.1.1.68-1423771456695:blk_1073741937_1113
2015-02-12 12:09:06,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:09:06,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:09:06,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:09:07,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:09:07,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:09:07,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job.split	dst=null	perm=null	proto=rpc
2015-02-12 12:09:07,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:09:07,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:09:07,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:09:07,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:09:07,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:09:07,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:09:08,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 12:09:08,125 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:09:08,126 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0010_01_000003
2015-02-12 12:09:08,127 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000003
2015-02-12 12:09:08,127 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000003 transitioned from RUNNING to KILLING
2015-02-12 12:09:08,127 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0010_01_000003
2015-02-12 12:09:08,146 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1.jhist. BP-1120419527-10.1.1.68-1423771456695 blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW]]}
2015-02-12 12:09:08,147 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0010_01_000003 is : 143
2015-02-12 12:09:08,149 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741938_1114 src: /127.0.0.1:57241 dest: /127.0.0.1:55522
2015-02-12 12:09:08,152 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741938_1114 src: /127.0.0.1:57242 dest: /127.0.0.1:55529
2015-02-12 12:09:08,154 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741938_1114 src: /127.0.0.1:57243 dest: /127.0.0.1:55519
2015-02-12 12:09:08,163 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4450)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1.jhist for DFSClient_NONMAPREDUCE_-2052970901_1
2015-02-12 12:09:08,166 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:09:08,166 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000003
2015-02-12 12:09:08,167 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000003
2015-02-12 12:09:08,167 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000003
2015-02-12 12:09:08,168 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000003
2015-02-12 12:09:08,168 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000003
2015-02-12 12:09:08,168 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:09:08,171 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0010_01_000003 from application application_1423771478362_0010
2015-02-12 12:09:08,172 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:09:08,172 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0010
2015-02-12 12:09:08,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:09:08,289 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:09:08,291 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0010_01_000002
2015-02-12 12:09:08,291 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000002
2015-02-12 12:09:08,291 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000002 transitioned from RUNNING to KILLING
2015-02-12 12:09:08,291 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0010_01_000002
2015-02-12 12:09:08,292 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:09:08,292 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0010_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 12:09:08,292 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000003
2015-02-12 12:09:08,292 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 12:09:08,292 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-02-12 12:09:08,293 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0010_01_000003, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>, usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6 cluster=<memory:16384, vCores:32>
2015-02-12 12:09:08,293 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-02-12 12:09:08,293 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>, usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-02-12 12:09:08,293 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0010_000001 released container container_1423771478362_0010_01_000003 on node: host: 10.1.1.68:55673 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 12:09:08,315 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0010_01_000002 is : 143
2015-02-12 12:09:08,330 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:09:08,330 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000002
2015-02-12 12:09:08,331 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000002
2015-02-12 12:09:08,331 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000002
2015-02-12 12:09:08,332 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000002
2015-02-12 12:09:08,332 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000002
2015-02-12 12:09:08,332 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:09:08,332 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0010_01_000002 from application application_1423771478362_0010
2015-02-12 12:09:08,332 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:09:08,332 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0010
2015-02-12 12:09:08,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 12:09:08,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 12:09:08,468 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:09:08,471 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0010_01_000004
2015-02-12 12:09:08,471 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000004
2015-02-12 12:09:08,471 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000004 transitioned from RUNNING to KILLING
2015-02-12 12:09:08,471 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0010_01_000004
2015-02-12 12:09:08,479 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:09:08,481 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0010_01_000005
2015-02-12 12:09:08,482 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000005
2015-02-12 12:09:08,495 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0010_01_000004 is : 143
2015-02-12 12:09:08,507 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000005 transitioned from RUNNING to KILLING
2015-02-12 12:09:08,507 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:09:08,508 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0010_01_000005
2015-02-12 12:09:08,531 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0010_01_000005 is : 143
2015-02-12 12:09:08,543 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:09:08,543 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000004
2015-02-12 12:09:08,543 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:09:08,544 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000004
2015-02-12 12:09:08,544 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000004
2015-02-12 12:09:08,545 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000004
2015-02-12 12:09:08,545 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000004
2015-02-12 12:09:08,546 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000005
2015-02-12 12:09:08,547 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000005
2015-02-12 12:09:08,547 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000005
2015-02-12 12:09:08,548 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000005
2015-02-12 12:09:08,548 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0010_01_000004 from application application_1423771478362_0010
2015-02-12 12:09:08,549 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:09:08,549 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0010
2015-02-12 12:09:08,549 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000005
2015-02-12 12:09:08,549 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:09:08,550 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0010_01_000005 from application application_1423771478362_0010
2015-02-12 12:09:08,550 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:09:08,550 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0010
2015-02-12 12:09:08,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_m_000004_0	dst=null	perm=null	proto=rpc
2015-02-12 12:09:08,593 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:09:08,595 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0010_01_000006
2015-02-12 12:09:08,595 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000006
2015-02-12 12:09:08,596 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000006 transitioned from RUNNING to KILLING
2015-02-12 12:09:08,597 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:09:08,597 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0010_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 12:09:08,597 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000004
2015-02-12 12:09:08,597 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 12:09:08,597 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0010_01_000006
2015-02-12 12:09:08,597 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-02-12 12:09:08,601 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0010_01_000004, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 cluster=<memory:16384, vCores:32>
2015-02-12 12:09:08,602 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-02-12 12:09:08,602 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>, usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-02-12 12:09:08,602 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0010_000001 released container container_1423771478362_0010_01_000004 on node: host: 10.1.1.68:55664 #containers=3 available=1024 used=3072 with event: FINISHED
2015-02-12 12:09:08,602 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:09:08,602 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0010_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 12:09:08,602 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000005
2015-02-12 12:09:08,603 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 12:09:08,603 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-02-12 12:09:08,608 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0010_01_000005, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 cluster=<memory:16384, vCores:32>
2015-02-12 12:09:08,608 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-02-12 12:09:08,608 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>, usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-02-12 12:09:08,609 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0010_000001 released container container_1423771478362_0010_01_000005 on node: host: 10.1.1.68:55664 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 12:09:08,631 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0010_01_000006 is : 143
2015-02-12 12:09:08,649 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:09:08,650 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000006
2015-02-12 12:09:08,650 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000006
2015-02-12 12:09:08,650 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000006
2015-02-12 12:09:08,651 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000006
2015-02-12 12:09:08,653 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000006
2015-02-12 12:09:08,654 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:09:08,654 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0010_01_000006 from application application_1423771478362_0010
2015-02-12 12:09:08,654 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:09:08,654 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0010
2015-02-12 12:09:08,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_m_000005_0	dst=null	perm=null	proto=rpc
2015-02-12 12:09:08,698 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:09:08,701 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0010_01_000007
2015-02-12 12:09:08,701 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000007
2015-02-12 12:09:08,703 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:08,703 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:08,703 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:09:08,703 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0010_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 12:09:08,704 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000006
2015-02-12 12:09:08,704 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 12:09:08,704 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-02-12 12:09:08,705 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0010_01_000006, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 cluster=<memory:16384, vCores:32>
2015-02-12 12:09:08,705 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-02-12 12:09:08,705 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>, usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-02-12 12:09:08,706 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0010_000001 released container container_1423771478362_0010_01_000006 on node: host: 10.1.1.68:55664 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 12:09:08,706 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000007 transitioned from RUNNING to KILLING
2015-02-12 12:09:08,708 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0010_01_000007
2015-02-12 12:09:08,730 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0010_01_000007 is : 143
2015-02-12 12:09:08,744 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:09:08,744 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000007
2015-02-12 12:09:08,745 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000007
2015-02-12 12:09:08,745 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000007
2015-02-12 12:09:08,747 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000007
2015-02-12 12:09:08,748 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000007
2015-02-12 12:09:08,748 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:09:08,748 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0010_01_000007 from application application_1423771478362_0010
2015-02-12 12:09:08,748 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:09:08,748 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0010
2015-02-12 12:09:09,294 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:09:09,294 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0010_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 12:09:09,294 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000002
2015-02-12 12:09:09,294 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55673, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 12:09:09,295 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-02-12 12:09:09,295 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0010_01_000002, NodeId: 10.1.1.68:55673, NodeHttpAddress: 10.1.1.68:55676, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55673 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 cluster=<memory:16384, vCores:32>
2015-02-12 12:09:09,296 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:09:09,296 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:09:09,296 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0010_000001 released container container_1423771478362_0010_01_000002 on node: host: 10.1.1.68:55673 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 12:09:09,296 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:09,709 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:09,709 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:09,709 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:09,709 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:09:09,709 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0010_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 12:09:09,710 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000007
2015-02-12 12:09:09,710 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0010_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:09:09,710 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:09:09,711 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0010_01_000007, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:09:09,711 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:09:09,711 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:09:09,712 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0010_000001 released container container_1423771478362_0010_01_000007 on node: host: 10.1.1.68:55664 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:09:09,712 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 12:09:09,712 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000008
2015-02-12 12:09:09,713 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423771478362_0010_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 12:09:09,713 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1570)) - assignedContainer application attempt=appattempt_1423771478362_0010_000001 container=Container: [ContainerId: container_1423771478362_0010_01_000008, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 10, Token: null, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 clusterResource=<memory:16384, vCores:32>
2015-02-12 12:09:09,713 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(601)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>, usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-02-12 12:09:09,713 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(464)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-02-12 12:09:10,295 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0010_01_000003]
2015-02-12 12:09:10,295 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:10,295 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:10,439 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 12:09:10,448 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:09:10,450 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1423771478362_0010_01_000008 by user soberoi
2015-02-12 12:09:10,450 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000008
2015-02-12 12:09:10,450 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1423771478362_0010_01_000008 to application application_1423771478362_0010
2015-02-12 12:09:10,451 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 12:09:10,451 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423771478362_0010
2015-02-12 12:09:10,451 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423771478362_0010
2015-02-12 12:09:10,451 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 12:09:10,451 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423771478362_0010
2015-02-12 12:09:10,452 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 12:09:10,481 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 12:09:10,481 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:09:10,564 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000008/default_container_executor.sh]
2015-02-12 12:09:10,711 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0010_01_000005, container_1423771478362_0010_01_000006, container_1423771478362_0010_01_000004]
2015-02-12 12:09:10,711 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 12:09:10,712 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:10,712 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:10,712 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:10,712 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:11,297 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0010_01_000002]
2015-02-12 12:09:11,297 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:11,443 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 12:09:11,712 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(469)) - Removed completed containers from NM context: [container_1423771478362_0010_01_000007]
2015-02-12 12:09:11,713 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1190)) - Null container completed...
2015-02-12 12:09:13,099 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:09:13,105 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:09:13,112 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 12:09:13,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:09:13,393 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_r_000000_0/part-00000. BP-1120419527-10.1.1.68-1423771456695 blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]}
2015-02-12 12:09:13,479 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741939_1115 src: /127.0.0.1:57258 dest: /127.0.0.1:55519
2015-02-12 12:09:13,480 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741939_1115 src: /127.0.0.1:57259 dest: /127.0.0.1:55529
2015-02-12 12:09:13,482 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741939_1115 src: /127.0.0.1:57260 dest: /127.0.0.1:55522
2015-02-12 12:09:13,523 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57260, dest: /127.0.0.1:55522, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0010_r_000000_0_233812608_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741939_1115, duration: 39471000
2015-02-12 12:09:13,523 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741939_1115, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:09:13,523 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:09:13,524 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57259, dest: /127.0.0.1:55529, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0010_r_000000_0_233812608_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741939_1115, duration: 40288000
2015-02-12 12:09:13,524 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:09:13,525 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57258, dest: /127.0.0.1:55519, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1423771478362_0010_r_000000_0_233812608_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741939_1115, duration: 41480000
2015-02-12 12:09:13,525 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:09:13,525 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW]]} size 0
2015-02-12 12:09:13,526 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-065530ff-78aa-4c0c-96f5-5cc72fea570f:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:09:13,530 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_r_000000_0/part-00000 is closed by DFSClient_attempt_1423771478362_0010_r_000000_0_233812608_1
2015-02-12 12:09:13,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/task_1423771478362_0010_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/_temporary/attempt_1423771478362_0010_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/task_1423771478362_0010_r_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 12:09:13,575 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1423771478362_0010_000001 (auth:SIMPLE)
2015-02-12 12:09:13,576 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1423771478362_0010_01_000008
2015-02-12 12:09:13,576 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.68	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000008
2015-02-12 12:09:13,576 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000008 transitioned from RUNNING to KILLING
2015-02-12 12:09:13,577 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1423771478362_0010_01_000008
2015-02-12 12:09:13,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:09:13,585 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-2052970901_1
2015-02-12 12:09:13,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,592 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1423771478362_0010_01_000008 is : 143
2015-02-12 12:09:13,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/task_1423771478362_0010_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary/1/task_1423771478362_0010_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:09:13,604 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 12:09:13,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000008
2015-02-12 12:09:13,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000008
2015-02-12 12:09:13,605 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000008
2015-02-12 12:09:13,606 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1423771478362_0010_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 12:09:13,606 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1423771478362_0010_01_000008 from application application_1423771478362_0010
2015-02-12 12:09:13,606 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000008
2015-02-12 12:09:13,606 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/horton/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423771478362_0010/container_1423771478362_0010_01_000008
2015-02-12 12:09:13,606 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 12:09:13,607 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423771478362_0010
2015-02-12 12:09:13,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:09:13,616 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2052970901_1
2015-02-12 12:09:13,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:09:13,620 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2052970901_1
2015-02-12 12:09:13,639 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57243, dest: /127.0.0.1:55519, bytes: 75736, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741938_1114, duration: 5482887000
2015-02-12 12:09:13,640 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741938_1114, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:09:13,642 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 17048
2015-02-12 12:09:13,642 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57242, dest: /127.0.0.1:55529, bytes: 75736, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741938_1114, duration: 5483692000
2015-02-12 12:09:13,642 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:09:13,644 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 17048
2015-02-12 12:09:13,644 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57241, dest: /127.0.0.1:55522, bytes: 75736, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741938_1114, duration: 5487682000
2015-02-12 12:09:13,644 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:09:13,645 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW]]} size 17048
2015-02-12 12:09:13,647 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1.jhist is closed by DFSClient_NONMAPREDUCE_-2052970901_1
2015-02-12 12:09:13,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:09:13,653 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010.summary_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:09:13,655 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741940_1116 src: /127.0.0.1:57262 dest: /127.0.0.1:55519
2015-02-12 12:09:13,656 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741940_1116 src: /127.0.0.1:57263 dest: /127.0.0.1:55529
2015-02-12 12:09:13,658 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741940_1116 src: /127.0.0.1:57264 dest: /127.0.0.1:55526
2015-02-12 12:09:13,662 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57264, dest: /127.0.0.1:55526, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741940_1116, duration: 2186000
2015-02-12 12:09:13,662 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741940_1116, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:09:13,663 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57263, dest: /127.0.0.1:55529, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741940_1116, duration: 2403000
2015-02-12 12:09:13,663 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:09:13,665 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57262, dest: /127.0.0.1:55519, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741940_1116, duration: 4461000
2015-02-12 12:09:13,665 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:09:13,663 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:09:13,667 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:09:13,669 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]} size 0
2015-02-12 12:09:13,672 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010.summary_tmp is closed by DFSClient_NONMAPREDUCE_-2052970901_1
2015-02-12 12:09:13,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:09:13,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010-1423771729087-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2FE3CDD6F2F2F74520-1423771753621-6-1-SUCCEEDED-default-1423771733342.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010-1423771729087-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2FE3CDD6F2F2F74520-1423771753621-6-1-SUCCEEDED-default-1423771733342.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010-1423771729087-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2FE3CDD6F2F2F74520-1423771753621-6-1-SUCCEEDED-default-1423771733342.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:09:13,700 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010-1423771729087-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2FE3CDD6F2F2F74520-1423771753621-6-1-SUCCEEDED-default-1423771733342.jhist_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW]]}
2015-02-12 12:09:13,703 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741941_1117 src: /127.0.0.1:57266 dest: /127.0.0.1:55519
2015-02-12 12:09:13,705 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741941_1117 src: /127.0.0.1:57267 dest: /127.0.0.1:55529
2015-02-12 12:09:13,707 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741941_1117 src: /127.0.0.1:57268 dest: /127.0.0.1:55526
2015-02-12 12:09:13,710 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57268, dest: /127.0.0.1:55526, bytes: 75736, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741941_1117, duration: 1920000
2015-02-12 12:09:13,711 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741941_1117, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:09:13,711 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:09:13,711 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57267, dest: /127.0.0.1:55529, bytes: 75736, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741941_1117, duration: 2712000
2015-02-12 12:09:13,712 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:09:13,712 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bebf294-2850-45e2-b85c-2523885d0a4c:NORMAL:127.0.0.1:55519|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED]]} size 0
2015-02-12 12:09:13,712 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57266, dest: /127.0.0.1:55519, bytes: 75736, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: 7ec5b022-3233-4514-a91b-1e0cf5f7c9ec, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741941_1117, duration: 3656000
2015-02-12 12:09:13,712 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:09:13,713 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55519 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW], ReplicaUnderConstruction[[DISK]DS-4ce14610-be98-48ff-b28d-c33e2df27e44:NORMAL:127.0.0.1:55526|FINALIZED], ReplicaUnderConstruction[[DISK]DS-de43b62f-388f-4842-aba1-aeb68654489e:NORMAL:127.0.0.1:55519|FINALIZED]]} size 0
2015-02-12 12:09:13,715 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010-1423771729087-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2FE3CDD6F2F2F74520-1423771753621-6-1-SUCCEEDED-default-1423771733342.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-2052970901_1
2015-02-12 12:09:13,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010-1423771729087-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2FE3CDD6F2F2F74520-1423771753621-6-1-SUCCEEDED-default-1423771733342.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:09:13,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010/job_1423771478362_0010_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 12:09:13,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 12:09:13,731 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3663)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010_conf.xml_tmp. BP-1120419527-10.1.1.68-1423771456695 blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-ab94e6a9-03b6-4e4f-8a7a-11cdd9e4f6a2:NORMAL:127.0.0.1:55529|RBW]]}
2015-02-12 12:09:13,733 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741942_1118 src: /127.0.0.1:57270 dest: /127.0.0.1:55526
2015-02-12 12:09:13,735 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741942_1118 src: /127.0.0.1:57271 dest: /127.0.0.1:55522
2015-02-12 12:09:13,736 INFO  datanode.DataNode (DataXceiver.java:writeBlock(593)) - Receiving BP-1120419527-10.1.1.68-1423771456695:blk_1073741942_1118 src: /127.0.0.1:57272 dest: /127.0.0.1:55529
2015-02-12 12:09:13,741 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57272, dest: /127.0.0.1:55529, bytes: 116048, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: de9e44f0-e16e-4afe-864c-4a5fdf6d29d8, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741942_1118, duration: 2734000
2015-02-12 12:09:13,741 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741942_1118, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 12:09:13,742 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55529 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:09:13,742 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57271, dest: /127.0.0.1:55522, bytes: 116048, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: 6f1f07ca-bed1-44ce-aba8-b2d58eb2a3fa, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741942_1118, duration: 3275000
2015-02-12 12:09:13,742 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:09:13,743 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1292)) - src: /127.0.0.1:57270, dest: /127.0.0.1:55526, bytes: 116048, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2052970901_1, offset: 0, srvID: 96ab84db-3835-4ade-b715-a77ff6c7c57a, blockid: BP-1120419527-10.1.1.68-1423771456695:blk_1073741942_1118, duration: 4508000
2015-02-12 12:09:13,743 INFO  datanode.DataNode (BlockReceiver.java:run(1273)) - PacketResponder: BP-1120419527-10.1.1.68-1423771456695:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 12:09:13,743 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55522 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:09:13,744 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55526 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-775daf91-35b2-45ee-850c-935c071bf8ea:NORMAL:127.0.0.1:55526|RBW], ReplicaUnderConstruction[[DISK]DS-0db4e62b-fe02-4dc4-bf49-f3fa7b371739:NORMAL:127.0.0.1:55522|RBW], ReplicaUnderConstruction[[DISK]DS-e341031c-9900-4893-989b-b930fef79e2d:NORMAL:127.0.0.1:55529|FINALIZED]]} size 0
2015-02-12 12:09:13,746 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3584)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-2052970901_1
2015-02-12 12:09:13,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:09:13,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:09:13,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:09:13,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010-1423771729087-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2FE3CDD6F2F2F74520-1423771753621-6-1-SUCCEEDED-default-1423771733342.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423771478362_0010-1423771729087-soberoi-%5BF4B13C8AB332459A84BF1470AC8CEF2E%2FE3CDD6F2F2F74520-1423771753621-6-1-SUCCEEDED-default-1423771733342.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 12:09:13,763 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1129)) - Updating application attempt appattempt_1423771478362_0010_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 12:09:13,763 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0010_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 12:09:13,763 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(992)) - Updating application application_1423771478362_0010 with final state: FINISHING
2015-02-12 12:09:13,764 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0010 State change from RUNNING to FINAL_SAVING
2015-02-12 12:09:13,764 INFO  recovery.RMStateStore (RMStateStore.java:transition(161)) - Updating info for app: application_1423771478362_0010
2015-02-12 12:09:13,764 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(764)) - appattempt_1423771478362_0010_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 12:09:13,764 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(718)) - application_1423771478362_0010 State change from FINAL_SAVING to FINISHING
2015-02-12 12:09:14,581 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(380)) - container_1423771478362_0010_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 12:09:14,581 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(98)) - Completed container: container_1423771478362_0010_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 12:09:14,581 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(106)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423771478362_0010	CONTAINERID=container_1423771478362_0010_01_000008
2015-02-12 12:09:14,581 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423771478362_0010_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.68:55664, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 12:09:14,581 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1723)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-02-12 12:09:14,582 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1674)) - completedContainer container=Container: [ContainerId: container_1423771478362_0010_01_000008, NodeId: 10.1.1.68:55664, NodeHttpAddress: 10.1.1.68:55667, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.68:55664 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 cluster=<memory:16384, vCores:32>
2015-02-12 12:09:14,583 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(646)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-02-12 12:09:14,583 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(664)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>, usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-02-12 12:09:14,583 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(1215)) - Application attempt appattempt_1423771478362_0010_000001 released container container_1423771478362_0010_01_000008 on node: host: 10.1.1.68:55664 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 12:09:14,771 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(351)) - application_1423771478362_0010 unregistered successfully. 
2015-02-12 12:09:14,774 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741933_1109 127.0.0.1:55519 127.0.0.1:55529 127.0.0.1:55522 127.0.0.1:55526 
2015-02-12 12:09:14,774 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741934_1110 127.0.0.1:55526 127.0.0.1:55522 127.0.0.1:55519 127.0.0.1:55529 
2015-02-12 12:09:14,775 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741935_1111 127.0.0.1:55519 127.0.0.1:55529 127.0.0.1:55526 
2015-02-12 12:09:14,775 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741936_1112 127.0.0.1:55519 127.0.0.1:55529 127.0.0.1:55526 
2015-02-12 12:09:14,775 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741938_1114 127.0.0.1:55522 127.0.0.1:55529 127.0.0.1:55519 
2015-02-12 12:09:14,775 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1109)) - BLOCK* addToInvalidates: blk_1073741937_1113 127.0.0.1:55529 127.0.0.1:55522 127.0.0.1:55526 
2015-02-12 12:09:14,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423771478362_0010	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,819 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary
2015-02-12 12:09:14,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,821 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary
2015-02-12 12:09:14,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,836 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 12:09:14,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,854 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 4
2015-02-12 12:09:14,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,869 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/checkpoint/sink
2015-02-12 12:09:14,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/sink/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,876 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/checkpoint/tap
2015-02-12 12:09:14,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00001	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00002	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/checkpoint/tap/part-00003	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,905 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 12:09:14,905 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 12:09:14,909 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/duplicatecheckpoint
2015-02-12 12:09:14,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/duplicatecheckpoint	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,926 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 12:09:14,926 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 12:09:14,930 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/failcheckpoint/sink
2015-02-12 12:09:14,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/failcheckpoint/sink	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,931 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/failcheckpoint/tap
2015-02-12 12:09:14,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/failcheckpoint/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,946 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 12:09:14,946 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 12:09:14,948 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/failcheckpointdeclared/tap
2015-02-12 12:09:14,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/failcheckpointdeclared/tap	dst=null	perm=null	proto=rpc
2015-02-12 12:09:14,949 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/checkpointplatform/failcheckpointdeclared/sink
2015-02-12 12:09:14,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9311)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/checkpointplatform/failcheckpointdeclared/sink	dst=null	perm=null	proto=rpc

Standard error

Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@10078b10" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@740fa6b3" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@54db519" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@75ef6433" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@1f81b67d" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Feb 12, 2015 12:04:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
Feb 12, 2015 12:04:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
Feb 12, 2015 12:04:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Feb 12, 2015 12:04:39 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Feb 12, 2015 12:04:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 12:04:41 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 12:04:43 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
Feb 12, 2015 12:04:43 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Feb 12, 2015 12:04:43 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Feb 12, 2015 12:04:43 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Feb 12, 2015 12:04:43 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Feb 12, 2015 12:04:43 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.