Class cascading.flow.FlowProcessPlatformTest

all > cascading.flow > FlowProcessPlatformTest

tests

failures

ignored

29.295s

duration

100%

successful

Tests
Standard output
Standard error

Tests

Test	Duration	Result
testOpenForRead	29.295s	passed

Standard output

2015-03-13 10:45:19,804 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-03-13 10:45:19,832 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-03-13 10:45:19,833 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.flow.FlowProcessPlatformTest
2015-03-13 10:45:19,844 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(117)) - using cluster
2015-03-13 10:45:20,387 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-03-13 10:45:20,452 INFO  namenode.HostFileManager (HostFileManager.java:refresh(304)) - read includes:
HostSet(
)
2015-03-13 10:45:20,453 INFO  namenode.HostFileManager (HostFileManager.java:refresh(311)) - read excludes:
HostSet(
)
2015-03-13 10:45:20,454 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
2015-03-13 10:45:20,455 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(210)) - dfs.block.invalidate.limit=1000
2015-03-13 10:45:20,458 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlocksMap
2015-03-13 10:45:20,458 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:45:20,459 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 2.0% max memory = 672 MB
2015-03-13 10:45:20,460 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^21 = 2097152 entries
2015-03-13 10:45:20,465 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(314)) - dfs.block.access.token.enable=false
2015-03-13 10:45:20,466 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(300)) - defaultReplication         = 3
2015-03-13 10:45:20,466 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(301)) - maxReplication             = 512
2015-03-13 10:45:20,468 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(302)) - minReplication             = 1
2015-03-13 10:45:20,468 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(303)) - maxReplicationStreams      = 2
2015-03-13 10:45:20,468 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(304)) - shouldCheckForEnoughRacks  = false
2015-03-13 10:45:20,469 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(305)) - replicationRecheckInterval = 3000
2015-03-13 10:45:20,469 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(306)) - encryptDataTransfer        = false
2015-03-13 10:45:20,476 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(612)) - fsOwner             = soberoi (auth:SIMPLE)
2015-03-13 10:45:20,477 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(613)) - supergroup          = supergroup
2015-03-13 10:45:20,477 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(614)) - isPermissionEnabled = true
2015-03-13 10:45:20,478 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(628)) - HA Enabled: false
2015-03-13 10:45:20,480 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(665)) - Append Enabled: true
2015-03-13 10:45:20,727 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map INodeMap
2015-03-13 10:45:20,728 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:45:20,728 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 1.0% max memory = 672 MB
2015-03-13 10:45:20,728 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^20 = 1048576 entries
2015-03-13 10:45:20,731 INFO  namenode.NameNode (FSDirectory.java:<init>(173)) - Caching file names occuring more than 10 times
2015-03-13 10:45:20,735 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4362)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-03-13 10:45:20,735 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4363)) - dfs.namenode.safemode.min.datanodes = 0
2015-03-13 10:45:20,736 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4364)) - dfs.namenode.safemode.extension     = 0
2015-03-13 10:45:20,737 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(725)) - Retry cache on namenode is enabled
2015-03-13 10:45:20,738 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(733)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-03-13 10:45:20,740 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map Namenode Retry Cache
2015-03-13 10:45:20,741 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:45:20,741 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.029999999329447746% max memory = 672 MB
2015-03-13 10:45:20,741 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^15 = 32768 entries
2015-03-13 10:45:20,780 INFO  common.Storage (NNStorage.java:format(527)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1 has been successfully formatted.
2015-03-13 10:45:20,782 INFO  common.Storage (NNStorage.java:format(527)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2 has been successfully formatted.
2015-03-13 10:45:20,791 INFO  namenode.FSImage (FSImageFormat.java:save(976)) - Saving image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current/fsimage.ckpt_0000000000000000000 using no compression
2015-03-13 10:45:20,791 INFO  namenode.FSImage (FSImageFormat.java:save(976)) - Saving image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage.ckpt_0000000000000000000 using no compression
2015-03-13 10:45:20,801 INFO  namenode.FSImage (FSImageFormat.java:save(1004)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage.ckpt_0000000000000000000 of size 199 bytes saved in 0 seconds.
2015-03-13 10:45:20,801 INFO  namenode.FSImage (FSImageFormat.java:save(1004)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current/fsimage.ckpt_0000000000000000000 of size 199 bytes saved in 0 seconds.
2015-03-13 10:45:20,809 INFO  namenode.NNStorageRetentionManager (NNStorageRetentionManager.java:getImageTxIdToRetain(177)) - Going to retain 1 images with txid >= 0
2015-03-13 10:45:20,843 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-03-13 10:45:20,885 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(344)) - Scheduled snapshot period at 10 second(s).
2015-03-13 10:45:20,885 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:start(183)) - NameNode metrics system started
2015-03-13 10:45:20,928 INFO  mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-03-13 10:45:20,965 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:45:20,968 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
2015-03-13 10:45:20,968 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:45:20,969 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:45:20,978 INFO  http.HttpServer (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:45:20,988 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 56671
2015-03-13 10:45:20,989 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:45:21,008 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/hdfs to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_56671_hdfs____yngw6x/webapp
2015-03-13 10:45:21,221 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:56671
2015-03-13 10:45:21,221 INFO  namenode.NameNode (NameNode.java:setHttpServerAddress(439)) - Web-server up at: localhost:56671
2015-03-13 10:45:21,223 INFO  namenode.HostFileManager (HostFileManager.java:refresh(304)) - read includes:
HostSet(
)
2015-03-13 10:45:21,224 INFO  namenode.HostFileManager (HostFileManager.java:refresh(311)) - read excludes:
HostSet(
)
2015-03-13 10:45:21,224 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(210)) - dfs.block.invalidate.limit=1000
2015-03-13 10:45:21,225 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlocksMap
2015-03-13 10:45:21,225 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:45:21,225 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 2.0% max memory = 672 MB
2015-03-13 10:45:21,226 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^21 = 2097152 entries
2015-03-13 10:45:21,227 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(314)) - dfs.block.access.token.enable=false
2015-03-13 10:45:21,228 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(300)) - defaultReplication         = 3
2015-03-13 10:45:21,228 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(301)) - maxReplication             = 512
2015-03-13 10:45:21,228 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(302)) - minReplication             = 1
2015-03-13 10:45:21,228 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(303)) - maxReplicationStreams      = 2
2015-03-13 10:45:21,229 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(304)) - shouldCheckForEnoughRacks  = false
2015-03-13 10:45:21,229 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(305)) - replicationRecheckInterval = 3000
2015-03-13 10:45:21,229 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(306)) - encryptDataTransfer        = false
2015-03-13 10:45:21,230 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(612)) - fsOwner             = soberoi (auth:SIMPLE)
2015-03-13 10:45:21,230 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(613)) - supergroup          = supergroup
2015-03-13 10:45:21,230 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(614)) - isPermissionEnabled = true
2015-03-13 10:45:21,231 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(628)) - HA Enabled: false
2015-03-13 10:45:21,231 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(665)) - Append Enabled: true
2015-03-13 10:45:21,232 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map INodeMap
2015-03-13 10:45:21,232 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:45:21,232 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 1.0% max memory = 672 MB
2015-03-13 10:45:21,233 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^20 = 1048576 entries
2015-03-13 10:45:21,234 INFO  namenode.NameNode (FSDirectory.java:<init>(173)) - Caching file names occuring more than 10 times
2015-03-13 10:45:21,234 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4362)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-03-13 10:45:21,234 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4363)) - dfs.namenode.safemode.min.datanodes = 0
2015-03-13 10:45:21,235 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4364)) - dfs.namenode.safemode.extension     = 0
2015-03-13 10:45:21,235 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(725)) - Retry cache on namenode is enabled
2015-03-13 10:45:21,235 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(733)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-03-13 10:45:21,236 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map Namenode Retry Cache
2015-03-13 10:45:21,236 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:45:21,236 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.029999999329447746% max memory = 672 MB
2015-03-13 10:45:21,237 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^15 = 32768 entries
2015-03-13 10:45:21,241 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/in_use.lock acquired by nodename 21679@Edinburgh.local
2015-03-13 10:45:21,244 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/in_use.lock acquired by nodename 21679@Edinburgh.local
2015-03-13 10:45:21,247 INFO  namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(305)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current
2015-03-13 10:45:21,248 INFO  namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(305)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current
2015-03-13 10:45:21,249 INFO  namenode.FSImage (FSImage.java:loadFSImage(627)) - No edit log streams selected.
2015-03-13 10:45:21,253 INFO  namenode.FSImage (FSImageFormat.java:load(330)) - Loading image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000 using no compression
2015-03-13 10:45:21,253 INFO  namenode.FSImage (FSImageFormat.java:load(333)) - Number of files = 1
2015-03-13 10:45:21,255 INFO  namenode.FSImage (FSImageFormat.java:loadFilesUnderConstruction(815)) - Number of files under construction = 0
2015-03-13 10:45:21,255 INFO  namenode.FSImage (FSImageFormat.java:load(365)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000 of size 199 bytes loaded in 0 seconds.
2015-03-13 10:45:21,256 INFO  namenode.FSImage (FSImage.java:loadFSImage(837)) - Loaded image for txid 0 from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000
2015-03-13 10:45:21,260 INFO  namenode.FSEditLog (FSEditLog.java:startLogSegment(1010)) - Starting log segment at 1
2015-03-13 10:45:21,318 INFO  namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2015-03-13 10:45:21,318 INFO  namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(571)) - Finished loading FSImage in 81 msecs
2015-03-13 10:45:21,438 INFO  namenode.NameNode (NameNodeRpcServer.java:<init>(271)) - RPC server is binding to localhost:0
2015-03-13 10:45:21,450 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56672
2015-03-13 10:45:21,466 INFO  namenode.FSNamesystem (FSNamesystem.java:registerMBean(5310)) - Registered FSNamesystemState MBean
2015-03-13 10:45:21,484 INFO  namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(4965)) - Number of blocks under construction: 0
2015-03-13 10:45:21,485 INFO  namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(4965)) - Number of blocks under construction: 0
2015-03-13 10:45:21,485 INFO  namenode.FSNamesystem (FSNamesystem.java:initializeReplQueues(4475)) - initializing replication queues
2015-03-13 10:45:21,492 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2316)) - Total number of blocks            = 0
2015-03-13 10:45:21,492 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2317)) - Number of invalid blocks          = 0
2015-03-13 10:45:21,492 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2318)) - Number of under-replicated blocks = 0
2015-03-13 10:45:21,493 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2319)) - Number of  over-replicated blocks = 0
2015-03-13 10:45:21,493 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2321)) - Number of blocks being written    = 0
2015-03-13 10:45:21,493 INFO  hdfs.StateChange (FSNamesystem.java:initializeReplQueues(4480)) - STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 8 msec
2015-03-13 10:45:21,493 INFO  hdfs.StateChange (FSNamesystem.java:leave(4444)) - STATE* Leaving safe mode after 0 secs
2015-03-13 10:45:21,494 INFO  hdfs.StateChange (FSNamesystem.java:leave(4455)) - STATE* Network topology has 0 racks and 0 datanodes
2015-03-13 10:45:21,494 INFO  hdfs.StateChange (FSNamesystem.java:leave(4458)) - STATE* UnderReplicatedBlocks has 0 blocks
2015-03-13 10:45:21,511 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:21,511 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56672: starting
2015-03-13 10:45:21,513 INFO  namenode.NameNode (NameNode.java:startCommonServices(570)) - NameNode RPC up at: localhost/127.0.0.1:56672
2015-03-13 10:45:21,514 INFO  namenode.FSNamesystem (FSNamesystem.java:startActiveServices(886)) - Starting services required for active state
2015-03-13 10:45:21,536 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 0 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2
2015-03-13 10:45:21,589 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:45:21,589 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:45:21,594 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:56673
2015-03-13 10:45:21,596 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:45:21,598 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:45:21,600 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:45:21,600 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:45:21,600 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:45:21,601 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:45:21,604 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:45:21,604 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 56674
2015-03-13 10:45:21,604 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:45:21,608 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_56674_datanode____.eihebr/webapp
2015-03-13 10:45:21,712 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:56674
2015-03-13 10:45:21,718 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56675
2015-03-13 10:45:21,723 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:56675
2015-03-13 10:45:21,729 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:45:21,732 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:45:21,737 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:56672 starting to offer service
2015-03-13 10:45:21,740 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:21,740 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56675: starting
2015-03-13 10:45:21,743 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 1 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4
2015-03-13 10:45:21,767 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:45:21,767 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:45:21,768 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:56676
2015-03-13 10:45:21,768 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:45:21,770 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:45:21,771 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:45:21,771 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:45:21,771 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:45:21,772 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:45:21,773 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:45:21,774 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 56677
2015-03-13 10:45:21,774 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:45:21,778 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_56677_datanode____.t2jbyc/webapp
2015-03-13 10:45:21,885 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:56677
2015-03-13 10:45:21,887 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56679
2015-03-13 10:45:21,889 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:56679
2015-03-13 10:45:21,892 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:45:21,893 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:45:21,894 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:56672 starting to offer service
2015-03-13 10:45:21,894 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:21,894 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56679: starting
2015-03-13 10:45:21,897 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 2 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6
2015-03-13 10:45:21,924 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:45:21,924 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:45:21,925 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:56680
2015-03-13 10:45:21,925 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:45:21,926 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:45:21,927 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:45:21,928 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:45:21,928 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:45:21,929 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:45:21,930 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:45:21,930 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 56681
2015-03-13 10:45:21,930 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:45:21,934 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_56681_datanode____.8bfc8b/webapp
2015-03-13 10:45:21,960 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/in_use.lock acquired by nodename 21679@Edinburgh.local
2015-03-13 10:45:21,960 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/in_use.lock acquired by nodename 21679@Edinburgh.local
2015-03-13 10:45:21,961 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3 is not formatted
2015-03-13 10:45:21,961 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:45:21,961 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1 is not formatted
2015-03-13 10:45:21,961 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:45:21,962 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/in_use.lock acquired by nodename 21679@Edinburgh.local
2015-03-13 10:45:21,962 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4 is not formatted
2015-03-13 10:45:21,962 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:45:21,962 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/in_use.lock acquired by nodename 21679@Edinburgh.local
2015-03-13 10:45:21,963 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2 is not formatted
2015-03-13 10:45:21,963 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:45:22,013 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:45:22,013 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:45:22,014 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-526406211-10.1.1.144-1426268720751 is not formatted.
2015-03-13 10:45:22,014 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:45:22,014 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-526406211-10.1.1.144-1426268720751 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-526406211-10.1.1.144-1426268720751/current
2015-03-13 10:45:22,014 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-526406211-10.1.1.144-1426268720751 is not formatted.
2015-03-13 10:45:22,014 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:45:22,014 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-526406211-10.1.1.144-1426268720751 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-526406211-10.1.1.144-1426268720751/current
2015-03-13 10:45:22,015 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:45:22,015 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-526406211-10.1.1.144-1426268720751 is not formatted.
2015-03-13 10:45:22,015 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:45:22,015 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:45:22,015 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-526406211-10.1.1.144-1426268720751 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-526406211-10.1.1.144-1426268720751/current
2015-03-13 10:45:22,015 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-526406211-10.1.1.144-1426268720751 is not formatted.
2015-03-13 10:45:22,016 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:45:22,016 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-526406211-10.1.1.144-1426268720751 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-526406211-10.1.1.144-1426268720751/current
2015-03-13 10:45:22,017 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=211384765;bpid=BP-526406211-10.1.1.144-1426268720751;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0;bpid=BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,018 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=211384765;bpid=BP-526406211-10.1.1.144-1426268720751;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0;bpid=BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,028 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current
2015-03-13 10:45:22,028 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current
2015-03-13 10:45:22,028 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current
2015-03-13 10:45:22,029 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current
2015-03-13 10:45:22,033 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:45:22,034 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:45:22,038 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426282356038 with interval 21600000
2015-03-13 10:45:22,039 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,039 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426273192039 with interval 21600000
2015-03-13 10:45:22,040 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current...
2015-03-13 10:45:22,040 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current...
2015-03-13 10:45:22,040 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,041 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current...
2015-03-13 10:45:22,041 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current...
2015-03-13 10:45:22,067 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-526406211-10.1.1.144-1426268720751 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current: 27ms
2015-03-13 10:45:22,067 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-526406211-10.1.1.144-1426268720751 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current: 26ms
2015-03-13 10:45:22,067 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-526406211-10.1.1.144-1426268720751 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current: 26ms
2015-03-13 10:45:22,067 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-526406211-10.1.1.144-1426268720751: 27ms
2015-03-13 10:45:22,068 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-526406211-10.1.1.144-1426268720751 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current: 28ms
2015-03-13 10:45:22,068 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current...
2015-03-13 10:45:22,068 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-526406211-10.1.1.144-1426268720751: 29ms
2015-03-13 10:45:22,068 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current...
2015-03-13 10:45:22,068 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current: 0ms
2015-03-13 10:45:22,069 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current...
2015-03-13 10:45:22,069 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current: 0ms
2015-03-13 10:45:22,069 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current...
2015-03-13 10:45:22,069 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current: 0ms
2015-03-13 10:45:22,069 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:45:22,069 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current: 0ms
2015-03-13 10:45:22,069 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:45:22,071 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1870145783-10.1.1.144-56676-1426268721963) service to localhost/127.0.0.1:56672 beginning handshake with NN
2015-03-13 10:45:22,071 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1826935060-10.1.1.144-56673-1426268721965) service to localhost/127.0.0.1:56672 beginning handshake with NN
2015-03-13 10:45:22,080 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1826935060-10.1.1.144-56673-1426268721965, infoPort=56674, ipcPort=56675, storageInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0) storage DS-1826935060-10.1.1.144-56673-1426268721965
2015-03-13 10:45:22,083 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:56673
2015-03-13 10:45:22,083 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1870145783-10.1.1.144-56676-1426268721963, infoPort=56677, ipcPort=56679, storageInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0) storage DS-1870145783-10.1.1.144-56676-1426268721963
2015-03-13 10:45:22,084 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:56676
2015-03-13 10:45:22,086 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1826935060-10.1.1.144-56673-1426268721965) service to localhost/127.0.0.1:56672 successfully registered with NN
2015-03-13 10:45:22,087 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:56672 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:45:22,087 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1870145783-10.1.1.144-56676-1426268721963) service to localhost/127.0.0.1:56672 successfully registered with NN
2015-03-13 10:45:22,087 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:56672 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:45:22,093 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:56681
2015-03-13 10:45:22,094 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56682
2015-03-13 10:45:22,097 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:56682
2015-03-13 10:45:22,102 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:45:22,103 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:45:22,104 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:56672 starting to offer service
2015-03-13 10:45:22,104 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:22,104 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56682: starting
2015-03-13 10:45:22,106 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 3 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8
2015-03-13 10:45:22,107 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/in_use.lock acquired by nodename 21679@Edinburgh.local
2015-03-13 10:45:22,107 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5 is not formatted
2015-03-13 10:45:22,107 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:45:22,108 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/in_use.lock acquired by nodename 21679@Edinburgh.local
2015-03-13 10:45:22,109 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6 is not formatted
2015-03-13 10:45:22,109 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:45:22,115 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1826935060-10.1.1.144-56673-1426268721965) service to localhost/127.0.0.1:56672 trying to claim ACTIVE state with txid=1
2015-03-13 10:45:22,115 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1826935060-10.1.1.144-56673-1426268721965) service to localhost/127.0.0.1:56672
2015-03-13 10:45:22,115 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1870145783-10.1.1.144-56676-1426268721963) service to localhost/127.0.0.1:56672 trying to claim ACTIVE state with txid=1
2015-03-13 10:45:22,116 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1870145783-10.1.1.144-56676-1426268721963) service to localhost/127.0.0.1:56672
2015-03-13 10:45:22,128 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:56676 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:45:22,129 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:56673 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:45:22,129 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1870145783-10.1.1.144-56676-1426268721963, infoPort=56677, ipcPort=56679, storageInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0), blocks: 0, processing time: 2 msecs
2015-03-13 10:45:22,129 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1826935060-10.1.1.144-56673-1426268721965, infoPort=56674, ipcPort=56675, storageInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0), blocks: 0, processing time: 0 msecs
2015-03-13 10:45:22,145 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:45:22,146 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:45:22,146 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 1 msec to generate and 30 msecs for RPC and NN processing
2015-03-13 10:45:22,146 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@5d55eb2f
2015-03-13 10:45:22,146 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 0 msec to generate and 30 msecs for RPC and NN processing
2015-03-13 10:45:22,146 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@33c38a88
2015-03-13 10:45:22,147 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:56683
2015-03-13 10:45:22,148 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:45:22,149 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:45:22,149 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:45:22,149 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:45:22,149 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:45:22,150 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,150 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:45:22,149 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:45:22,151 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:45:22,151 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:45:22,151 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:45:22,151 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:45:22,152 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:45:22,152 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:45:22,153 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-526406211-10.1.1.144-1426268720751 to blockPoolScannerMap, new size=1
2015-03-13 10:45:22,152 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,154 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:45:22,154 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-526406211-10.1.1.144-1426268720751 to blockPoolScannerMap, new size=1
2015-03-13 10:45:22,155 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:45:22,156 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 56684
2015-03-13 10:45:22,156 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:45:22,156 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:45:22,157 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-526406211-10.1.1.144-1426268720751 is not formatted.
2015-03-13 10:45:22,157 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:45:22,157 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-526406211-10.1.1.144-1426268720751 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-526406211-10.1.1.144-1426268720751/current
2015-03-13 10:45:22,158 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:45:22,158 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-526406211-10.1.1.144-1426268720751 is not formatted.
2015-03-13 10:45:22,158 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:45:22,158 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-526406211-10.1.1.144-1426268720751 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-526406211-10.1.1.144-1426268720751/current
2015-03-13 10:45:22,160 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=211384765;bpid=BP-526406211-10.1.1.144-1426268720751;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0;bpid=BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,160 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current
2015-03-13 10:45:22,161 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current
2015-03-13 10:45:22,161 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:45:22,161 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_56684_datanode____.mvh9uw/webapp
2015-03-13 10:45:22,162 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426278260162 with interval 21600000
2015-03-13 10:45:22,162 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,163 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current...
2015-03-13 10:45:22,163 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current...
2015-03-13 10:45:22,170 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-526406211-10.1.1.144-1426268720751 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current: 7ms
2015-03-13 10:45:22,171 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-526406211-10.1.1.144-1426268720751 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current: 8ms
2015-03-13 10:45:22,171 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-526406211-10.1.1.144-1426268720751: 8ms
2015-03-13 10:45:22,171 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current...
2015-03-13 10:45:22,171 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current: 0ms
2015-03-13 10:45:22,171 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current...
2015-03-13 10:45:22,171 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current: 0ms
2015-03-13 10:45:22,172 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:45:22,172 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1915237370-10.1.1.144-56680-1426268722110) service to localhost/127.0.0.1:56672 beginning handshake with NN
2015-03-13 10:45:22,173 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1915237370-10.1.1.144-56680-1426268722110, infoPort=56681, ipcPort=56682, storageInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0) storage DS-1915237370-10.1.1.144-56680-1426268722110
2015-03-13 10:45:22,173 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:56680
2015-03-13 10:45:22,174 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1915237370-10.1.1.144-56680-1426268722110) service to localhost/127.0.0.1:56672 successfully registered with NN
2015-03-13 10:45:22,174 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:56672 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:45:22,175 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1915237370-10.1.1.144-56680-1426268722110) service to localhost/127.0.0.1:56672 trying to claim ACTIVE state with txid=1
2015-03-13 10:45:22,175 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1915237370-10.1.1.144-56680-1426268722110) service to localhost/127.0.0.1:56672
2015-03-13 10:45:22,176 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:56680 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:45:22,176 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1915237370-10.1.1.144-56680-1426268722110, infoPort=56681, ipcPort=56682, storageInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0), blocks: 0, processing time: 0 msecs
2015-03-13 10:45:22,177 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 0 msec to generate and 2 msecs for RPC and NN processing
2015-03-13 10:45:22,177 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@18db9a2
2015-03-13 10:45:22,177 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:45:22,177 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:45:22,177 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:45:22,177 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:45:22,178 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,178 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-526406211-10.1.1.144-1426268720751 to blockPoolScannerMap, new size=1
2015-03-13 10:45:22,291 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:56684
2015-03-13 10:45:22,293 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56685
2015-03-13 10:45:22,295 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:56685
2015-03-13 10:45:22,299 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:45:22,300 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:45:22,301 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:56672 starting to offer service
2015-03-13 10:45:22,302 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56685: starting
2015-03-13 10:45:22,301 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:22,304 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/in_use.lock acquired by nodename 21679@Edinburgh.local
2015-03-13 10:45:22,305 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7 is not formatted
2015-03-13 10:45:22,305 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:45:22,306 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/in_use.lock acquired by nodename 21679@Edinburgh.local
2015-03-13 10:45:22,306 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8 is not formatted
2015-03-13 10:45:22,306 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:45:22,349 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:45:22,350 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-526406211-10.1.1.144-1426268720751 is not formatted.
2015-03-13 10:45:22,350 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:45:22,350 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-526406211-10.1.1.144-1426268720751 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-526406211-10.1.1.144-1426268720751/current
2015-03-13 10:45:22,351 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:45:22,351 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-526406211-10.1.1.144-1426268720751 is not formatted.
2015-03-13 10:45:22,351 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:45:22,351 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-526406211-10.1.1.144-1426268720751 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-526406211-10.1.1.144-1426268720751/current
2015-03-13 10:45:22,353 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=211384765;bpid=BP-526406211-10.1.1.144-1426268720751;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0;bpid=BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,353 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current
2015-03-13 10:45:22,353 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current
2015-03-13 10:45:22,354 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:45:22,355 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426289725355 with interval 21600000
2015-03-13 10:45:22,356 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,356 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current...
2015-03-13 10:45:22,357 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current...
2015-03-13 10:45:22,364 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-526406211-10.1.1.144-1426268720751 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current: 7ms
2015-03-13 10:45:22,364 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-526406211-10.1.1.144-1426268720751 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current: 7ms
2015-03-13 10:45:22,364 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-526406211-10.1.1.144-1426268720751: 8ms
2015-03-13 10:45:22,364 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current...
2015-03-13 10:45:22,365 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current: 1ms
2015-03-13 10:45:22,365 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current...
2015-03-13 10:45:22,365 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-526406211-10.1.1.144-1426268720751 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current: 0ms
2015-03-13 10:45:22,365 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:45:22,365 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1786258516-10.1.1.144-56683-1426268722307) service to localhost/127.0.0.1:56672 beginning handshake with NN
2015-03-13 10:45:22,366 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1786258516-10.1.1.144-56683-1426268722307, infoPort=56684, ipcPort=56685, storageInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0) storage DS-1786258516-10.1.1.144-56683-1426268722307
2015-03-13 10:45:22,366 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:56683
2015-03-13 10:45:22,367 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1786258516-10.1.1.144-56683-1426268722307) service to localhost/127.0.0.1:56672 successfully registered with NN
2015-03-13 10:45:22,367 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:56672 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:45:22,369 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1786258516-10.1.1.144-56683-1426268722307) service to localhost/127.0.0.1:56672 trying to claim ACTIVE state with txid=1
2015-03-13 10:45:22,369 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-526406211-10.1.1.144-1426268720751 (storage id DS-1786258516-10.1.1.144-56683-1426268722307) service to localhost/127.0.0.1:56672
2015-03-13 10:45:22,371 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:56683 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:45:22,371 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1786258516-10.1.1.144-56683-1426268722307, infoPort=56684, ipcPort=56685, storageInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0), blocks: 0, processing time: 0 msecs
2015-03-13 10:45:22,372 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 0 msec to generate and 3 msecs for RPC and NN processing
2015-03-13 10:45:22,372 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@6bb79087
2015-03-13 10:45:22,372 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:45:22,372 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:45:22,372 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:45:22,372 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:45:22,373 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-526406211-10.1.1.144-1426268720751
2015-03-13 10:45:22,373 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-526406211-10.1.1.144-1426268720751 to blockPoolScannerMap, new size=1
2015-03-13 10:45:22,547 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(1891)) - Cluster is active
2015-03-13 10:45:22,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:22,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:22,621 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar. BP-526406211-10.1.1.144-1426268720751 blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]}
2015-03-13 10:45:22,669 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001 src: /127.0.0.1:56687 dest: /127.0.0.1:56673
2015-03-13 10:45:22,677 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001 src: /127.0.0.1:56688 dest: /127.0.0.1:56683
2015-03-13 10:45:22,679 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001 src: /127.0.0.1:56689 dest: /127.0.0.1:56676
2015-03-13 10:45:22,720 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56689, dest: /127.0.0.1:56676, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001, duration: 26474000
2015-03-13 10:45:22,720 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:22,720 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:22,721 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56688, dest: /127.0.0.1:56683, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001, duration: 29899000
2015-03-13 10:45:22,721 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:22,722 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:22,722 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56687, dest: /127.0.0.1:56673, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001, duration: 31046000
2015-03-13 10:45:22,723 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:22,723 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56673 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:22,727 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar is closed by DFSClient_NONMAPREDUCE_234741904_9
2015-03-13 10:45:22,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=soberoi:supergroup:rwxr--r--
2015-03-13 10:45:22,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:22,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:22,847 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar. BP-526406211-10.1.1.144-1426268720751 blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]}
2015-03-13 10:45:22,849 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002 src: /127.0.0.1:56690 dest: /127.0.0.1:56680
2015-03-13 10:45:22,851 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002 src: /127.0.0.1:56691 dest: /127.0.0.1:56676
2015-03-13 10:45:22,852 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002 src: /127.0.0.1:56692 dest: /127.0.0.1:56683
2015-03-13 10:45:22,876 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56692, dest: /127.0.0.1:56683, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002, duration: 22663000
2015-03-13 10:45:22,877 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:22,877 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:22,878 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56691, dest: /127.0.0.1:56676, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002, duration: 23823000
2015-03-13 10:45:22,878 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:22,878 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:22,879 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56690, dest: /127.0.0.1:56680, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002, duration: 24943000
2015-03-13 10:45:22,879 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:22,880 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:22,881 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar is closed by DFSClient_NONMAPREDUCE_234741904_9
2015-03-13 10:45:22,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=soberoi:supergroup:rwxr--r--
2015-03-13 10:45:22,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging	dst=null	perm=null
2015-03-13 10:45:22,967 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceInit(150)) - mkdir: hdfs://localhost:56672/tmp/hadoop-yarn/staging
2015-03-13 10:45:22,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:45:22,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:45:23,025 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:rollMasterKey(107)) - Rolling master-key for amrm-tokens
2015-03-13 10:45:23,030 INFO  security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:<init>(75)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
2015-03-13 10:45:23,033 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:<init>(77)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms
2015-03-13 10:45:23,035 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
2015-03-13 10:45:23,037 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
2015-03-13 10:45:23,038 INFO  resourcemanager.ResourceManager (ResourceManager.java:createScheduler(328)) - Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
2015-03-13 10:45:23,065 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
2015-03-13 10:45:23,067 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
2015-03-13 10:45:23,068 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
2015-03-13 10:45:23,070 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
2015-03-13 10:45:23,081 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - ResourceManager metrics system started (again)
2015-03-13 10:45:23,111 INFO  capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(189)) - root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APPLICATIONS:*ADMINISTER_QUEUE:*
2015-03-13 10:45:23,111 INFO  capacity.ParentQueue (ParentQueue.java:<init>(151)) - Initialized parent-queue root name=root, fullname=root
2015-03-13 10:45:23,117 INFO  capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(271)) - Initializing default
capacity = 1.0 [= (float) configuredCapacity / 100 ]
asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]
maxCapacity = 1.0 [= configuredMaxCapacity ]
absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]
userLimit = 100 [= configuredUserLimit ]
userLimitFactor = 1.0 [= configuredUserLimitFactor ]
maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)]
maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ]
maxActiveApplications = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) * maxAMResourcePerQueuePercent * absoluteMaxCapacity),1) ]
maxActiveAppsUsingAbsCap = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) *maxAMResourcePercent * absoluteCapacity),1) ]
maxActiveApplicationsPerUser = 1 [= max((int)(maxActiveApplications * (userLimit / 100.0f) * userLimitFactor),1) ]
usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)]
absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]
maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]
minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ]
numContainers = 0 [= currentNumContainers ]
state = RUNNING [= configuredState ]
acls = SUBMIT_APPLICATIONS:*ADMINISTER_QUEUE:* [= configuredAcls ]
nodeLocalityDelay = 0

2015-03-13 10:45:23,118 INFO  capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(409)) - Initialized queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:45:23,119 INFO  capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(409)) - Initialized queue: root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:45:23,119 INFO  capacity.CapacityScheduler (CapacityScheduler.java:initializeQueues(307)) - Initialized root queue root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:45:23,119 INFO  capacity.CapacityScheduler (CapacityScheduler.java:reinitialize(271)) - Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<<memory:1024, vCores:1>>, maximumAllocation=<<memory:8192, vCores:32>>
2015-03-13 10:45:23,138 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
2015-03-13 10:45:23,143 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
2015-03-13 10:45:23,144 INFO  resourcemanager.RMNMInfo (RMNMInfo.java:<init>(63)) - Registered RMNMInfo MBean
2015-03-13 10:45:23,145 INFO  util.HostsFileReader (HostsFileReader.java:refresh(84)) - Refreshing hosts (include/exclude) list
2015-03-13 10:45:23,147 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(225)) - Waiting for RM to start...
2015-03-13 10:45:23,147 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:rollMasterKey(107)) - Rolling master-key for amrm-tokens
2015-03-13 10:45:23,147 INFO  security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(103)) - Rolling master-key for container-tokens
2015-03-13 10:45:23,149 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(97)) - Rolling master-key for nm-tokens
2015-03-13 10:45:23,155 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:45:23,155 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
2015-03-13 10:45:23,156 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:45:23,156 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:45:23,156 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /cluster/*
2015-03-13 10:45:23,157 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:45:23,158 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 56693
2015-03-13 10:45:23,158 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:45:23,161 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/cluster to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_56693_cluster____.fa8otv/webapp
2015-03-13 10:45:23,245 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:56693
2015-03-13 10:45:23,245 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /cluster started at 56693
2015-03-13 10:45:23,454 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:45:23,455 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:45:23,455 INFO  security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(85)) - storing master key with keyID 1
2015-03-13 10:45:23,456 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(526)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-03-13 10:45:23,456 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:45:23,457 INFO  security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(85)) - storing master key with keyID 2
2015-03-13 10:45:23,464 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56694
2015-03-13 10:45:23,466 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
2015-03-13 10:45:23,467 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:23,467 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56694: starting
2015-03-13 10:45:23,480 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56695
2015-03-13 10:45:23,482 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server
2015-03-13 10:45:23,482 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:23,482 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56695: starting
2015-03-13 10:45:23,503 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56696
2015-03-13 10:45:23,505 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server
2015-03-13 10:45:23,506 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:23,506 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56696: starting
2015-03-13 10:45:23,524 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56697
2015-03-13 10:45:23,526 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server
2015-03-13 10:45:23,527 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:23,527 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56697: starting
2015-03-13 10:45:24,649 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(238)) - MiniYARN ResourceManager address: 10.1.1.144:56696
2015-03-13 10:45:24,649 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(240)) - MiniYARN ResourceManager web address: Edinburgh.local:56693
2015-03-13 10:45:24,650 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0
2015-03-13 10:45:24,650 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1
2015-03-13 10:45:24,651 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2
2015-03-13 10:45:24,651 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3
2015-03-13 10:45:24,666 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_0
2015-03-13 10:45:24,666 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_1
2015-03-13 10:45:24,667 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_2
2015-03-13 10:45:24,667 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_3
2015-03-13 10:45:24,667 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 0
2015-03-13 10:45:24,726 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:45:24,726 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:45:24,727 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:45:24,728 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:45:24,728 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:45:24,729 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:45:24,730 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:45:24,730 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:45:24,731 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:45:24,737 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:45:24,737 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:45:24,868 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:45:24,877 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:45:24,878 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:45:24,894 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:45:24,895 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:45:24,895 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:45:24,895 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:45:24,896 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:45:24,896 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 0 to start...
2015-03-13 10:45:24,904 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56698
2015-03-13 10:45:24,906 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:45:24,906 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:45:24,906 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:24,907 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56698: starting
2015-03-13 10:45:24,912 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:56698
2015-03-13 10:45:24,912 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:56698
2015-03-13 10:45:24,916 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56699
2015-03-13 10:45:24,918 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:45:24,919 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:24,919 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56699: starting
2015-03-13 10:45:24,920 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 56699
2015-03-13 10:45:24,928 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:45:24,937 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 56700
2015-03-13 10:45:24,938 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:24,939 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:45:24,940 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:45:24,940 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:45:24,940 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:45:24,940 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:45:24,941 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:45:24,941 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:45:24,941 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 56701
2015-03-13 10:45:24,941 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:45:24,946 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_56701_node____.blst2b/webapp
2015-03-13 10:45:25,727 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:56701
2015-03-13 10:45:25,727 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 56701
2015-03-13 10:45:25,740 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:45:25,753 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:45:25,754 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 56698 httpPort: 56701) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:56698
2015-03-13 10:45:25,754 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -953802549
2015-03-13 10:45:25,756 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1190429264
2015-03-13 10:45:25,756 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:56698 with total resource of <memory:4096, vCores:8>
2015-03-13 10:45:25,756 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:45:25,758 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:56698 Node Transitioned from NEW to RUNNING
2015-03-13 10:45:25,759 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:56698 clusterResource: <memory:4096, vCores:8>
2015-03-13 10:45:25,899 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0
2015-03-13 10:45:25,900 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1
2015-03-13 10:45:25,900 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2
2015-03-13 10:45:25,901 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3
2015-03-13 10:45:25,914 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_0
2015-03-13 10:45:25,915 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_1
2015-03-13 10:45:25,915 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_2
2015-03-13 10:45:25,915 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_3
2015-03-13 10:45:25,917 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 1
2015-03-13 10:45:25,930 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:45:25,930 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:45:25,930 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:45:25,930 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:45:25,930 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:45:25,931 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:45:25,931 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:45:25,931 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:45:25,931 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:45:25,933 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:45:25,934 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:45:26,042 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:45:26,043 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:45:26,043 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:45:26,046 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:45:26,046 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:45:26,046 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:45:26,047 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:45:26,047 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:45:26,047 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 1 to start...
2015-03-13 10:45:26,052 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56702
2015-03-13 10:45:26,053 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:45:26,053 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:45:26,054 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:26,054 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56702: starting
2015-03-13 10:45:26,058 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:56702
2015-03-13 10:45:26,058 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:56702
2015-03-13 10:45:26,059 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56703
2015-03-13 10:45:26,061 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:45:26,061 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:26,061 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56703: starting
2015-03-13 10:45:26,063 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 56703
2015-03-13 10:45:26,063 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:45:26,064 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 56704
2015-03-13 10:45:26,064 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:26,065 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:45:26,066 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:45:26,066 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:45:26,066 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:45:26,066 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:45:26,067 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:45:26,067 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:45:26,067 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 56705
2015-03-13 10:45:26,067 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:45:26,071 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_56705_node____avz7q9/webapp
2015-03-13 10:45:26,324 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:56705
2015-03-13 10:45:26,325 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 56705
2015-03-13 10:45:26,332 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:45:26,333 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:45:26,334 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 56702 httpPort: 56705) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:56702
2015-03-13 10:45:26,334 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:56702 Node Transitioned from NEW to RUNNING
2015-03-13 10:45:26,334 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -953802549
2015-03-13 10:45:26,334 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:56702 clusterResource: <memory:8192, vCores:16>
2015-03-13 10:45:26,334 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1190429264
2015-03-13 10:45:26,334 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:56702 with total resource of <memory:4096, vCores:8>
2015-03-13 10:45:26,335 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:45:27,048 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001
2015-03-13 10:45:27,050 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001
2015-03-13 10:45:27,052 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0
2015-03-13 10:45:27,052 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1
2015-03-13 10:45:27,052 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2
2015-03-13 10:45:27,053 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3
2015-03-13 10:45:27,056 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002
2015-03-13 10:45:27,068 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_0
2015-03-13 10:45:27,068 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_1
2015-03-13 10:45:27,069 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_2
2015-03-13 10:45:27,069 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_3
2015-03-13 10:45:27,069 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 2
2015-03-13 10:45:27,081 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:45:27,081 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:45:27,081 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:45:27,081 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:45:27,082 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:45:27,082 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:45:27,082 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:45:27,082 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:45:27,082 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:45:27,084 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:45:27,084 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:45:27,165 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002
2015-03-13 10:45:27,188 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:45:27,189 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:45:27,189 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:45:27,192 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:45:27,192 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:45:27,193 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:45:27,193 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:45:27,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:45:27,193 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 2 to start...
2015-03-13 10:45:27,197 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56706
2015-03-13 10:45:27,198 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:45:27,198 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:45:27,199 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:27,199 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56706: starting
2015-03-13 10:45:27,203 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:56706
2015-03-13 10:45:27,203 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:56706
2015-03-13 10:45:27,205 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56707
2015-03-13 10:45:27,206 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:45:27,207 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:27,207 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56707: starting
2015-03-13 10:45:27,209 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 56707
2015-03-13 10:45:27,211 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:45:27,211 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 56708
2015-03-13 10:45:27,212 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:27,214 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:45:27,214 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:45:27,215 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:45:27,215 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:45:27,215 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:45:27,216 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:45:27,216 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:45:27,216 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 56709
2015-03-13 10:45:27,216 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:45:27,219 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_56709_node____xdr8it/webapp
2015-03-13 10:45:27,363 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001
2015-03-13 10:45:27,367 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002
2015-03-13 10:45:27,419 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:56709
2015-03-13 10:45:27,420 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 56709
2015-03-13 10:45:27,425 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:45:27,427 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:45:27,427 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 56706 httpPort: 56709) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:56706
2015-03-13 10:45:27,427 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:56706 Node Transitioned from NEW to RUNNING
2015-03-13 10:45:27,428 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -953802549
2015-03-13 10:45:27,428 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1190429264
2015-03-13 10:45:27,428 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:56706 clusterResource: <memory:12288, vCores:24>
2015-03-13 10:45:27,428 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:56706 with total resource of <memory:4096, vCores:8>
2015-03-13 10:45:27,428 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:45:28,199 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0
2015-03-13 10:45:28,200 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1
2015-03-13 10:45:28,200 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2
2015-03-13 10:45:28,201 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3
2015-03-13 10:45:28,213 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_0
2015-03-13 10:45:28,214 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_1
2015-03-13 10:45:28,214 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_2
2015-03-13 10:45:28,214 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_3
2015-03-13 10:45:28,215 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 3
2015-03-13 10:45:28,228 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:45:28,228 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:45:28,228 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:45:28,229 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:45:28,229 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:45:28,229 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:45:28,229 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:45:28,230 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:45:28,230 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:45:28,231 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:45:28,232 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:45:28,335 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:45:28,336 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:45:28,337 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:45:28,339 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:45:28,339 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:45:28,339 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:45:28,340 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:45:28,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:45:28,340 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 3 to start...
2015-03-13 10:45:28,345 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56710
2015-03-13 10:45:28,348 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:45:28,348 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:45:28,348 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:28,348 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56710: starting
2015-03-13 10:45:28,352 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:56710
2015-03-13 10:45:28,353 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:56710
2015-03-13 10:45:28,354 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56711
2015-03-13 10:45:28,356 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:45:28,357 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:28,357 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56711: starting
2015-03-13 10:45:28,359 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 56711
2015-03-13 10:45:28,360 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:45:28,361 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 56712
2015-03-13 10:45:28,361 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:28,362 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:45:28,363 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:45:28,363 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:45:28,364 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:45:28,364 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:45:28,364 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:45:28,365 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:45:28,365 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 56713
2015-03-13 10:45:28,365 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:45:28,368 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_56713_node____.3lwrgi/webapp
2015-03-13 10:45:28,600 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:56713
2015-03-13 10:45:28,600 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 56713
2015-03-13 10:45:28,605 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:45:28,606 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:45:28,607 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 56710 httpPort: 56713) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:56710
2015-03-13 10:45:28,607 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:56710 Node Transitioned from NEW to RUNNING
2015-03-13 10:45:28,607 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -953802549
2015-03-13 10:45:28,607 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1190429264
2015-03-13 10:45:28,607 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:56710 with total resource of <memory:4096, vCores:8>
2015-03-13 10:45:28,607 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:45:28,607 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:56710 clusterResource: <memory:16384, vCores:32>
2015-03-13 10:45:29,354 INFO  hs.JobHistory (JobHistory.java:serviceInit(77)) - JobHistory Init
2015-03-13 10:45:29,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null
2015-03-13 10:45:29,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:45:29,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:45:29,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:45:29,371 INFO  hs.HistoryFileManager (HistoryFileManager.java:mkdir(561)) - Perms after creating 511, Expected: 1023
2015-03-13 10:45:29,371 INFO  hs.HistoryFileManager (HistoryFileManager.java:mkdir(564)) - Explicitly setting permissions to : 1023, rwxrwxrwt
2015-03-13 10:45:29,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=soberoi:supergroup:rwxrwxrwt
2015-03-13 10:45:29,375 INFO  hs.HistoryFileManager (HistoryFileManager.java:initExisting(580)) - Initializing Existing Jobs...
2015-03-13 10:45:29,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null
2015-03-13 10:45:29,380 INFO  hs.CachedHistoryStorage (CachedHistoryStorage.java:serviceInit(65)) - CachedHistoryStorage Init
2015-03-13 10:45:29,381 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(207)) - Waiting for HistoryServer to start...
2015-03-13 10:45:29,381 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - JobHistoryServer metrics system started (again)
2015-03-13 10:45:29,381 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:45:29,382 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(526)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-03-13 10:45:29,382 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:45:29,385 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:45:29,385 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context jobhistory
2015-03-13 10:45:29,385 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:45:29,386 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:45:29,386 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /jobhistory/*
2015-03-13 10:45:29,386 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:45:29,386 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 56714
2015-03-13 10:45:29,387 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:45:29,389 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/jobhistory to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_56714_jobhistory____4q8cve/webapp
2015-03-13 10:45:29,568 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:56714
2015-03-13 10:45:29,569 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /jobhistory started at 56714
2015-03-13 10:45:29,586 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:45:29,593 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 56715
2015-03-13 10:45:29,595 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.mapreduce.v2.api.HSClientProtocolPB to the server
2015-03-13 10:45:29,595 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 56715: starting
2015-03-13 10:45:29,595 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:45:29,598 INFO  hs.HistoryClientService (HistoryClientService.java:serviceStart(140)) - Instantiated MRClientService at 10.1.1.144/10.1.1.144:56715
2015-03-13 10:45:30,886 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(224)) - MiniMRYARN ResourceManager address: 10.1.1.144:56696
2015-03-13 10:45:30,887 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(226)) - MiniMRYARN ResourceManager web address: Edinburgh.local:56693
2015-03-13 10:45:30,887 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(228)) - MiniMRYARN HistoryServer address: 10.1.1.144:56715
2015-03-13 10:45:30,888 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(230)) - MiniMRYARN HistoryServer web address: Edinburgh.local:56714
2015-03-13 10:45:30,900 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:45:30,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:45:30,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:30,906 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt. BP-526406211-10.1.1.144-1426268720751 blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]}
2015-03-13 10:45:30,908 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003 src: /127.0.0.1:56716 dest: /127.0.0.1:56673
2015-03-13 10:45:30,909 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003 src: /127.0.0.1:56717 dest: /127.0.0.1:56680
2015-03-13 10:45:30,912 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003 src: /127.0.0.1:56718 dest: /127.0.0.1:56676
2015-03-13 10:45:30,917 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56718, dest: /127.0.0.1:56676, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003, duration: 3264000
2015-03-13 10:45:30,917 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:30,918 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:30,919 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56717, dest: /127.0.0.1:56680, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003, duration: 4373000
2015-03-13 10:45:30,919 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:30,920 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:30,920 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56716, dest: /127.0.0.1:56673, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003, duration: 6136000
2015-03-13 10:45:30,921 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:30,922 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56673 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:30,923 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt is closed by DFSClient_NONMAPREDUCE_234741904_9
2015-03-13 10:45:30,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:30,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:30,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:30,929 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt. BP-526406211-10.1.1.144-1426268720751 blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]}
2015-03-13 10:45:30,931 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004 src: /127.0.0.1:56719 dest: /127.0.0.1:56683
2015-03-13 10:45:30,932 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004 src: /127.0.0.1:56720 dest: /127.0.0.1:56680
2015-03-13 10:45:30,934 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004 src: /127.0.0.1:56721 dest: /127.0.0.1:56676
2015-03-13 10:45:30,938 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56721, dest: /127.0.0.1:56676, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 3478000
2015-03-13 10:45:30,939 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:30,940 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:30,940 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56720, dest: /127.0.0.1:56680, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 4701000
2015-03-13 10:45:30,940 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:30,941 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:30,941 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56719, dest: /127.0.0.1:56683, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 6135000
2015-03-13 10:45:30,942 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:30,943 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:30,944 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt is closed by DFSClient_NONMAPREDUCE_234741904_9
2015-03-13 10:45:30,967 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
2015-03-13 10:45:30,967 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-03-13 10:45:30,968 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-03-13 10:45:30,968 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-03-13 10:45:30,968 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:45:30,968 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-03-13 10:45:30,969 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
2015-03-13 10:45:30,969 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-03-13 10:45:30,969 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-03-13 10:45:30,969 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-03-13 10:45:30,970 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-03-13 10:45:30,970 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-03-13 10:45:30,970 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-03-13 10:45:30,970 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-03-13 10:45:30,971 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-03-13 10:45:30,971 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-03-13 10:45:30,971 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-03-13 10:45:30,976 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:45:30,977 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:45:30,983 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: 9F4C176E885B49B3BA3135648AEAB217
2015-03-13 10:45:31,012 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-03-13 10:45:31,026 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-03-13 10:45:31,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:31,066 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-03-13 10:45:31,068 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-03-13 10:45:31,068 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  source: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt"]
2015-03-13 10:45:31,069 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread"]
2015-03-13 10:45:31,069 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  parallel execution is enabled: true
2015-03-13 10:45:31,069 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  starting jobs: 1
2015-03-13 10:45:31,069 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [test]  allocating threads: 1
2015-03-13 10:45:31,070 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...ocessplatform/openforread
2015-03-13 10:45:31,114 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:56696
2015-03-13 10:45:31,128 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:56696
2015-03-13 10:45:31,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:31,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:45:31,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:45:31,165 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 1
2015-03-13 10:45:31,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001	dst=null	perm=null
2015-03-13 10:45:31,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:45:31,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:45:31,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:31,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:31,181 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar. BP-526406211-10.1.1.144-1426268720751 blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]}
2015-03-13 10:45:31,182 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005 src: /127.0.0.1:56723 dest: /127.0.0.1:56676
2015-03-13 10:45:31,184 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005 src: /127.0.0.1:56724 dest: /127.0.0.1:56680
2015-03-13 10:45:31,185 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005 src: /127.0.0.1:56725 dest: /127.0.0.1:56683
2015-03-13 10:45:31,191 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56725, dest: /127.0.0.1:56683, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005, duration: 5305000
2015-03-13 10:45:31,192 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:31,193 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:31,193 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56724, dest: /127.0.0.1:56680, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005, duration: 6515000
2015-03-13 10:45:31,193 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:31,196 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:31,196 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56723, dest: /127.0.0.1:56676, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005, duration: 9240000
2015-03-13 10:45:31,196 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:31,197 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:31,198 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar is closed by DFSClient_NONMAPREDUCE_234741904_9
2015-03-13 10:45:31,201 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar
2015-03-13 10:45:31,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:31,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:31,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:31,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:31,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:31,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:45:31,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:45:31,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:45:31,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:45:31,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:45:31,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:31,218 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-03-13 10:45:31,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:45:31,226 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:45:31,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:45:31,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:31,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:31,242 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split
2015-03-13 10:45:31,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=null
2015-03-13 10:45:31,245 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split. BP-526406211-10.1.1.144-1426268720751 blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]}
2015-03-13 10:45:31,247 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006 src: /127.0.0.1:56726 dest: /127.0.0.1:56673
2015-03-13 10:45:31,248 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006 src: /127.0.0.1:56727 dest: /127.0.0.1:56680
2015-03-13 10:45:31,250 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006 src: /127.0.0.1:56728 dest: /127.0.0.1:56683
2015-03-13 10:45:31,251 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006 src: /127.0.0.1:56729 dest: /127.0.0.1:56676
2015-03-13 10:45:31,258 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56729, dest: /127.0.0.1:56676, bytes: 1792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, duration: 5635000
2015-03-13 10:45:31,259 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:31,260 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:31,260 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56728, dest: /127.0.0.1:56683, bytes: 1792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, duration: 6977000
2015-03-13 10:45:31,261 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:31,262 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:31,262 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56727, dest: /127.0.0.1:56680, bytes: 1792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, duration: 8438000
2015-03-13 10:45:31,262 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:31,263 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:31,263 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56726, dest: /127.0.0.1:56673, bytes: 1792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, duration: 10197000
2015-03-13 10:45:31,264 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:31,265 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56673 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:31,266 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split is closed by DFSClient_NONMAPREDUCE_234741904_9
2015-03-13 10:45:31,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:31,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:31,276 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo. BP-526406211-10.1.1.144-1426268720751 blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW]]}
2015-03-13 10:45:31,278 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007 src: /127.0.0.1:56730 dest: /127.0.0.1:56683
2015-03-13 10:45:31,279 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007 src: /127.0.0.1:56731 dest: /127.0.0.1:56676
2015-03-13 10:45:31,281 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007 src: /127.0.0.1:56732 dest: /127.0.0.1:56680
2015-03-13 10:45:31,286 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56732, dest: /127.0.0.1:56680, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007, duration: 3376000
2015-03-13 10:45:31,286 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:31,287 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW]]} size 0
2015-03-13 10:45:31,287 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56731, dest: /127.0.0.1:56676, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007, duration: 4785000
2015-03-13 10:45:31,287 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:31,288 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW]]} size 0
2015-03-13 10:45:31,289 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56730, dest: /127.0.0.1:56683, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007, duration: 5981000
2015-03-13 10:45:31,289 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:31,290 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW]]} size 0
2015-03-13 10:45:31,291 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_234741904_9
2015-03-13 10:45:31,292 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:45:31,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:31,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:45:31,299 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-03-13 10:45:31,300 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-03-13 10:45:31,300 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-03-13 10:45:31,300 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-03-13 10:45:31,300 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-03-13 10:45:31,300 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-03-13 10:45:31,300 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-03-13 10:45:31,300 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-03-13 10:45:31,300 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-03-13 10:45:31,301 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-03-13 10:45:31,301 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-03-13 10:45:31,301 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-03-13 10:45:31,301 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-03-13 10:45:31,301 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-03-13 10:45:31,301 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-03-13 10:45:31,301 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-03-13 10:45:31,301 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-03-13 10:45:31,301 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-03-13 10:45:31,302 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-03-13 10:45:31,302 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-03-13 10:45:31,302 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-03-13 10:45:31,302 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
2015-03-13 10:45:31,302 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-03-13 10:45:31,302 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-03-13 10:45:31,302 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-03-13 10:45:31,303 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-03-13 10:45:31,303 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-03-13 10:45:31,303 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-03-13 10:45:31,303 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:45:31,303 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-03-13 10:45:31,303 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-03-13 10:45:31,303 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-03-13 10:45:31,304 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-03-13 10:45:31,304 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-03-13 10:45:31,304 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-03-13 10:45:31,304 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-03-13 10:45:31,304 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-03-13 10:45:31,304 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-03-13 10:45:31,304 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-03-13 10:45:31,305 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-03-13 10:45:31,305 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-03-13 10:45:31,305 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-03-13 10:45:31,305 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-03-13 10:45:31,305 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-03-13 10:45:31,305 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-03-13 10:45:31,306 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-03-13 10:45:31,306 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-03-13 10:45:31,306 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-03-13 10:45:31,306 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-03-13 10:45:31,306 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-03-13 10:45:31,306 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-03-13 10:45:31,306 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-03-13 10:45:31,307 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:45:31,307 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-03-13 10:45:31,307 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-03-13 10:45:31,307 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-03-13 10:45:31,307 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-03-13 10:45:31,307 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-03-13 10:45:31,307 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-03-13 10:45:31,308 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-03-13 10:45:31,308 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-03-13 10:45:31,308 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-03-13 10:45:31,308 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-03-13 10:45:31,308 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-03-13 10:45:31,308 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-03-13 10:45:31,308 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-03-13 10:45:31,309 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-03-13 10:45:31,309 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-03-13 10:45:31,309 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-03-13 10:45:31,309 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-03-13 10:45:31,309 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-03-13 10:45:31,309 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-03-13 10:45:31,309 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-03-13 10:45:31,310 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-03-13 10:45:31,310 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-03-13 10:45:31,310 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-03-13 10:45:31,310 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-03-13 10:45:31,310 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-03-13 10:45:31,310 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-03-13 10:45:31,310 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-03-13 10:45:31,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-03-13 10:45:31,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-03-13 10:45:31,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-03-13 10:45:31,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-03-13 10:45:31,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-03-13 10:45:31,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-03-13 10:45:31,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-03-13 10:45:31,312 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-03-13 10:45:31,312 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-03-13 10:45:31,312 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-03-13 10:45:31,312 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-03-13 10:45:31,312 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-03-13 10:45:31,312 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-03-13 10:45:31,312 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-03-13 10:45:31,313 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-03-13 10:45:31,313 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-03-13 10:45:31,313 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-03-13 10:45:31,313 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-03-13 10:45:31,313 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-03-13 10:45:31,313 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-03-13 10:45:31,314 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-03-13 10:45:31,314 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-03-13 10:45:31,314 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-03-13 10:45:31,314 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
2015-03-13 10:45:31,314 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-03-13 10:45:31,314 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-03-13 10:45:31,314 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-03-13 10:45:31,315 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-03-13 10:45:31,315 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-03-13 10:45:31,315 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-03-13 10:45:31,315 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-03-13 10:45:31,315 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-03-13 10:45:31,315 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-03-13 10:45:31,315 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-03-13 10:45:31,316 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-03-13 10:45:31,316 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-03-13 10:45:31,316 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-03-13 10:45:31,316 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:45:31,316 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-03-13 10:45:31,401 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml. BP-526406211-10.1.1.144-1426268720751 blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]}
2015-03-13 10:45:31,403 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008 src: /127.0.0.1:56733 dest: /127.0.0.1:56683
2015-03-13 10:45:31,407 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008 src: /127.0.0.1:56734 dest: /127.0.0.1:56680
2015-03-13 10:45:31,410 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008 src: /127.0.0.1:56735 dest: /127.0.0.1:56673
2015-03-13 10:45:31,422 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56735, dest: /127.0.0.1:56673, bytes: 96429, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008, duration: 9613000
2015-03-13 10:45:31,423 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:31,424 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56673 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:31,424 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56734, dest: /127.0.0.1:56680, bytes: 96429, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008, duration: 10526000
2015-03-13 10:45:31,424 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:31,427 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:31,428 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56733, dest: /127.0.0.1:56683, bytes: 96429, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008, duration: 13223000
2015-03-13 10:45:31,428 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:31,430 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:31,431 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml is closed by DFSClient_NONMAPREDUCE_234741904_9
2015-03-13 10:45:31,432 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426268723022_0001
2015-03-13 10:45:31,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001	dst=null	perm=null
2015-03-13 10:45:31,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:31,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:31,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:31,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:31,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=null
2015-03-13 10:45:31,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=null
2015-03-13 10:45:31,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:45:31,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:45:31,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:31,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:31,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:31,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:31,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:31,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:31,547 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 1 submitted by user soberoi
2015-03-13 10:45:31,547 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426268723022_0001
2015-03-13 10:45:31,548 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426268723022_0001 State change from NEW to NEW_SAVING
2015-03-13 10:45:31,548 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426268723022_0001
2015-03-13 10:45:31,552 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426268723022_0001
2015-03-13 10:45:31,554 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426268723022_0001 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:45:31,555 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426268723022_0001_000001
2015-03-13 10:45:31,557 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426268723022_0001_000001 State change from NEW to SUBMITTED
2015-03-13 10:45:31,560 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426268723022_0001 from user: soberoi activated in queue: default
2015-03-13 10:45:31,560 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426268723022_0001 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@530e7cb6, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:45:31,560 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426268723022_0001 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:45:31,560 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426268723022_0001_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0, currently active: 1
2015-03-13 10:45:31,561 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426268723022_0001_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:45:31,563 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426268723022_0001 State change from SUBMITTED to ACCEPTED
2015-03-13 10:45:31,566 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426268723022_0001 to ResourceManager at /10.1.1.144:56696
2015-03-13 10:45:31,587 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:56693/proxy/application_1426268723022_0001/
2015-03-13 10:45:31,587 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_1426268723022_0001
2015-03-13 10:45:31,587 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://Edinburgh.local:56693/proxy/application_1426268723022_0001/
2015-03-13 10:45:31,637 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:45:31,637 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000001
2015-03-13 10:45:31,638 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426268723022_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:56710, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:45:31,638 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426268723022_0001 container=Container: [ContainerId: container_1426268723022_0001_01_000001, NodeId: 10.1.1.144:56710, NodeHttpAddress: 10.1.1.144:56713, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:56710 }, ] containerId=container_1426268723022_0001_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0 usedCapacity=0.0 absoluteUsedCapacity=0.0 used=<memory:0, vCores:0> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:31,638 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:45:31,638 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:31,639 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:45:31,640 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426268723022_0001 AttemptId: appattempt_1426268723022_0001_000001 MasterContainer: Container: [ContainerId: container_1426268723022_0001_01_000001, NodeId: 10.1.1.144:56710, NodeHttpAddress: 10.1.1.144:56713, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:56710 }, ]
2015-03-13 10:45:31,641 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426268723022_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:45:31,644 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426268723022_0001_000001
2015-03-13 10:45:31,645 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426268723022_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:45:31,647 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426268723022_0001_000001
2015-03-13 10:45:31,657 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426268723022_0001_01_000001, NodeId: 10.1.1.144:56710, NodeHttpAddress: 10.1.1.144:56713, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:56710 }, ] for AM appattempt_1426268723022_0001_000001
2015-03-13 10:45:31,657 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426268723022_0001_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:45:31,675 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426268723022_0001_000001 (auth:SIMPLE)
2015-03-13 10:45:31,682 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426268723022_0001_01_000001 by user soberoi
2015-03-13 10:45:31,693 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426268723022_0001
2015-03-13 10:45:31,694 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426268723022_0001 transitioned from NEW to INITING
2015-03-13 10:45:31,694 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000001
2015-03-13 10:45:31,695 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426268723022_0001_01_000001 to application application_1426268723022_0001
2015-03-13 10:45:31,698 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426268723022_0001 transitioned from INITING to RUNNING
2015-03-13 10:45:31,701 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:45:31,701 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426268723022_0001
2015-03-13 10:45:31,703 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426268723022_0001_01_000001, NodeId: 10.1.1.144:56710, NodeHttpAddress: 10.1.1.144:56713, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:56710 }, ] for AM appattempt_1426268723022_0001_000001
2015-03-13 10:45:31,703 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426268723022_0001_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:45:31,708 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:45:31,709 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:45:31,709 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:45:31,709 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:45:31,709 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:45:31,709 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:45:31,710 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426268722726, FILE, null }
2015-03-13 10:45:31,715 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar, 1426268722880, FILE, null }
2015-03-13 10:45:31,716 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426268723022_0001_01_000001
2015-03-13 10:45:31,732 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426268723022_0001_01_000001.tokens. Credentials list: 
2015-03-13 10:45:31,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:31,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:31,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:31,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:31,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:45:31,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:45:31,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:45:31,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:45:31,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:45:31,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:45:31,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:45:31,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:45:31,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:45:31,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:45:31,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:31,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:31,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:31,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:31,757 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:45:31,780 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56680, dest: /127.0.0.1:56737, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002, duration: 2567000
2015-03-13 10:45:31,780 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56738, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001, duration: 2949000
2015-03-13 10:45:31,831 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:31,832 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:31,863 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426268723022_0001_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000001.tokens
2015-03-13 10:45:31,864 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426268723022_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426268723022_0001
2015-03-13 10:45:31,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:31,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:31,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:31,966 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56741, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_918021337_838, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005, duration: 788000
2015-03-13 10:45:31,997 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:32,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:45:32,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:45:32,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:45:32,025 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56741, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_918021337_838, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007, duration: 231000
2015-03-13 10:45:32,038 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:32,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=null
2015-03-13 10:45:32,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=null
2015-03-13 10:45:32,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=null
2015-03-13 10:45:32,059 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003
2015-03-13 10:45:32,059 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006
2015-03-13 10:45:32,059 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006
2015-03-13 10:45:32,059 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007
2015-03-13 10:45:32,060 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004
2015-03-13 10:45:32,061 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008
2015-03-13 10:45:32,062 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005
2015-03-13 10:45:32,063 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003
2015-03-13 10:45:32,067 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56673, dest: /127.0.0.1:56742, bytes: 1808, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_918021337_838, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, duration: 258000
2015-03-13 10:45:32,079 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:32,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:32,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:32,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:32,107 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56738, bytes: 97185, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_918021337_838, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008, duration: 391000
2015-03-13 10:45:32,122 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:32,123 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:45:32,158 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:45:32,158 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:32,167 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003
2015-03-13 10:45:32,167 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007
2015-03-13 10:45:32,170 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005
2015-03-13 10:45:32,170 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004
2015-03-13 10:45:32,171 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006
2015-03-13 10:45:32,172 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008
2015-03-13 10:45:32,229 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000001/default_container_executor.sh]
2015-03-13 10:45:32,376 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005
2015-03-13 10:45:32,377 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004
2015-03-13 10:45:32,378 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008
2015-03-13 10:45:32,379 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006
2015-03-13 10:45:32,379 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007
2015-03-13 10:45:32,631 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:32,632 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:45:33,512 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:56683 to replicate blk_1073741829_1005 to datanode(s) 127.0.0.1:56673
2015-03-13 10:45:33,632 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:33,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:45:33,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:45:33,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:45:33,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:45:33,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001	dst=null	perm=null
2015-03-13 10:45:33,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:45:33,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:45:33,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:45:33,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:45:34,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:45:34,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:45:34,292 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56744, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741831_1007, duration: 251000
2015-03-13 10:45:34,379 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1786258516-10.1.1.144-56683-1426268722307, infoPort=56684, ipcPort=56685, storageInfo=lv=-47;cid=testClusterID;nsid=211384765;c=0) Starting thread to transfer BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005 to 127.0.0.1:56673 
2015-03-13 10:45:34,384 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005 src: /127.0.0.1:56746 dest: /127.0.0.1:56673
2015-03-13 10:45:34,385 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005 (numBytes=254067) to /127.0.0.1:56673
2015-03-13 10:45:34,386 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005 src: /127.0.0.1:56746 dest: /127.0.0.1:56673 of size 254067
2015-03-13 10:45:34,388 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56673 is added to blk_1073741829_1005 size 254067
2015-03-13 10:45:34,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:35,056 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426268723022_0001_000001 (auth:SIMPLE)
2015-03-13 10:45:35,061 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426268723022_0001_000001
2015-03-13 10:45:35,062 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426268723022_0001	APPATTEMPTID=appattempt_1426268723022_0001_000001
2015-03-13 10:45:35,062 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426268723022_0001_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:45:35,062 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426268723022_0001 State change from ACCEPTED to RUNNING
2015-03-13 10:45:35,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:35,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:45:35,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:35,283 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1_conf.xml. BP-526406211-10.1.1.144-1426268720751 blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]}
2015-03-13 10:45:35,324 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009 src: /127.0.0.1:56751 dest: /127.0.0.1:56676
2015-03-13 10:45:35,325 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009 src: /127.0.0.1:56752 dest: /127.0.0.1:56683
2015-03-13 10:45:35,327 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009 src: /127.0.0.1:56753 dest: /127.0.0.1:56673
2015-03-13 10:45:35,337 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56753, dest: /127.0.0.1:56673, bytes: 89224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009, duration: 8024000
2015-03-13 10:45:35,337 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:35,338 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56673 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:35,338 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56752, dest: /127.0.0.1:56683, bytes: 89224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009, duration: 8866000
2015-03-13 10:45:35,338 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:35,338 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:35,339 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56751, dest: /127.0.0.1:56676, bytes: 89224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009, duration: 7565000
2015-03-13 10:45:35,339 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:35,339 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:35,345 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1_conf.xml is closed by DFSClient_NONMAPREDUCE_830346085_1
2015-03-13 10:45:35,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:36,367 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:45:36,368 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000002
2015-03-13 10:45:36,368 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426268723022_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:56702, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:45:36,368 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426268723022_0001 container=Container: [ContainerId: container_1426268723022_0001_01_000002, NodeId: 10.1.1.144:56702, NodeHttpAddress: 10.1.1.144:56705, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:56702 }, ] containerId=container_1426268723022_0001_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:36,369 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:45:36,369 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:36,370 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:45:36,370 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000003
2015-03-13 10:45:36,370 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426268723022_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:56702, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:45:36,370 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426268723022_0001 container=Container: [ContainerId: container_1426268723022_0001_01_000003, NodeId: 10.1.1.144:56702, NodeHttpAddress: 10.1.1.144:56705, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:56702 }, ] containerId=container_1426268723022_0001_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:36,371 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:45:36,371 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:36,371 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:45:36,372 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000004
2015-03-13 10:45:36,372 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426268723022_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:56702, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:45:36,372 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426268723022_0001 container=Container: [ContainerId: container_1426268723022_0001_01_000004, NodeId: 10.1.1.144:56702, NodeHttpAddress: 10.1.1.144:56705, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:56702 }, ] containerId=container_1426268723022_0001_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:36,372 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:45:36,372 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:36,373 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:45:36,373 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000005
2015-03-13 10:45:36,373 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426268723022_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:56702, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:45:36,373 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426268723022_0001 container=Container: [ContainerId: container_1426268723022_0001_01_000005, NodeId: 10.1.1.144:56702, NodeHttpAddress: 10.1.1.144:56705, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:56702 }, ] containerId=container_1426268723022_0001_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:36,373 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:45:36,374 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:36,459 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:45:36,460 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000006
2015-03-13 10:45:36,460 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426268723022_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:56706, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:45:36,461 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426268723022_0001 container=Container: [ContainerId: container_1426268723022_0001_01_000006, NodeId: 10.1.1.144:56706, NodeHttpAddress: 10.1.1.144:56709, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:56706 }, ] containerId=container_1426268723022_0001_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:36,461 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:45:36,461 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:36,646 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:37,065 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005
2015-03-13 10:45:37,066 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009
2015-03-13 10:45:37,067 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009
2015-03-13 10:45:37,105 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:45:37,106 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:45:37,106 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:45:37,107 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:45:37,107 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:45:37,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:37,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:37,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:37,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:37,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:37,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:37,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:37,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:37,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:37,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:37,238 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426268723022_0001_000001 (auth:SIMPLE)
2015-03-13 10:45:37,238 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426268723022_0001_000001 (auth:SIMPLE)
2015-03-13 10:45:37,244 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426268723022_0001_01_000003 by user soberoi
2015-03-13 10:45:37,245 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426268723022_0001_01_000002 by user soberoi
2015-03-13 10:45:37,245 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426268723022_0001_01_000004 by user soberoi
2015-03-13 10:45:37,246 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426268723022_0001
2015-03-13 10:45:37,246 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000003
2015-03-13 10:45:37,246 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000004
2015-03-13 10:45:37,247 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426268723022_0001_01_000005 by user soberoi
2015-03-13 10:45:37,248 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000005
2015-03-13 10:45:37,246 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000002
2015-03-13 10:45:37,247 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426268723022_0001_01_000003 to application application_1426268723022_0001
2015-03-13 10:45:37,249 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426268723022_0001 transitioned from NEW to INITING
2015-03-13 10:45:37,251 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426268723022_0001_01_000004 to application application_1426268723022_0001
2015-03-13 10:45:37,251 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426268723022_0001_01_000002 to application application_1426268723022_0001
2015-03-13 10:45:37,251 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426268723022_0001_01_000006 by user soberoi
2015-03-13 10:45:37,252 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426268723022_0001_01_000005 to application application_1426268723022_0001
2015-03-13 10:45:37,253 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426268723022_0001 transitioned from INITING to RUNNING
2015-03-13 10:45:37,253 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426268723022_0001
2015-03-13 10:45:37,254 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000006
2015-03-13 10:45:37,254 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:45:37,257 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426268723022_0001 transitioned from NEW to INITING
2015-03-13 10:45:37,257 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:45:37,257 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426268723022_0001_01_000006 to application application_1426268723022_0001
2015-03-13 10:45:37,258 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:45:37,258 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426268723022_0001 transitioned from INITING to RUNNING
2015-03-13 10:45:37,258 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:45:37,258 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426268723022_0001
2015-03-13 10:45:37,258 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:45:37,259 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426268723022_0001
2015-03-13 10:45:37,259 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426268723022_0001
2015-03-13 10:45:37,259 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426268723022_0001
2015-03-13 10:45:37,259 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:45:37,259 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:45:37,260 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426268723022_0001
2015-03-13 10:45:37,260 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426268723022_0001
2015-03-13 10:45:37,261 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:45:37,261 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:45:37,261 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:45:37,261 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:45:37,261 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:45:37,261 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:45:37,261 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:45:37,261 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:45:37,261 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426268722726, FILE, null }
2015-03-13 10:45:37,262 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426268723022_0001
2015-03-13 10:45:37,262 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426268723022_0001
2015-03-13 10:45:37,262 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:45:37,262 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426268723022_0001
2015-03-13 10:45:37,263 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426268723022_0001
2015-03-13 10:45:37,263 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426268723022_0001
2015-03-13 10:45:37,263 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:45:37,263 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426268723022_0001
2015-03-13 10:45:37,263 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426268723022_0001
2015-03-13 10:45:37,264 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426268723022_0001
2015-03-13 10:45:37,264 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:45:37,264 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426268723022_0001
2015-03-13 10:45:37,264 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426268722726, FILE, null }
2015-03-13 10:45:37,264 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar, 1426268722880, FILE, null }
2015-03-13 10:45:37,267 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar, 1426268722880, FILE, null }
2015-03-13 10:45:37,268 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426268723022_0001_01_000006
2015-03-13 10:45:37,271 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426268723022_0001_01_000002
2015-03-13 10:45:37,273 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426268722726, FILE, null }
2015-03-13 10:45:37,273 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar, 1426268722880, FILE, null }
2015-03-13 10:45:37,273 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426268723022_0001_01_000004
2015-03-13 10:45:37,275 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426268722726, FILE, null }
2015-03-13 10:45:37,275 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar, 1426268722880, FILE, null }
2015-03-13 10:45:37,275 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426268723022_0001_01_000003
2015-03-13 10:45:37,281 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426268722726, FILE, null }
2015-03-13 10:45:37,281 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar, 1426268722880, FILE, null }
2015-03-13 10:45:37,281 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426268723022_0001_01_000005
2015-03-13 10:45:37,296 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426268723022_0001_01_000006.tokens. Credentials list: 
2015-03-13 10:45:37,309 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426268723022_0001_01_000003.tokens. Credentials list: 
2015-03-13 10:45:37,311 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426268723022_0001_01_000004.tokens. Credentials list: 
2015-03-13 10:45:37,312 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426268723022_0001_01_000002.tokens. Credentials list: 
2015-03-13 10:45:37,314 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426268723022_0001_01_000005.tokens. Credentials list: 
2015-03-13 10:45:37,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:37,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:37,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:45:37,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:37,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:37,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:45:37,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:37,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:37,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:45:37,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:37,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:45:37,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:45:37,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:37,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:45:37,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:45:37,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:45:37,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:45:37,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:45:37,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:37,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:45:37,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:45:37,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:45:37,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:37,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:45:37,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:45:37,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:45:37,338 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:45:37,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:45:37,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:45:37,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:45:37,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:37,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:45:37,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:37,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:37,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:37,347 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:45:37,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:45:37,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar	dst=null	perm=null
2015-03-13 10:45:37,359 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56756, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002, duration: 1399000
2015-03-13 10:45:37,365 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56673, dest: /127.0.0.1:56757, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001, duration: 1470000
2015-03-13 10:45:37,368 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56758, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741825_1001, duration: 1592000
2015-03-13 10:45:37,370 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:37,371 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:37,371 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56759, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741826_1002, duration: 3566000
2015-03-13 10:45:37,372 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:37,377 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:37,379 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:45:37,379 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:45:37,380 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:45:37,380 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:45:37,382 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009
2015-03-13 10:45:37,417 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:37,437 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-7200781763833044952.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:37,438 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:37,439 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:37,463 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:37,464 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:45:37,483 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426268723022_0001_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000006.tokens
2015-03-13 10:45:37,484 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426268723022_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426268723022_0001
2015-03-13 10:45:37,489 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426268723022_0001_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000003.tokens
2015-03-13 10:45:37,490 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001
2015-03-13 10:45:37,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:37,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:37,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:37,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:37,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:37,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar	dst=null	perm=null
2015-03-13 10:45:37,583 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56758, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_87624451_1032, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005, duration: 737000
2015-03-13 10:45:37,583 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56673, dest: /127.0.0.1:56757, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-985190355_1033, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741829_1005, duration: 722000
2015-03-13 10:45:37,608 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:37,608 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:37,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:37,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:37,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:37,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:37,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:37,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml	dst=null	perm=null
2015-03-13 10:45:37,642 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56756, bytes: 97185, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_87624451_1032, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008, duration: 357000
2015-03-13 10:45:37,642 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56680, dest: /127.0.0.1:56764, bytes: 97185, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-985190355_1033, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741832_1008, duration: 394000
2015-03-13 10:45:37,650 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:37,658 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:37,658 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:45:37,658 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:45:37,658 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:56672/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:45:37,658 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:45:37,659 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:45:37,659 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:45:37,753 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:45:37,753 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:37,755 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:45:37,755 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:37,757 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:45:37,757 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:37,757 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:45:37,757 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:37,761 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:45:37,761 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:37,911 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000002/default_container_executor.sh]
2015-03-13 10:45:37,921 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000006/default_container_executor.sh]
2015-03-13 10:45:37,921 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000003/default_container_executor.sh]
2015-03-13 10:45:37,921 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000005/default_container_executor.sh]
2015-03-13 10:45:37,922 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000004/default_container_executor.sh]
2015-03-13 10:45:38,126 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:45:38,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:38,382 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:38,382 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:38,382 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:38,474 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:38,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:38,689 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:45:38,825 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426268723022_0001_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000002.tokens
2015-03-13 10:45:38,825 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001
2015-03-13 10:45:38,934 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:45:39,063 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426268723022_0001_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000005.tokens
2015-03-13 10:45:39,064 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001
2015-03-13 10:45:39,174 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:45:39,296 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426268723022_0001_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000004.tokens
2015-03-13 10:45:39,296 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001
2015-03-13 10:45:39,384 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:39,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:39,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:39,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:39,475 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:39,655 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:40,387 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:40,388 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:40,388 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:40,388 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:40,479 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:40,661 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:41,394 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:41,395 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:41,395 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:41,395 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:41,485 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:41,666 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:42,400 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:42,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:42,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:42,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:42,489 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:42,668 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:43,403 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:43,404 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:43,404 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:43,405 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:43,494 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:43,674 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:44,406 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:44,407 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:44,407 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:44,407 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:44,499 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:44,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:45,413 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:45,413 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:45,414 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:45,414 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:45,500 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:45,678 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:45,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=null
2015-03-13 10:45:46,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=null
2015-03-13 10:45:46,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=null
2015-03-13 10:45:46,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=null
2015-03-13 10:45:46,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job.split	dst=null	perm=null
2015-03-13 10:45:46,189 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56673, dest: /127.0.0.1:56776, bytes: 1808, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000001_0_110571768_1, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, duration: 280000
2015-03-13 10:45:46,195 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56778, bytes: 776, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000004_0_720697964_1, offset: 1024, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, duration: 283000
2015-03-13 10:45:46,279 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56673, dest: /127.0.0.1:56780, bytes: 1808, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, duration: 224000
2015-03-13 10:45:46,302 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56781, bytes: 1292, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000002_0_-1435256345_1, offset: 512, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, duration: 252000
2015-03-13 10:45:46,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:45:46,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:45:46,340 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56680, dest: /127.0.0.1:56782, bytes: 776, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000003_0_-356272718_1, offset: 1024, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741830_1006, duration: 271000
2015-03-13 10:45:46,345 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56673, dest: /127.0.0.1:56776, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000001_0_110571768_1, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003, duration: 266000
2015-03-13 10:45:46,349 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56778, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000004_0_720697964_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003, duration: 283000
2015-03-13 10:45:46,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:46,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:46,415 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:46,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:45:46,415 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:46,416 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:46,416 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:46,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:45:46,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:46,441 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56680, dest: /127.0.0.1:56783, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000002_0_-1435256345_1, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003, duration: 272000
2015-03-13 10:45:46,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:46,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:45:46,501 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:46,528 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56673, dest: /127.0.0.1:56784, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000003_0_-356272718_1, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003, duration: 283000
2015-03-13 10:45:46,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:46,682 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:46,761 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000004_0/part-00004 is closed by DFSClient_attempt_1426268723022_0001_m_000004_0_720697964_1
2015-03-13 10:45:46,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000004_0	dst=null	perm=null
2015-03-13 10:45:46,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000004_0	dst=null	perm=null
2015-03-13 10:45:46,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000004	dst=null	perm=null
2015-03-13 10:45:46,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:45:46,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,814 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426268723022_0001_01_000006
2015-03-13 10:45:46,816 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000006
2015-03-13 10:45:46,816 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:45:46,816 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426268723022_0001_01_000006
2015-03-13 10:45:46,816 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:45:46,831 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426268723022_0001_01_000006 is : 143
2015-03-13 10:45:46,835 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1.jhist. BP-526406211-10.1.1.144-1426268720751 blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]}
2015-03-13 10:45:46,837 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741834_1010 src: /127.0.0.1:56785 dest: /127.0.0.1:56683
2015-03-13 10:45:46,839 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741834_1010 src: /127.0.0.1:56786 dest: /127.0.0.1:56673
2015-03-13 10:45:46,840 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741834_1010 src: /127.0.0.1:56787 dest: /127.0.0.1:56676
2015-03-13 10:45:46,851 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1.jhist for DFSClient_NONMAPREDUCE_830346085_1
2015-03-13 10:45:46,855 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:45:46,857 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000006
2015-03-13 10:45:46,858 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000006
2015-03-13 10:45:46,860 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000006
2015-03-13 10:45:46,860 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000006
2015-03-13 10:45:46,861 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000006
2015-03-13 10:45:46,863 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:45:46,863 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426268723022_0001_01_000006 from application application_1426268723022_0001
2015-03-13 10:45:46,863 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:46,863 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426268723022_0001
2015-03-13 10:45:46,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,874 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56788, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000001_0_110571768_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 1346000
2015-03-13 10:45:46,884 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56673, dest: /127.0.0.1:56780, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741827_1003, duration: 279000
2015-03-13 10:45:46,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,931 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56788, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000001_0_110571768_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 1529000
2015-03-13 10:45:46,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,985 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56680, dest: /127.0.0.1:56789, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000002_0_-1435256345_1, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 245000
2015-03-13 10:45:46,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:46,990 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56788, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000001_0_110571768_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 251000
2015-03-13 10:45:47,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,043 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56790, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000002_0_-1435256345_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 1471000
2015-03-13 10:45:47,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,062 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56791, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 272000
2015-03-13 10:45:47,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,105 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56788, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000001_0_110571768_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 227000
2015-03-13 10:45:47,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,115 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56792, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000003_0_-356272718_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 211000
2015-03-13 10:45:47,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,150 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56793, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 243000
2015-03-13 10:45:47,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,174 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56788, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000001_0_110571768_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 272000
2015-03-13 10:45:47,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,179 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56781, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000002_0_-1435256345_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 1937000
2015-03-13 10:45:47,192 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000001_0/part-00001. BP-526406211-10.1.1.144-1426268720751 blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]}
2015-03-13 10:45:47,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,221 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56795, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000003_0_-356272718_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 228000
2015-03-13 10:45:47,233 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011 src: /127.0.0.1:56794 dest: /127.0.0.1:56683
2015-03-13 10:45:47,236 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011 src: /127.0.0.1:56796 dest: /127.0.0.1:56676
2015-03-13 10:45:47,237 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011 src: /127.0.0.1:56797 dest: /127.0.0.1:56673
2015-03-13 10:45:47,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,248 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56680, dest: /127.0.0.1:56798, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 1372000
2015-03-13 10:45:47,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,262 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56797, dest: /127.0.0.1:56673, bytes: 235, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000001_0_110571768_1, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011, duration: 22566000
2015-03-13 10:45:47,262 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:47,262 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56673 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:47,262 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56796, dest: /127.0.0.1:56676, bytes: 235, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000001_0_110571768_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011, duration: 22731000
2015-03-13 10:45:47,263 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,263 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:47,263 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56794, dest: /127.0.0.1:56683, bytes: 235, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000001_0_110571768_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011, duration: 24289000
2015-03-13 10:45:47,264 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,264 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:47,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,269 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000001_0/part-00001 is closed by DFSClient_attempt_1426268723022_0001_m_000001_0_110571768_1
2015-03-13 10:45:47,269 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56781, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000002_0_-1435256345_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 274000
2015-03-13 10:45:47,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000001_0	dst=null	perm=null
2015-03-13 10:45:47,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000001_0	dst=null	perm=null
2015-03-13 10:45:47,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000001	dst=null	perm=null
2015-03-13 10:45:47,290 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000002_0/part-00002. BP-526406211-10.1.1.144-1426268720751 blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]}
2015-03-13 10:45:47,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:45:47,312 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426268723022_0001_000001 (auth:SIMPLE)
2015-03-13 10:45:47,316 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426268723022_0001_01_000003
2015-03-13 10:45:47,317 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000003
2015-03-13 10:45:47,317 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:45:47,317 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:47,317 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426268723022_0001_01_000003
2015-03-13 10:45:47,318 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:45:47,318 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:47,318 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:47,331 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426268723022_0001_01_000003 is : 143
2015-03-13 10:45:47,335 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012 src: /127.0.0.1:56799 dest: /127.0.0.1:56676
2015-03-13 10:45:47,336 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012 src: /127.0.0.1:56801 dest: /127.0.0.1:56680
2015-03-13 10:45:47,339 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012 src: /127.0.0.1:56802 dest: /127.0.0.1:56683
2015-03-13 10:45:47,347 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:45:47,348 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000003
2015-03-13 10:45:47,348 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000003
2015-03-13 10:45:47,349 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56802, dest: /127.0.0.1:56683, bytes: 204, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000002_0_-1435256345_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012, duration: 8000000
2015-03-13 10:45:47,349 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:47,349 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000003
2015-03-13 10:45:47,350 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000003
2015-03-13 10:45:47,349 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:45:47,349 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000003
2015-03-13 10:45:47,350 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426268723022_0001_01_000003 from application application_1426268723022_0001
2015-03-13 10:45:47,350 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:47,350 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56801, dest: /127.0.0.1:56680, bytes: 204, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000002_0_-1435256345_1, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012, duration: 9378000
2015-03-13 10:45:47,350 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426268723022_0001
2015-03-13 10:45:47,350 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,351 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56799, dest: /127.0.0.1:56676, bytes: 204, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000002_0_-1435256345_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012, duration: 10483000
2015-03-13 10:45:47,351 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,351 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:47,352 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:47,352 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:47,357 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000002_0/part-00002 is closed by DFSClient_attempt_1426268723022_0001_m_000002_0_-1435256345_1
2015-03-13 10:45:47,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000002_0	dst=null	perm=null
2015-03-13 10:45:47,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000002_0	dst=null	perm=null
2015-03-13 10:45:47,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000002	dst=null	perm=null
2015-03-13 10:45:47,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:45:47,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,382 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56795, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000003_0_-356272718_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 226000
2015-03-13 10:45:47,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,390 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426268723022_0001_01_000004
2015-03-13 10:45:47,390 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000004
2015-03-13 10:45:47,390 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:45:47,390 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012
2015-03-13 10:45:47,390 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426268723022_0001_01_000004
2015-03-13 10:45:47,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:47,391 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011
2015-03-13 10:45:47,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:45:47,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426268723022_0001_01_000003
2015-03-13 10:45:47,392 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:45:47,392 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:47,394 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:45:47,394 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426268723022_0001_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:45:47,394 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000003
2015-03-13 10:45:47,394 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426268723022_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:56702, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:45:47,394 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:45:47,395 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426268723022_0001_01_000003, NodeId: 10.1.1.144:56702, NodeHttpAddress: 10.1.1.144:56705, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:56702 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:47,395 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:47,395 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:45:47,395 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426268723022_0001_000001 released container container_1426268723022_0001_01_000003 on node: host: 10.1.1.144:56702 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:45:47,403 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426268723022_0001_01_000004 is : 143
2015-03-13 10:45:47,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,416 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56791, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 226000
2015-03-13 10:45:47,419 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:45:47,420 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000004
2015-03-13 10:45:47,420 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000004
2015-03-13 10:45:47,421 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000004
2015-03-13 10:45:47,422 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000004
2015-03-13 10:45:47,422 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000004
2015-03-13 10:45:47,423 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:45:47,423 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426268723022_0001_01_000004 from application application_1426268723022_0001
2015-03-13 10:45:47,423 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:47,423 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426268723022_0001
2015-03-13 10:45:47,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,463 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56680, dest: /127.0.0.1:56803, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000003_0_-356272718_1, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 271000
2015-03-13 10:45:47,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,470 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56793, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 239000
2015-03-13 10:45:47,482 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000003_0/part-00003. BP-526406211-10.1.1.144-1426268720751 blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]}
2015-03-13 10:45:47,525 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741837_1013 src: /127.0.0.1:56804 dest: /127.0.0.1:56676
2015-03-13 10:45:47,526 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741837_1013 src: /127.0.0.1:56805 dest: /127.0.0.1:56680
2015-03-13 10:45:47,528 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741837_1013 src: /127.0.0.1:56806 dest: /127.0.0.1:56683
2015-03-13 10:45:47,538 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56806, dest: /127.0.0.1:56683, bytes: 204, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000003_0_-356272718_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741837_1013, duration: 8360000
2015-03-13 10:45:47,539 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741837_1013, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:47,539 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:47,539 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56805, dest: /127.0.0.1:56680, bytes: 204, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000003_0_-356272718_1, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741837_1013, duration: 6149000
2015-03-13 10:45:47,540 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,540 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:47,540 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56804, dest: /127.0.0.1:56676, bytes: 204, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000003_0_-356272718_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741837_1013, duration: 9945000
2015-03-13 10:45:47,541 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,541 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:47,545 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000003_0/part-00003 is closed by DFSClient_attempt_1426268723022_0001_m_000003_0_-356272718_1
2015-03-13 10:45:47,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000003_0	dst=null	perm=null
2015-03-13 10:45:47,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,558 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56791, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 222000
2015-03-13 10:45:47,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000003_0	dst=null	perm=null
2015-03-13 10:45:47,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000003	dst=null	perm=null
2015-03-13 10:45:47,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:45:47,579 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426268723022_0001_01_000005
2015-03-13 10:45:47,579 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000005
2015-03-13 10:45:47,580 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:47,580 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:45:47,580 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426268723022_0001_01_000005
2015-03-13 10:45:47,580 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:45:47,581 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426268723022_0001_01_000004
2015-03-13 10:45:47,581 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:45:47,581 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:45:47,582 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426268723022_0001_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:45:47,582 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000004
2015-03-13 10:45:47,582 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426268723022_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:56702, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:45:47,582 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:45:47,582 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426268723022_0001_01_000004, NodeId: 10.1.1.144:56702, NodeHttpAddress: 10.1.1.144:56705, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:56702 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:47,582 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:47,582 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:45:47,583 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426268723022_0001_000001 released container container_1426268723022_0001_01_000004 on node: host: 10.1.1.144:56702 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:45:47,594 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426268723022_0001_01_000005 is : 143
2015-03-13 10:45:47,609 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:45:47,610 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000005
2015-03-13 10:45:47,610 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000005
2015-03-13 10:45:47,610 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000005
2015-03-13 10:45:47,610 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000005
2015-03-13 10:45:47,612 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000005
2015-03-13 10:45:47,612 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:45:47,612 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426268723022_0001_01_000005 from application application_1426268723022_0001
2015-03-13 10:45:47,613 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:47,613 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426268723022_0001
2015-03-13 10:45:47,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:45:47,647 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56791, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741828_1004, duration: 227000
2015-03-13 10:45:47,663 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000000_0/part-00000. BP-526406211-10.1.1.144-1426268720751 blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]}
2015-03-13 10:45:47,684 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:47,703 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741838_1014 src: /127.0.0.1:56807 dest: /127.0.0.1:56680
2015-03-13 10:45:47,705 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741838_1014 src: /127.0.0.1:56808 dest: /127.0.0.1:56683
2015-03-13 10:45:47,707 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741838_1014 src: /127.0.0.1:56809 dest: /127.0.0.1:56676
2015-03-13 10:45:47,715 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56809, dest: /127.0.0.1:56676, bytes: 287, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741838_1014, duration: 6665000
2015-03-13 10:45:47,715 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741838_1014, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:47,716 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:47,716 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56808, dest: /127.0.0.1:56683, bytes: 287, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741838_1014, duration: 7833000
2015-03-13 10:45:47,716 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,717 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:47,717 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56807, dest: /127.0.0.1:56680, bytes: 287, op: HDFS_WRITE, cliID: DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741838_1014, duration: 8986000
2015-03-13 10:45:47,718 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,718 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:47,723 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000000_0/part-00000 is closed by DFSClient_attempt_1426268723022_0001_m_000000_0_283555216_1
2015-03-13 10:45:47,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000000_0	dst=null	perm=null
2015-03-13 10:45:47,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000000_0	dst=null	perm=null
2015-03-13 10:45:47,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000000	dst=null	perm=null
2015-03-13 10:45:47,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/_temporary/attempt_1426268723022_0001_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:45:47,754 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426268723022_0001_01_000002
2015-03-13 10:45:47,754 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000002
2015-03-13 10:45:47,755 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:45:47,756 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:45:47,757 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:45:47,757 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426268723022_0001_01_000005
2015-03-13 10:45:47,757 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:45:47,757 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426268723022_0001_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:45:47,758 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000005
2015-03-13 10:45:47,758 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426268723022_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:56702, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:45:47,758 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:45:47,758 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426268723022_0001_01_000005, NodeId: 10.1.1.144:56702, NodeHttpAddress: 10.1.1.144:56705, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:56702 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:47,758 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:47,758 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:45:47,759 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426268723022_0001_000001 released container container_1426268723022_0001_01_000005 on node: host: 10.1.1.144:56702 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:45:47,757 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426268723022_0001_01_000002
2015-03-13 10:45:47,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:47,763 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_830346085_1
2015-03-13 10:45:47,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1	dst=null	perm=null
2015-03-13 10:45:47,772 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426268723022_0001_01_000002 is : 143
2015-03-13 10:45:47,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:47,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:47,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000000	dst=null	perm=null
2015-03-13 10:45:47,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00000	dst=null	perm=null
2015-03-13 10:45:47,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:47,786 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:45:47,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:47,787 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000002
2015-03-13 10:45:47,788 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000002
2015-03-13 10:45:47,788 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000002
2015-03-13 10:45:47,789 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426268723022_0001/container_1426268723022_0001_01_000002
2015-03-13 10:45:47,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:47,789 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000002
2015-03-13 10:45:47,789 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426268723022_0001_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:45:47,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000001	dst=null	perm=null
2015-03-13 10:45:47,791 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426268723022_0001_01_000002 from application application_1426268723022_0001
2015-03-13 10:45:47,792 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:45:47,792 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426268723022_0001
2015-03-13 10:45:47,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00001	dst=null	perm=null
2015-03-13 10:45:47,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:47,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:47,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:47,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000002	dst=null	perm=null
2015-03-13 10:45:47,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00002	dst=null	perm=null
2015-03-13 10:45:47,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:47,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:47,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:47,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000003	dst=null	perm=null
2015-03-13 10:45:47,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00003	dst=null	perm=null
2015-03-13 10:45:47,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:47,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:47,817 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:45:47,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:47,818 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426268723022_0001_01_000006
2015-03-13 10:45:47,819 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:45:47,819 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426268723022_0001_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:45:47,819 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000006
2015-03-13 10:45:47,819 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426268723022_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:56706, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:45:47,820 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:45:47,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000004	dst=null	perm=null
2015-03-13 10:45:47,820 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426268723022_0001_01_000006, NodeId: 10.1.1.144:56706, NodeHttpAddress: 10.1.1.144:56709, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:56706 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:47,820 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:47,820 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:45:47,820 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426268723022_0001_000001 released container container_1426268723022_0001_01_000006 on node: host: 10.1.1.144:56706 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:45:47,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00004	dst=null	perm=null
2015-03-13 10:45:47,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary/1/task_1426268723022_0001_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:47,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary	dst=null	perm=null
2015-03-13 10:45:47,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:47,837 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_SUCCESS is closed by DFSClient_NONMAPREDUCE_830346085_1
2015-03-13 10:45:47,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:47,842 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_830346085_1
2015-03-13 10:45:47,857 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56787, dest: /127.0.0.1:56676, bytes: 53388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741834_1010, duration: 1014512000
2015-03-13 10:45:47,857 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741834_1010, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:47,858 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:47,858 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56786, dest: /127.0.0.1:56673, bytes: 53388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741834_1010, duration: 1014606000
2015-03-13 10:45:47,858 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,859 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56673 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:47,860 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56785, dest: /127.0.0.1:56683, bytes: 53388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741834_1010, duration: 1017688000
2015-03-13 10:45:47,860 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,860 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:47,862 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1.jhist is closed by DFSClient_NONMAPREDUCE_830346085_1
2015-03-13 10:45:47,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:47,868 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001.summary_tmp. BP-526406211-10.1.1.144-1426268720751 blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]}
2015-03-13 10:45:47,870 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741839_1015 src: /127.0.0.1:56810 dest: /127.0.0.1:56676
2015-03-13 10:45:47,871 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741839_1015 src: /127.0.0.1:56811 dest: /127.0.0.1:56680
2015-03-13 10:45:47,872 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741839_1015 src: /127.0.0.1:56812 dest: /127.0.0.1:56673
2015-03-13 10:45:47,878 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56812, dest: /127.0.0.1:56673, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741839_1015, duration: 4294000
2015-03-13 10:45:47,878 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741839_1015, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:47,879 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56673 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:47,879 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56811, dest: /127.0.0.1:56680, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741839_1015, duration: 4275000
2015-03-13 10:45:47,879 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,880 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:47,880 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56810, dest: /127.0.0.1:56676, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741839_1015, duration: 5985000
2015-03-13 10:45:47,880 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,881 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56673|RBW]]} size 0
2015-03-13 10:45:47,882 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001.summary_tmp is closed by DFSClient_NONMAPREDUCE_830346085_1
2015-03-13 10:45:47,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:45:47,890 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1.jhist	dst=null	perm=null
2015-03-13 10:45:47,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001-1426268731527-soberoi-%5BF4A7D570B764463096A5FF2E90B80488%2FAD71AD56D89B4038-1426268747843-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:45:47,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1.jhist	dst=null	perm=null
2015-03-13 10:45:47,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001-1426268731527-soberoi-%5BF4A7D570B764463096A5FF2E90B80488%2FAD71AD56D89B4038-1426268747843-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:45:47,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1.jhist	dst=null	perm=null
2015-03-13 10:45:47,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001-1426268731527-soberoi-%5BF4A7D570B764463096A5FF2E90B80488%2FAD71AD56D89B4038-1426268747843-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:47,908 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56813, bytes: 53808, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741834_1010, duration: 280000
2015-03-13 10:45:47,910 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001-1426268731527-soberoi-%5BF4A7D570B764463096A5FF2E90B80488%2FAD71AD56D89B4038-1426268747843-5-0-SUCCEEDED-default.jhist_tmp. BP-526406211-10.1.1.144-1426268720751 blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]}
2015-03-13 10:45:47,912 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741840_1016 src: /127.0.0.1:56814 dest: /127.0.0.1:56673
2015-03-13 10:45:47,914 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741840_1016 src: /127.0.0.1:56815 dest: /127.0.0.1:56683
2015-03-13 10:45:47,916 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741840_1016 src: /127.0.0.1:56816 dest: /127.0.0.1:56676
2015-03-13 10:45:47,920 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56816, dest: /127.0.0.1:56676, bytes: 53388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741840_1016, duration: 2199000
2015-03-13 10:45:47,920 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741840_1016, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:47,921 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:47,921 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56815, dest: /127.0.0.1:56683, bytes: 53388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741840_1016, duration: 3092000
2015-03-13 10:45:47,921 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,922 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:47,922 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56814, dest: /127.0.0.1:56673, bytes: 53388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741840_1016, duration: 4085000
2015-03-13 10:45:47,922 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,923 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56673 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56673|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW]]} size 0
2015-03-13 10:45:47,925 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001-1426268731527-soberoi-%5BF4A7D570B764463096A5FF2E90B80488%2FAD71AD56D89B4038-1426268747843-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_830346085_1
2015-03-13 10:45:47,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001-1426268731527-soberoi-%5BF4A7D570B764463096A5FF2E90B80488%2FAD71AD56D89B4038-1426268747843-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:45:47,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1_conf.xml	dst=null	perm=null
2015-03-13 10:45:47,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:45:47,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1_conf.xml	dst=null	perm=null
2015-03-13 10:45:47,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:45:47,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001/job_1426268723022_0001_1_conf.xml	dst=null	perm=null
2015-03-13 10:45:47,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:45:47,937 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56813, bytes: 89924, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741833_1009, duration: 347000
2015-03-13 10:45:47,939 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001_conf.xml_tmp. BP-526406211-10.1.1.144-1426268720751 blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]}
2015-03-13 10:45:47,940 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741841_1017 src: /127.0.0.1:56817 dest: /127.0.0.1:56680
2015-03-13 10:45:47,941 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741841_1017 src: /127.0.0.1:56818 dest: /127.0.0.1:56676
2015-03-13 10:45:47,943 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-526406211-10.1.1.144-1426268720751:blk_1073741841_1017 src: /127.0.0.1:56819 dest: /127.0.0.1:56683
2015-03-13 10:45:47,947 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56819, dest: /127.0.0.1:56683, bytes: 89224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741841_1017, duration: 3174000
2015-03-13 10:45:47,948 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741841_1017, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:45:47,948 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56683 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:47,948 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56818, dest: /127.0.0.1:56676, bytes: 89224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741841_1017, duration: 3108000
2015-03-13 10:45:47,949 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,949 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56676 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:47,949 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:56817, dest: /127.0.0.1:56680, bytes: 89224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_830346085_1, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741841_1017, duration: 4924000
2015-03-13 10:45:47,950 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-526406211-10.1.1.144-1426268720751:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:45:47,950 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56680 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:56680|RBW], ReplicaUnderConstruction[127.0.0.1:56676|RBW], ReplicaUnderConstruction[127.0.0.1:56683|RBW]]} size 0
2015-03-13 10:45:47,952 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_830346085_1
2015-03-13 10:45:47,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:45:47,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:45:47,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:45:47,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001-1426268731527-soberoi-%5BF4A7D570B764463096A5FF2E90B80488%2FAD71AD56D89B4038-1426268747843-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426268723022_0001-1426268731527-soberoi-%5BF4A7D570B764463096A5FF2E90B80488%2FAD71AD56D89B4038-1426268747843-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:45:47,974 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426268723022_0001_000001 State change from RUNNING to FINISHING
2015-03-13 10:45:47,975 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426268723022_0001
2015-03-13 10:45:47,975 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426268723022_0001 State change from RUNNING to REMOVING
2015-03-13 10:45:47,975 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426268723022_0001
2015-03-13 10:45:47,976 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426268723022_0001 State change from REMOVING to FINISHING
2015-03-13 10:45:48,690 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:45:48,763 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426268723022 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:45:48,763 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426268723022_0001_01_000002
2015-03-13 10:45:48,764 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426268723022_0001_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:45:48,764 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426268723022_0001_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:45:48,764 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426268723022_0001	CONTAINERID=container_1426268723022_0001_01_000002
2015-03-13 10:45:48,765 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426268723022_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:56702, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:45:48,765 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:45:48,765 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426268723022_0001_01_000002, NodeId: 10.1.1.144:56702, NodeHttpAddress: 10.1.1.144:56705, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:56702 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:48,765 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:45:48,766 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:45:48,766 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426268723022_0001_000001 released container container_1426268723022_0001_01_000002 on node: host: 10.1.1.144:56702 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:45:48,990 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741829_1005 127.0.0.1:56676 127.0.0.1:56680 127.0.0.1:56683 127.0.0.1:56673 
2015-03-13 10:45:48,991 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741830_1006 127.0.0.1:56673 127.0.0.1:56680 127.0.0.1:56683 127.0.0.1:56676 
2015-03-13 10:45:48,991 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741831_1007 127.0.0.1:56683 127.0.0.1:56676 127.0.0.1:56680 
2015-03-13 10:45:48,991 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741832_1008 127.0.0.1:56683 127.0.0.1:56680 127.0.0.1:56673 
2015-03-13 10:45:48,991 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741834_1010 127.0.0.1:56683 127.0.0.1:56673 127.0.0.1:56676 
2015-03-13 10:45:48,991 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741833_1009 127.0.0.1:56676 127.0.0.1:56683 127.0.0.1:56673 
2015-03-13 10:45:48,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426268723022_0001	dst=null	perm=null
2015-03-13 10:45:49,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:49,064 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary
2015-03-13 10:45:49,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/_temporary	dst=null	perm=null
2015-03-13 10:45:49,076 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:45:49,077 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:45:49,078 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:45:49,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:49,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:49,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:49,086 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:45:49,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00000	dst=null	perm=null
2015-03-13 10:45:49,098 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56821, bytes: 291, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741838_1014, duration: 230000
2015-03-13 10:45:49,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00001	dst=null	perm=null
2015-03-13 10:45:49,103 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56821, bytes: 239, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011, duration: 226000
2015-03-13 10:45:49,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00002	dst=null	perm=null
2015-03-13 10:45:49,108 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56822, bytes: 208, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012, duration: 250000
2015-03-13 10:45:49,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00003	dst=null	perm=null
2015-03-13 10:45:49,113 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56680, dest: /127.0.0.1:56823, bytes: 208, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1915237370-10.1.1.144-56680-1426268722110, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741837_1013, duration: 243000
2015-03-13 10:45:49,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00004	dst=null	perm=null
2015-03-13 10:45:49,115 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/flowprocessplatform/openforread
2015-03-13 10:45:49,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:49,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:49,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:49,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread	dst=null	perm=null
2015-03-13 10:45:49,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00000	dst=null	perm=null
2015-03-13 10:45:49,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00000	dst=null	perm=null
2015-03-13 10:45:49,125 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56821, bytes: 291, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741838_1014, duration: 199000
2015-03-13 10:45:49,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00001	dst=null	perm=null
2015-03-13 10:45:49,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00001	dst=null	perm=null
2015-03-13 10:45:49,129 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56673, dest: /127.0.0.1:56824, bytes: 239, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1826935060-10.1.1.144-56673-1426268721965, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741835_1011, duration: 171000
2015-03-13 10:45:49,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00002	dst=null	perm=null
2015-03-13 10:45:49,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00002	dst=null	perm=null
2015-03-13 10:45:49,133 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56676, dest: /127.0.0.1:56822, bytes: 208, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1870145783-10.1.1.144-56676-1426268721963, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741836_1012, duration: 201000
2015-03-13 10:45:49,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00003	dst=null	perm=null
2015-03-13 10:45:49,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00003	dst=null	perm=null
2015-03-13 10:45:49,136 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:56683, dest: /127.0.0.1:56821, bytes: 208, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_234741904_9, offset: 0, srvID: DS-1786258516-10.1.1.144-56683-1426268722307, blockid: BP-526406211-10.1.1.144-1426268720751:blk_1073741837_1013, duration: 160000
2015-03-13 10:45:49,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00004	dst=null	perm=null
2015-03-13 10:45:49,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/flowprocessplatform/openforread/part-00004	dst=null	perm=null

Standard error

Mar 13, 2015 10:45:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:45:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Mar 13, 2015 10:45:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:45:25 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:45:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:25 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:45:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:45:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:45:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:45:26 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:45:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:26 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:45:27 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:45:27 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:45:27 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:45:27 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:45:27 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:27 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:27 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:27 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:45:28 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:45:28 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:45:28 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:45:28 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:45:28 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:28 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:28 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:28 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:45:29 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:45:29 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:45:29 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:45:29 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:45:29 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:29 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:29 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:45:29 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.