2016-05-17 22:31:02,595 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-17 22:31:02,617 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.scheme.TextDelimitedPlatformTest, with platform: hadoop2-tez
2016-05-17 22:31:02,643 INFO tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-05-17 22:31:02,975 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-05-17 22:31:03,278 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides:
2016-05-17 22:31:03,452 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:03,453 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:03,540 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 5EABBBA9D0C84A2AB153306C7CD4AA8D
2016-05-17 22:31:03,734 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.065
2016-05-17 22:31:03,745 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.076
2016-05-17 22:31:03,746 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:03,746 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:03,747 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:03,892 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-05-17 22:31:03,895 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-05-17 22:31:04,103 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-17 22:31:04,106 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:04,106 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:04,107 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-05-17 22:31:04,107 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] parallel execution of steps is enabled: false
2016-05-17 22:31:04,107 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executing total steps: 1
2016-05-17 22:31:04,108 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] allocating management threads: 1
2016-05-17 22:31:04,109 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...Char/quoted/speccharfalse
2016-05-17 22:31:04,109 WARN flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:04,130 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:04,305 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:04,312 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:04,313 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:04,366 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001 doesn't exist and is created
2016-05-17 22:31:04,445 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:04,446 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:04,447 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001
2016-05-17 22:31:04,480 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524264312_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:04,522 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:04,538 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:04,546 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-05-17 22:31:04,547 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-05-17 22:31:04,547 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:04,564 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:04,569 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:04,573 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001/localmode-log-dir
2016-05-17 22:31:04,574 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001/localmode-log-dir/history.txt.appattempt_1463524264312_0001_000000, maxErrors=10
2016-05-17 22:31:04,574 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:04,576 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524264312_0001_000000, appSubmitTime=1463524264466, launchTime=1463524264479
2016-05-17 22:31:04,583 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:04,584 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:04,586 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:04,586 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:04,640 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:36445
2016-05-17 22:31:04,647 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-05-17 22:31:04,647 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-05-17 22:31:04,647 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:04,682 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:04,747 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:04,748 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-05-17 22:31:04,748 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-05-17 22:31:04,748 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:04,748 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524264312_0001_000000, startTime=1463524264747
2016-05-17 22:31:04,749 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:04,848 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:04,864 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:04,864 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1463524264312_0001, dagName=[B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse
2016-05-17 22:31:05,082 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse
2016-05-17 22:31:05,188 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524264312_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001/localmode-log-dir/dag_1463524264312_0001_1.dot
2016-05-17 22:31:05,191 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001/localmode-log-dir/dag_1463524264312_0001_1-tez-dag.pb.txt
2016-05-17 22:31:05,351 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524264312_0001_1
2016-05-17 22:31:05,351 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:05,352 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse
2016-05-17 22:31:05 Running Dag: dag_1463524264312_0001_1
2016-05-17 22:31:05,388 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:05,388 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524264312_0001_1, submitTime=1463524265083
2016-05-17 22:31:05,434 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E0EABA0A017146E5A99B747B36938AD8
2016-05-17 22:31:05,436 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:05,440 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524264312_0001_1, initTime=1463524265391
2016-05-17 22:31:05,440 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524264312_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:05,440 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:05,443 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:05,443 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:DAG_STARTED]: dagID=dag_1463524264312_0001_1, startTime=1463524265442
2016-05-17 22:31:05,444 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:05,446 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524264312_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:05,446 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E0EABA0A017146E5A99B747B36938AD8 : {6722142E3EF24B54838D556B108A2088={InputName=6722142E3EF24B54838D556B108A2088}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:05,446 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 6722142E3EF24B54838D556B108A2088, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:05,447 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,453 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,454 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,455 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1463524264312_0001, dagName=[B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse
2016-05-17 22:31:05,456 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]. Starting root input initializers: 1
2016-05-17 22:31:05,470 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 6722142E3EF24B54838D556B108A2088 on vertex vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,474 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:05,497 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:05,499 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 6722142E3EF24B54838D556B108A2088 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:05,500 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:05,501 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:05,501 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524264312_0001, with dag id: dag_1463524264312_0001_1
2016-05-17 22:31:05,551 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-05-17 22:31:05,554 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 6722142E3EF24B54838D556B108A2088 on vertex vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,555 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:05,556 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {6722142E3EF24B54838D556B108A2088=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:05,571 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] parallelism set to 1
2016-05-17 22:31:05,571 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:05,580 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524264312_0001_1_00, eventCount=1
2016-05-17 22:31:05,582 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,582 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=FD9CED7391CE415191F89182E8B687CE, vertexId=vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:05,585 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=FD9CED7391CE415191F89182E8B687CE, vertexId=vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,605 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=FD9CED7391CE415191F89182E8B687CE, vertexName=E0EABA0A017146E5A99B747B36938AD8, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:05,616 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=FD9CED7391CE415191F89182E8B687CE, vertexId=vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,621 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:05,621 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, vertexId=vertex_1463524264312_0001_1_00, initRequestedTime=1463524265446, initedTime=1463524265620, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:05,622 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] with distanceFromRoot: 0
2016-05-17 22:31:05,622 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:05,624 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E0EABA0A017146E5A99B747B36938AD8
2016-05-17 22:31:05,624 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,626 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:05,626 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524264312_0001_1_00, startRequestedTime=1463524265623, startedTime=1463524265623
2016-05-17 22:31:05,627 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:05,658 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:05,658 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:TASK_STARTED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, taskId=task_1463524264312_0001_1_00_000000, scheduledTime=1463524265657, launchTime=1463524265657
2016-05-17 22:31:05,659 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524264312_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:05,661 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,664 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: E0EABA0A017146E5A99B747B36938AD8, VertexParallelism: 1, TaskAttemptID:attempt_1463524264312_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6722142E3EF24B54838D556B108A2088, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=FD9CED7391CE415191F89182E8B687CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:05,667 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524264312_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:05,668 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:05,709 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:05,713 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:05,714 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:05,719 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524264312_0001_00_000001
2016-05-17 22:31:05,720 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:05,731 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1463524264312_0001_00_000001
2016-05-17 22:31:05,732 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:05,736 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:05,738 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:05,738 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524264312_0001_00_000001, launchTime=1463524265738
2016-05-17 22:31:05,741 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524264312_0001_00_000001
2016-05-17 22:31:05,745 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524264312_0001_1_00_000000_0] to container: [container_1463524264312_0001_00_000001]
2016-05-17 22:31:05,745 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:05,746 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524264312_0001_00_000001 given task: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,746 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524264312_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05 Starting to run new task attempt: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,748 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,748 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:05,749 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524264312_0001_1_00_000000_0] started. Is using containerId: [container_1463524264312_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:05,750 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:05,751 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:05,752 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:05,753 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:05,754 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0, startTime=1463524265746, containerId=container_1463524264312_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524264312_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:05,756 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524264312_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:05,756 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:05,756 INFO counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-05-17 22:31:05,760 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524264312_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:05,782 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:05,782 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: E0EABA0A017146E5A99B747B36938AD8, VertexParallelism: 1, TaskAttemptID:attempt_1463524264312_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6722142E3EF24B54838D556B108A2088, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=FD9CED7391CE415191F89182E8B687CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:05,785 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:05,790 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,790 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:05,791 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:05,794 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524264312_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:05,797 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=6722142E3EF24B54838D556B108A2088, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:05,798 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:05,799 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=FD9CED7391CE415191F89182E8B687CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:05,800 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:05,800 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,801 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:05,801 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: FD9CED7391CE415191F89182E8B687CE
2016-05-17 22:31:05,801 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:05,804 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,804 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: FD9CED7391CE415191F89182E8B687CE
2016-05-17 22:31:05,830 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:05,831 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,832 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,838 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:05,855 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E0EABA0A017146E5A99B747B36938AD8, ordinal: 0
2016-05-17 22:31:05,857 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E0EABA0A017146E5A99B747B36938AD8, mem on start (mb), free: 159, total: 281, max: 672
2016-05-17 22:31:05,857 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:05,857 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:05,858 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:05,858 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:05,858 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: FD9CED7391CE415191F89182E8B687CE
2016-05-17 22:31:05,858 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:05,859 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:05,870 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:05,871 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:05,872 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:05,872 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:05,872 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:05,872 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:05,872 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 6722142E3EF24B54838D556B108A2088, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:05,873 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, FD9CED7391CE415191F89182E8B687CE, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:05,874 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:05,875 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 6722142E3EF24B54838D556B108A2088 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:05,875 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,876 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:05,876 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,876 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:05,877 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:05,878 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:05,879 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,882 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:05,893 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2ad5934b
2016-05-17 22:31:05,940 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2ad5934b
2016-05-17 22:31:05,945 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:05,945 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:05,958 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:05,962 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,962 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"], id: FD9CED7391CE415191F89182E8B687CE
2016-05-17 22:31:05,963 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-05-17 22:31:05,967 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:05,967 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:05,971 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E0EABA0A017146E5A99B747B36938AD8, all 1 inputs ready in: 00:00:00.003
2016-05-17 22:31:05,982 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:05,982 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:05,984 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,984 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524264312_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:05,986 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,986 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E0EABA0A017146E5A99B747B36938AD8, mem on close (mb), free: 255, total: 281, max: 672
2016-05-17 22:31:05 Completed running task attempt: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,993 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:05,997 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=32, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524265972, Process_Duration=14, Process_End_Time=1463524265986, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-05-17 22:31:05,998 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:05,998 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-05-17 22:31:05,999 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:05,999 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524264312_0001_00_000001
2016-05-17 22:31:06,002 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0, startTime=1463524265746, finishTime=1463524265994, timeTaken=248, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=32, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524265972, Process_Duration=14, Process_End_Time=1463524265986, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,003 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524264312_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:06,004 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:06,005 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:06,008 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:06,007 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:TASK_FINISHED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, taskId=task_1463524264312_0001_1_00_000000, startTime=1463524265746, finishTime=1463524266005, timeTaken=259, status=SUCCEEDED, successfulAttemptID=attempt_1463524264312_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=32, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524265972, Process_Duration=14, Process_End_Time=1463524265986, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,017 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524264312_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:06,018 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] : 1
2016-05-17 22:31:06,018 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:06,025 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:06,028 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:VERTEX_FINISHED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, vertexId=vertex_1463524264312_0001_1_00, initRequestedTime=1463524265446, initedTime=1463524265620, startRequestedTime=1463524265623, startedTime=1463524265623, finishTime=1463524266019, timeTaken=396, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=32, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524265972, Process_Duration=14, Process_End_Time=1463524265986, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1463524265746, firstTasksToStart=[ task_1463524264312_0001_1_00_000000 ], lastTaskFinishTime=1463524265994, lastTasksToFinish=[ task_1463524264312_0001_1_00_000000 ], minTaskDuration=248, maxTaskDuration=248, avgTaskDuration=248.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524264312_0001_1_00_000000 ], longestDurationTasks=[ task_1463524264312_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:06,029 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:06,030 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:06,031 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:06,031 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524264312_0001_00_000001, stoppedTime=1463524266031, exitStatus=0
2016-05-17 22:31:06,033 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:06,033 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:06,033 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524264312_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:06,034 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524264312_0001_00_000001: 35 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:06,034 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524264312_0001_00_000001, Exiting
2016-05-17 22:31:06,034 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524264312_0001_00_000001
2016-05-17 22:31:06,034 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524264312_0001_00_000001
2016-05-17 22:31:06,035 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524264312_0001_1
2016-05-17 22:31:06,036 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524264312_0001_1
2016-05-17 22:31:06,038 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524264312_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:06,039 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524264312_0001_00_000001 completed successfully
2016-05-17 22:31:06,039 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: FD9CED7391CE415191F89182E8B687CE for vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:06,059 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524264312_0001_1, queueSize=0
2016-05-17 22:31:06,059 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:06,061 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524264312_0001_1, startTime=1463524265442, finishTime=1463524266052, timeTaken=610, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=32, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524265972, Process_Duration=14, Process_End_Time=1463524265986, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,062 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524264312_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:06,065 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524264312_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:06,065 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524264312_0001_00_000001
2016-05-17 22:31:06,065 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:06 Completed Dag: dag_1463524264312_0001_1
2016-05-17 22:31:06,066 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524264312_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:06,066 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524264312_0001_1_post
2016-05-17 22:31:06,066 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:06,066 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:06,076 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1463524264312_0001
2016-05-17 22:31:06,080 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:06,080 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:06,081 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:06,081 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:06,081 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:06,082 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:06,085 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:06,085 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:06,085 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:06,086 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:06,086 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:06,086 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:06,087 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:06,092 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001
2016-05-17 22:31:06,094 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse/_temporary
2016-05-17 22:31:06,094 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] completed in: 00:01.987
2016-05-17 22:31:06,235 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-05-17 22:31:06,269 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:06,269 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:06,331 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-05-17 22:31:06,341 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.039
2016-05-17 22:31:06,342 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:06,342 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:06,343 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:06,362 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-05-17 22:31:06,363 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-05-17 22:31:06,389 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:06,390 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:06,390 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-05-17 22:31:06,390 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] parallel execution of steps is enabled: false
2016-05-17 22:31:06,391 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executing total steps: 1
2016-05-17 22:31:06,392 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] allocating management threads: 1
2016-05-17 22:31:06,392 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...xtAll/quoted/normchartrue
2016-05-17 22:31:06,393 WARN flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:06,409 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:06,416 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:06,417 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:06,417 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:06,427 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001 doesn't exist and is created
2016-05-17 22:31:06,451 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:06,451 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:06,453 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001
2016-05-17 22:31:06,458 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524266416_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:06,474 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:06,475 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:06,478 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:06,478 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:06,478 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001/localmode-log-dir
2016-05-17 22:31:06,479 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001/localmode-log-dir/history.txt.appattempt_1463524266416_0001_000000, maxErrors=10
2016-05-17 22:31:06,480 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:06,480 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524266416_0001_000000, appSubmitTime=1463524266458, launchTime=1463524266458
2016-05-17 22:31:06,485 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:06,487 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:06,490 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:06,490 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:06,494 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:36177
2016-05-17 22:31:06,496 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:06,498 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:06,498 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524266416_0001_000000, startTime=1463524266498
2016-05-17 22:31:06,498 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:06,552 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:06,552 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:06,552 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1463524266416_0001, dagName=[4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-05-17 22:31:06,586 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-05-17 22:31:06,589 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524266416_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001/localmode-log-dir/dag_1463524266416_0001_1.dot
2016-05-17 22:31:06,590 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001/localmode-log-dir/dag_1463524266416_0001_1-tez-dag.pb.txt
2016-05-17 22:31:06,615 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524266416_0001_1
2016-05-17 22:31:06,615 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:06,615 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-05-17 22:31:06 Running Dag: dag_1463524266416_0001_1
2016-05-17 22:31:06,632 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:06,632 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524266416_0001_1, submitTime=1463524266586
2016-05-17 22:31:06,633 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B8E02653E84845E9AE73C631E278B1F5
2016-05-17 22:31:06,635 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:06,635 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:06,636 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524266416_0001_1, initTime=1463524266633
2016-05-17 22:31:06,637 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524266416_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:06,637 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:DAG_STARTED]: dagID=dag_1463524266416_0001_1, startTime=1463524266637
2016-05-17 22:31:06,637 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:06,638 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:06,638 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524266416_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:06,638 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B8E02653E84845E9AE73C631E278B1F5 : {4DEE49BF9F2D4181A740B9EF3BEB9D62={InputName=4DEE49BF9F2D4181A740B9EF3BEB9D62}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:06,638 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 4DEE49BF9F2D4181A740B9EF3BEB9D62, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:06,639 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,639 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1463524266416_0001, dagName=[4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-05-17 22:31:06,639 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,640 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,640 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]. Starting root input initializers: 1
2016-05-17 22:31:06,646 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:06,646 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 4DEE49BF9F2D4181A740B9EF3BEB9D62 on vertex vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,653 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:06,653 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 4DEE49BF9F2D4181A740B9EF3BEB9D62 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:06,655 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:06,655 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:06,658 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-05-17 22:31:06,659 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 4DEE49BF9F2D4181A740B9EF3BEB9D62 on vertex vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,659 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:06,659 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {4DEE49BF9F2D4181A740B9EF3BEB9D62=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:06,660 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] parallelism set to 1
2016-05-17 22:31:06,660 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:06,661 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524266416_0001_1_00, eventCount=1
2016-05-17 22:31:06,661 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,662 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=D6D78C5400A14A42AAF19AD2C383B81C, vertexId=vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:06,662 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=D6D78C5400A14A42AAF19AD2C383B81C, vertexId=vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,667 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524266416_0001, with dag id: dag_1463524266416_0001_1
2016-05-17 22:31:06,669 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=D6D78C5400A14A42AAF19AD2C383B81C, vertexName=B8E02653E84845E9AE73C631E278B1F5, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:06,669 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=D6D78C5400A14A42AAF19AD2C383B81C, vertexId=vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,670 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:06,671 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, vertexId=vertex_1463524266416_0001_1_00, initRequestedTime=1463524266638, initedTime=1463524266670, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:06,671 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] with distanceFromRoot: 0
2016-05-17 22:31:06,671 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:06,671 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B8E02653E84845E9AE73C631E278B1F5
2016-05-17 22:31:06,672 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,672 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:06,673 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524266416_0001_1_00, startRequestedTime=1463524266671, startedTime=1463524266671
2016-05-17 22:31:06,673 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:06,674 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:06,674 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:TASK_STARTED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, taskId=task_1463524266416_0001_1_00_000000, scheduledTime=1463524266674, launchTime=1463524266674
2016-05-17 22:31:06,675 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524266416_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:06,675 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,676 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: B8E02653E84845E9AE73C631E278B1F5, VertexParallelism: 1, TaskAttemptID:attempt_1463524266416_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4DEE49BF9F2D4181A740B9EF3BEB9D62, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D6D78C5400A14A42AAF19AD2C383B81C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:06,676 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524266416_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:06,677 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:06,678 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:06,679 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:06,679 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:06,680 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524266416_0001_00_000001
2016-05-17 22:31:06,680 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:06,686 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1463524266416_0001_00_000001
2016-05-17 22:31:06,686 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:06,687 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:06,687 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524266416_0001_00_000001, launchTime=1463524266687
2016-05-17 22:31:06,687 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:06,688 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524266416_0001_00_000001
2016-05-17 22:31:06,690 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524266416_0001_1_00_000000_0] to container: [container_1463524266416_0001_00_000001]
2016-05-17 22:31:06,690 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:06,690 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524266416_0001_1_00_000000_0] started. Is using containerId: [container_1463524266416_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:06,691 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:06,691 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0, startTime=1463524266690, containerId=container_1463524266416_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524266416_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:06,692 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524266416_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:06,692 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524266416_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:06,692 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524266416_0001_00_000001 given task: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,692 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524266416_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06 Starting to run new task attempt: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,693 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,693 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:06,693 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:06,693 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:06,694 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:06,694 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:06,694 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:06,694 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: B8E02653E84845E9AE73C631E278B1F5, VertexParallelism: 1, TaskAttemptID:attempt_1463524266416_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4DEE49BF9F2D4181A740B9EF3BEB9D62, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D6D78C5400A14A42AAF19AD2C383B81C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:06,695 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:06,695 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,697 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:06,697 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:06,700 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:06,700 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=D6D78C5400A14A42AAF19AD2C383B81C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:06,702 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:06,703 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: D6D78C5400A14A42AAF19AD2C383B81C
2016-05-17 22:31:06,703 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:06,703 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: D6D78C5400A14A42AAF19AD2C383B81C
2016-05-17 22:31:06,702 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=4DEE49BF9F2D4181A740B9EF3BEB9D62, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:06,704 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:06,704 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,705 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,707 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524266416_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:06,710 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:06,717 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:06,717 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,717 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,725 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B8E02653E84845E9AE73C631E278B1F5, ordinal: 0
2016-05-17 22:31:06,726 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B8E02653E84845E9AE73C631E278B1F5, mem on start (mb), free: 162, total: 281, max: 672
2016-05-17 22:31:06,727 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:06,728 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:06,728 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:06,728 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:06,729 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: D6D78C5400A14A42AAF19AD2C383B81C
2016-05-17 22:31:06,729 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:06,729 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:06,730 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:06,730 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:06,730 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:06,731 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:06,732 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:06,733 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:06,733 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, D6D78C5400A14A42AAF19AD2C383B81C, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:06,733 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 4DEE49BF9F2D4181A740B9EF3BEB9D62, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:06,734 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:06,734 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,734 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:06,734 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,734 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 4DEE49BF9F2D4181A740B9EF3BEB9D62 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:06,735 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:06,735 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:06,735 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:06,736 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,738 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:06,740 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@6538b017
2016-05-17 22:31:06,746 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@6538b017
2016-05-17 22:31:06,746 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:06,747 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:06,746 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:06,748 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,748 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"], id: D6D78C5400A14A42AAF19AD2C383B81C
2016-05-17 22:31:06,748 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-05-17 22:31:06,749 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:06,749 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:06,750 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B8E02653E84845E9AE73C631E278B1F5, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:06,753 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:06,754 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:06,754 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,755 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524266416_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:06,756 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,756 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B8E02653E84845E9AE73C631E278B1F5, mem on close (mb), free: 160, total: 281, max: 672
2016-05-17 22:31:06 Completed running task attempt: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,757 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:06,759 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524266750, Process_Duration=6, Process_End_Time=1463524266756, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-05-17 22:31:06,759 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:06,760 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0, startTime=1463524266690, finishTime=1463524266759, timeTaken=69, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524266750, Process_Duration=6, Process_End_Time=1463524266756, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,761 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524266416_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:06,761 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,762 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:06,762 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-05-17 22:31:06,763 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:06,762 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:06,764 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:TASK_FINISHED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, taskId=task_1463524266416_0001_1_00_000000, startTime=1463524266690, finishTime=1463524266761, timeTaken=71, status=SUCCEEDED, successfulAttemptID=attempt_1463524266416_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524266750, Process_Duration=6, Process_End_Time=1463524266756, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,765 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524266416_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:06,765 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] : 1
2016-05-17 22:31:06,765 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,766 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524266416_0001_00_000001
2016-05-17 22:31:06,768 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:06,771 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:VERTEX_FINISHED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, vertexId=vertex_1463524266416_0001_1_00, initRequestedTime=1463524266638, initedTime=1463524266670, startRequestedTime=1463524266671, startedTime=1463524266671, finishTime=1463524266765, timeTaken=94, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524266750, Process_Duration=6, Process_End_Time=1463524266756, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1463524266690, firstTasksToStart=[ task_1463524266416_0001_1_00_000000 ], lastTaskFinishTime=1463524266759, lastTasksToFinish=[ task_1463524266416_0001_1_00_000000 ], minTaskDuration=69, maxTaskDuration=69, avgTaskDuration=69.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524266416_0001_1_00_000000 ], longestDurationTasks=[ task_1463524266416_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:06,772 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:06,772 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:06,772 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:06,772 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524266416_0001_00_000001, stoppedTime=1463524266772, exitStatus=0
2016-05-17 22:31:06,773 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:06,773 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:06,774 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524266416_0001_1
2016-05-17 22:31:06,774 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524266416_0001_1
2016-05-17 22:31:06,775 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: D6D78C5400A14A42AAF19AD2C383B81C for vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,778 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524266416_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:06,778 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524266416_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:06,779 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524266416_0001_00_000001, Exiting
2016-05-17 22:31:06,780 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524266416_0001_00_000001
2016-05-17 22:31:06,780 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524266416_0001_00_000001
2016-05-17 22:31:06,782 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524266416_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:06,782 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524266416_0001_00_000001 completed successfully
2016-05-17 22:31:06,788 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524266416_0001_1, queueSize=0
2016-05-17 22:31:06,788 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:06,789 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524266416_0001_1, startTime=1463524266637, finishTime=1463524266787, timeTaken=150, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524266750, Process_Duration=6, Process_End_Time=1463524266756, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,789 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524266416_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:06,790 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524266416_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:06,790 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:06,790 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524266416_0001_00_000001
2016-05-17 22:31:06 Completed Dag: dag_1463524266416_0001_1
2016-05-17 22:31:06,791 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524266416_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:06,792 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524266416_0001_1_post
2016-05-17 22:31:06,792 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:06,792 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:06,798 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1463524266416_0001
2016-05-17 22:31:06,801 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:06,801 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:06,801 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:06,801 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:06,801 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:06,802 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:06,802 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:06,803 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:06,803 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:06,804 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:06,804 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:06,805 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:06,805 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:06,810 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001
2016-05-17 22:31:06,811 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue/_temporary
2016-05-17 22:31:06,812 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] completed in: 00:00.421
2016-05-17 22:31:06,975 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-05-17 22:31:07,015 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:07,016 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:07,072 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-05-17 22:31:07,087 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-05-17 22:31:07,087 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:07,088 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:07,088 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:07,105 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-05-17 22:31:07,106 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-05-17 22:31:07,129 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:07,130 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:07,131 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-05-17 22:31:07,132 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] parallel execution of steps is enabled: false
2016-05-17 22:31:07,133 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executing total steps: 1
2016-05-17 22:31:07,134 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] allocating management threads: 1
2016-05-17 22:31:07,135 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...arAll/quoted/specchartrue
2016-05-17 22:31:07,135 WARN flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:07,151 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:07,156 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:07,156 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:07,156 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:07,166 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001 doesn't exist and is created
2016-05-17 22:31:07,190 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:07,191 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:07,191 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001
2016-05-17 22:31:07,196 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524267156_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:07,207 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:07,209 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:07,211 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:07,212 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:07,212 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001/localmode-log-dir
2016-05-17 22:31:07,213 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001/localmode-log-dir/history.txt.appattempt_1463524267156_0001_000000, maxErrors=10
2016-05-17 22:31:07,213 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:07,213 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524267156_0001_000000, appSubmitTime=1463524267195, launchTime=1463524267195
2016-05-17 22:31:07,219 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:07,222 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:07,224 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:07,224 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:07,236 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:47038
2016-05-17 22:31:07,237 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:07,240 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524267156_0001_000000, startTime=1463524267240
2016-05-17 22:31:07,240 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:07,240 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:07,291 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:07,291 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:07,291 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1463524267156_0001, dagName=[4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue
2016-05-17 22:31:07,322 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue
2016-05-17 22:31:07,324 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524267156_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001/localmode-log-dir/dag_1463524267156_0001_1.dot
2016-05-17 22:31:07,325 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001/localmode-log-dir/dag_1463524267156_0001_1-tez-dag.pb.txt
2016-05-17 22:31:07,350 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524267156_0001_1
2016-05-17 22:31:07,350 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:07,350 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue
2016-05-17 22:31:07 Running Dag: dag_1463524267156_0001_1
2016-05-17 22:31:07,369 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524267156_0001_1, submitTime=1463524267322
2016-05-17 22:31:07,369 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:07,369 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A89FCAD7C4F844F3A497AE702C76E565
2016-05-17 22:31:07,370 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:07,370 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524267156_0001_1, initTime=1463524267369
2016-05-17 22:31:07,370 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267156_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:07,373 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:DAG_STARTED]: dagID=dag_1463524267156_0001_1, startTime=1463524267372
2016-05-17 22:31:07,373 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:07,373 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267156_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:07,373 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A89FCAD7C4F844F3A497AE702C76E565 : {8515E354D3884325AF7DE776BCCF723C={InputName=8515E354D3884325AF7DE776BCCF723C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:07,373 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8515E354D3884325AF7DE776BCCF723C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:07,374 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,374 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,374 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,374 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]. Starting root input initializers: 1
2016-05-17 22:31:07,374 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:07,375 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:07,376 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:07,377 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8515E354D3884325AF7DE776BCCF723C on vertex vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,377 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1463524267156_0001, dagName=[4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue
2016-05-17 22:31:07,379 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:07,380 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8515E354D3884325AF7DE776BCCF723C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:07,382 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:07,383 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:07,385 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-05-17 22:31:07,386 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8515E354D3884325AF7DE776BCCF723C on vertex vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,387 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:07,387 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8515E354D3884325AF7DE776BCCF723C=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:07,388 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] parallelism set to 1
2016-05-17 22:31:07,388 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:07,388 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524267156_0001_1_00, eventCount=1
2016-05-17 22:31:07,389 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,390 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=90102CEBF5FA4FA0AAB58F65B2F3658C, vertexId=vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:07,390 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=90102CEBF5FA4FA0AAB58F65B2F3658C, vertexId=vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,392 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=90102CEBF5FA4FA0AAB58F65B2F3658C, vertexName=A89FCAD7C4F844F3A497AE702C76E565, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:07,393 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=90102CEBF5FA4FA0AAB58F65B2F3658C, vertexId=vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,395 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:07,395 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, vertexId=vertex_1463524267156_0001_1_00, initRequestedTime=1463524267373, initedTime=1463524267395, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:07,396 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] with distanceFromRoot: 0
2016-05-17 22:31:07,397 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:07,397 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A89FCAD7C4F844F3A497AE702C76E565
2016-05-17 22:31:07,398 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,398 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:07,398 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524267156_0001_1_00, startRequestedTime=1463524267397, startedTime=1463524267397
2016-05-17 22:31:07,399 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:07,400 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:07,400 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:TASK_STARTED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, taskId=task_1463524267156_0001_1_00_000000, scheduledTime=1463524267400, launchTime=1463524267400
2016-05-17 22:31:07,401 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267156_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:07,401 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,402 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524267156_0001, with dag id: dag_1463524267156_0001_1
2016-05-17 22:31:07,403 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: A89FCAD7C4F844F3A497AE702C76E565, VertexParallelism: 1, TaskAttemptID:attempt_1463524267156_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8515E354D3884325AF7DE776BCCF723C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=90102CEBF5FA4FA0AAB58F65B2F3658C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:07,403 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267156_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:07,404 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:07,407 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:07,412 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:07,412 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:07,413 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524267156_0001_00_000001
2016-05-17 22:31:07,413 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:07,414 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1463524267156_0001_00_000001
2016-05-17 22:31:07,415 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:07,416 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:07,416 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:07,417 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524267156_0001_00_000001, launchTime=1463524267415
2016-05-17 22:31:07,417 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524267156_0001_00_000001
2016-05-17 22:31:07,418 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524267156_0001_1_00_000000_0] to container: [container_1463524267156_0001_00_000001]
2016-05-17 22:31:07,418 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:07,419 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524267156_0001_00_000001 given task: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,419 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524267156_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,419 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524267156_0001_1_00_000000_0] started. Is using containerId: [container_1463524267156_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:07,419 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:07,419 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0, startTime=1463524267419, containerId=container_1463524267156_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524267156_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:07,420 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267156_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:07 Starting to run new task attempt: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,420 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267156_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:07,420 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,420 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:07,421 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:07,421 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:07,421 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:07,421 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:07,421 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:07,422 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: A89FCAD7C4F844F3A497AE702C76E565, VertexParallelism: 1, TaskAttemptID:attempt_1463524267156_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8515E354D3884325AF7DE776BCCF723C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=90102CEBF5FA4FA0AAB58F65B2F3658C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:07,422 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:07,422 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,423 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:07,423 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:07,424 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=8515E354D3884325AF7DE776BCCF723C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:07,425 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:07,425 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,425 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,428 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:07,432 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:07,433 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524267156_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:07,433 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=90102CEBF5FA4FA0AAB58F65B2F3658C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:07,435 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:07,437 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 90102CEBF5FA4FA0AAB58F65B2F3658C
2016-05-17 22:31:07,437 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:07,438 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 90102CEBF5FA4FA0AAB58F65B2F3658C
2016-05-17 22:31:07,434 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:07,441 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,441 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,445 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A89FCAD7C4F844F3A497AE702C76E565, ordinal: 0
2016-05-17 22:31:07,445 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A89FCAD7C4F844F3A497AE702C76E565, mem on start (mb), free: 300, total: 397, max: 672
2016-05-17 22:31:07,445 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:07,445 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:07,446 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:07,456 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:07,456 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 90102CEBF5FA4FA0AAB58F65B2F3658C
2016-05-17 22:31:07,457 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:07,457 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:07,457 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:07,457 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:07,457 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:07,457 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:07,458 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:07,458 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:07,458 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 8515E354D3884325AF7DE776BCCF723C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:07,458 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 90102CEBF5FA4FA0AAB58F65B2F3658C, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:07,458 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:07,459 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,459 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:07,459 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,459 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 8515E354D3884325AF7DE776BCCF723C being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:07,459 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:07,459 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:07,460 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:07,463 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,463 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:07,464 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5740807
2016-05-17 22:31:07,466 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5740807
2016-05-17 22:31:07,466 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:07,466 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:07,467 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:07,468 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,468 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"], id: 90102CEBF5FA4FA0AAB58F65B2F3658C
2016-05-17 22:31:07,469 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-05-17 22:31:07,469 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:07,469 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:07,470 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A89FCAD7C4F844F3A497AE702C76E565, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:07,473 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:07,474 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:07,476 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,476 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524267156_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:07,478 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,478 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A89FCAD7C4F844F3A497AE702C76E565, mem on close (mb), free: 298, total: 397, max: 672
2016-05-17 22:31:07 Completed running task attempt: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,481 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:07,483 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524267470, Process_Duration=7, Process_End_Time=1463524267477, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-05-17 22:31:07,483 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:07,484 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-05-17 22:31:07,484 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0, startTime=1463524267419, finishTime=1463524267483, timeTaken=64, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524267470, Process_Duration=7, Process_End_Time=1463524267477, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:07,486 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267156_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:07,486 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:07,485 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:07,486 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,487 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:TASK_FINISHED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, taskId=task_1463524267156_0001_1_00_000000, startTime=1463524267419, finishTime=1463524267487, timeTaken=68, status=SUCCEEDED, successfulAttemptID=attempt_1463524267156_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524267470, Process_Duration=7, Process_End_Time=1463524267477, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:07,488 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267156_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:07,488 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] : 1
2016-05-17 22:31:07,488 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,489 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:07,490 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524267156_0001_00_000001
2016-05-17 22:31:07,492 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:07,495 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:VERTEX_FINISHED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, vertexId=vertex_1463524267156_0001_1_00, initRequestedTime=1463524267373, initedTime=1463524267395, startRequestedTime=1463524267397, startedTime=1463524267397, finishTime=1463524267488, timeTaken=91, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524267470, Process_Duration=7, Process_End_Time=1463524267477, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1463524267419, firstTasksToStart=[ task_1463524267156_0001_1_00_000000 ], lastTaskFinishTime=1463524267483, lastTasksToFinish=[ task_1463524267156_0001_1_00_000000 ], minTaskDuration=64, maxTaskDuration=64, avgTaskDuration=64.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524267156_0001_1_00_000000 ], longestDurationTasks=[ task_1463524267156_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:07,495 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:07,495 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:07,497 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524267156_0001_00_000001, stoppedTime=1463524267496, exitStatus=0
2016-05-17 22:31:07,497 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:07,497 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:07,498 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:07,499 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524267156_0001_1
2016-05-17 22:31:07,499 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524267156_0001_1
2016-05-17 22:31:07,500 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 90102CEBF5FA4FA0AAB58F65B2F3658C for vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,503 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524267156_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:07,503 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524267156_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:07,503 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524267156_0001_00_000001, Exiting
2016-05-17 22:31:07,503 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524267156_0001_00_000001
2016-05-17 22:31:07,503 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524267156_0001_00_000001
2016-05-17 22:31:07,507 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524267156_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:07,508 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524267156_0001_00_000001 completed successfully
2016-05-17 22:31:07,517 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524267156_0001_1, queueSize=0
2016-05-17 22:31:07,517 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:07,518 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524267156_0001_1, startTime=1463524267372, finishTime=1463524267515, timeTaken=143, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524267470, Process_Duration=7, Process_End_Time=1463524267477, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:07,518 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524267156_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:07,518 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267156_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:07,519 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:07,519 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524267156_0001_00_000001
2016-05-17 22:31:07 Completed Dag: dag_1463524267156_0001_1
2016-05-17 22:31:07,521 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524267156_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:07,522 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524267156_0001_1_post
2016-05-17 22:31:07,522 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:07,523 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:07,527 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1463524267156_0001
2016-05-17 22:31:07,530 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:07,530 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:07,530 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:07,530 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:07,531 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:07,531 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:07,531 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:07,533 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:07,533 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:07,533 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:07,533 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:07,535 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:07,535 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:07,541 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001
2016-05-17 22:31:07,541 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue/_temporary
2016-05-17 22:31:07,542 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] completed in: 00:00.412
2016-05-17 22:31:07,649 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-05-17 22:31:07,678 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:07,679 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:07,725 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-05-17 22:31:07,740 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-05-17 22:31:07,741 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:07,741 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:07,741 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:07,759 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-05-17 22:31:07,759 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-05-17 22:31:07,776 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:07,777 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:07,777 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-05-17 22:31:07,778 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] parallel execution of steps is enabled: false
2016-05-17 22:31:07,779 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executing total steps: 1
2016-05-17 22:31:07,779 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] allocating management threads: 1
2016-05-17 22:31:07,780 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...m/testHeaderAll/headerall
2016-05-17 22:31:07,780 WARN flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:07,797 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:07,802 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:07,803 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:07,803 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:07,814 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001 doesn't exist and is created
2016-05-17 22:31:07,831 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:07,832 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:07,832 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001
2016-05-17 22:31:07,837 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524267802_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:07,852 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:07,853 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:07,856 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:07,856 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:07,856 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001/localmode-log-dir
2016-05-17 22:31:07,857 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001/localmode-log-dir/history.txt.appattempt_1463524267802_0001_000000, maxErrors=10
2016-05-17 22:31:07,857 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:07,858 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524267802_0001_000000, appSubmitTime=1463524267837, launchTime=1463524267837
2016-05-17 22:31:07,863 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:07,868 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:07,871 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:57713
2016-05-17 22:31:07,873 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:07,873 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:07,874 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:07,877 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:07,877 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524267802_0001_000000, startTime=1463524267877
2016-05-17 22:31:07,877 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:07,932 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:07,932 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:07,932 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1463524267802_0001, dagName=[E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall
2016-05-17 22:31:07,957 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall
2016-05-17 22:31:07,959 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524267802_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001/localmode-log-dir/dag_1463524267802_0001_1.dot
2016-05-17 22:31:07,960 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001/localmode-log-dir/dag_1463524267802_0001_1-tez-dag.pb.txt
2016-05-17 22:31:07,988 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524267802_0001_1
2016-05-17 22:31:07,988 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:07,989 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall
2016-05-17 22:31:07 Running Dag: dag_1463524267802_0001_1
2016-05-17 22:31:08,003 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:08,004 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524267802_0001_1, submitTime=1463524267957
2016-05-17 22:31:08,005 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F4A755132C6A4CC7A4CB4D4AD949D557
2016-05-17 22:31:08,005 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:08,005 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:08,006 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524267802_0001_1, initTime=1463524268004
2016-05-17 22:31:08,006 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267802_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:08,007 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:08,007 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:DAG_STARTED]: dagID=dag_1463524267802_0001_1, startTime=1463524268007
2016-05-17 22:31:08,007 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:08,007 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267802_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:08,008 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F4A755132C6A4CC7A4CB4D4AD949D557 : {F60BD80950A942B3A59E05289627AE99={InputName=F60BD80950A942B3A59E05289627AE99}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:08,008 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: F60BD80950A942B3A59E05289627AE99, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:08,008 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,008 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,008 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,009 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]. Starting root input initializers: 1
2016-05-17 22:31:08,009 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1463524267802_0001, dagName=[E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall
2016-05-17 22:31:08,010 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:08,010 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: F60BD80950A942B3A59E05289627AE99 on vertex vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,013 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:08,013 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input F60BD80950A942B3A59E05289627AE99 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:08,015 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:08,015 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:08,019 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-05-17 22:31:08,020 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: F60BD80950A942B3A59E05289627AE99 on vertex vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,020 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:08,020 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {F60BD80950A942B3A59E05289627AE99=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:08,021 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] parallelism set to 1
2016-05-17 22:31:08,021 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:08,021 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524267802_0001_1_00, eventCount=1
2016-05-17 22:31:08,022 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,022 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=1A2C6632A98F45D6B330088DBD62B647, vertexId=vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:08,022 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=1A2C6632A98F45D6B330088DBD62B647, vertexId=vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,025 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=1A2C6632A98F45D6B330088DBD62B647, vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:08,026 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=1A2C6632A98F45D6B330088DBD62B647, vertexId=vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,027 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:08,027 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, vertexId=vertex_1463524267802_0001_1_00, initRequestedTime=1463524268008, initedTime=1463524268027, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:08,028 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] with distanceFromRoot: 0
2016-05-17 22:31:08,028 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:08,028 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F4A755132C6A4CC7A4CB4D4AD949D557
2016-05-17 22:31:08,029 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,029 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:08,029 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524267802_0001_1_00, startRequestedTime=1463524268028, startedTime=1463524268028
2016-05-17 22:31:08,030 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:08,030 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:08,030 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:TASK_STARTED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, taskId=task_1463524267802_0001_1_00_000000, scheduledTime=1463524268030, launchTime=1463524268030
2016-05-17 22:31:08,031 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267802_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:08,031 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,032 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: F4A755132C6A4CC7A4CB4D4AD949D557, VertexParallelism: 1, TaskAttemptID:attempt_1463524267802_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F60BD80950A942B3A59E05289627AE99, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1A2C6632A98F45D6B330088DBD62B647, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:08,032 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267802_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:08,032 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:08,034 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:08,034 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:08,034 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:08,035 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524267802_0001_00_000001
2016-05-17 22:31:08,035 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:08,037 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524267802_0001, with dag id: dag_1463524267802_0001_1
2016-05-17 22:31:08,038 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1463524267802_0001_00_000001
2016-05-17 22:31:08,038 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:08,041 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:08,042 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:08,042 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524267802_0001_00_000001, launchTime=1463524268041
2016-05-17 22:31:08,043 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524267802_0001_00_000001
2016-05-17 22:31:08,044 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524267802_0001_1_00_000000_0] to container: [container_1463524267802_0001_00_000001]
2016-05-17 22:31:08,044 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:08,044 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524267802_0001_00_000001 given task: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,045 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524267802_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,045 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524267802_0001_1_00_000000_0] started. Is using containerId: [container_1463524267802_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:08,046 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:08,046 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0, startTime=1463524268045, containerId=container_1463524267802_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524267802_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:08,046 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267802_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:08,046 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267802_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:08 Starting to run new task attempt: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,048 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,049 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,049 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:08,049 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:08,050 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:08,050 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:08,050 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:08,051 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: F4A755132C6A4CC7A4CB4D4AD949D557, VertexParallelism: 1, TaskAttemptID:attempt_1463524267802_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F60BD80950A942B3A59E05289627AE99, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1A2C6632A98F45D6B330088DBD62B647, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:08,051 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:08,053 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,055 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:08,055 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,058 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524267802_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:08,058 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=1A2C6632A98F45D6B330088DBD62B647, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:08,058 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=F60BD80950A942B3A59E05289627AE99, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:08,060 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:08,060 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,060 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:08,062 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 1A2C6632A98F45D6B330088DBD62B647
2016-05-17 22:31:08,063 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:08,064 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 1A2C6632A98F45D6B330088DBD62B647
2016-05-17 22:31:08,064 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:08,066 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,066 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,066 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:08,078 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F4A755132C6A4CC7A4CB4D4AD949D557, ordinal: 0
2016-05-17 22:31:08,078 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F4A755132C6A4CC7A4CB4D4AD949D557, mem on start (mb), free: 209, total: 397, max: 672
2016-05-17 22:31:08,079 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,079 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:08,079 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:08,082 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:08,082 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 1A2C6632A98F45D6B330088DBD62B647
2016-05-17 22:31:08,083 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:08,083 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:08,083 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:08,083 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:08,083 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:08,083 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:08,083 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:08,084 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:08,084 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, F60BD80950A942B3A59E05289627AE99, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:08,084 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 1A2C6632A98F45D6B330088DBD62B647, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:08,084 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:08,084 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: F60BD80950A942B3A59E05289627AE99 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:08,084 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:08,085 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:08,085 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,086 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:08,086 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,086 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:08,087 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,087 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:08,087 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4c1df613
2016-05-17 22:31:08,089 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4c1df613
2016-05-17 22:31:08,089 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:08,089 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:08,091 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:08,092 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,092 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"], id: 1A2C6632A98F45D6B330088DBD62B647
2016-05-17 22:31:08,092 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-05-17 22:31:08,092 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:08,092 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:08,093 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F4A755132C6A4CC7A4CB4D4AD949D557, all 1 inputs ready in: 00:00:00.001
2016-05-17 22:31:08,095 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:08,096 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:08,096 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,096 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524267802_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:08,098 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,098 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F4A755132C6A4CC7A4CB4D4AD949D557, mem on close (mb), free: 208, total: 397, max: 672
2016-05-17 22:31:08 Completed running task attempt: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,099 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:08,100 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0, startTime=1463524268045, finishTime=1463524268100, timeTaken=55, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268093, Process_Duration=5, Process_End_Time=1463524268098, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:08,101 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267802_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:08,101 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,102 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:TASK_FINISHED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, taskId=task_1463524267802_0001_1_00_000000, startTime=1463524268045, finishTime=1463524268101, timeTaken=56, status=SUCCEEDED, successfulAttemptID=attempt_1463524267802_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268093, Process_Duration=5, Process_End_Time=1463524268098, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:08,102 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267802_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:08,102 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] : 1
2016-05-17 22:31:08,102 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,103 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:08,104 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:08,103 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:08,106 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:08,107 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:VERTEX_FINISHED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, vertexId=vertex_1463524267802_0001_1_00, initRequestedTime=1463524268008, initedTime=1463524268027, startRequestedTime=1463524268028, startedTime=1463524268028, finishTime=1463524268102, timeTaken=74, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268093, Process_Duration=5, Process_End_Time=1463524268098, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1463524268045, firstTasksToStart=[ task_1463524267802_0001_1_00_000000 ], lastTaskFinishTime=1463524268100, lastTasksToFinish=[ task_1463524267802_0001_1_00_000000 ], minTaskDuration=55, maxTaskDuration=55, avgTaskDuration=55.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524267802_0001_1_00_000000 ], longestDurationTasks=[ task_1463524267802_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:08,107 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:08,108 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:08,108 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524267802_0001_00_000001, stoppedTime=1463524268108, exitStatus=0
2016-05-17 22:31:08,108 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:08,108 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:08,108 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524268093, Process_Duration=5, Process_End_Time=1463524268098, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-05-17 22:31:08,109 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:08,109 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-05-17 22:31:08,110 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,108 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524267802_0001_1
2016-05-17 22:31:08,111 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524267802_0001_00_000001
2016-05-17 22:31:08,111 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524267802_0001_1
2016-05-17 22:31:08,111 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 1A2C6632A98F45D6B330088DBD62B647 for vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,111 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524267802_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:08,111 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524267802_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:08,111 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524267802_0001_00_000001, Exiting
2016-05-17 22:31:08,112 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524267802_0001_00_000001
2016-05-17 22:31:08,112 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524267802_0001_00_000001
2016-05-17 22:31:08,115 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524267802_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:08,115 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524267802_0001_00_000001 completed successfully
2016-05-17 22:31:08,123 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524267802_0001_1, queueSize=0
2016-05-17 22:31:08,124 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:08,126 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524267802_0001_1, startTime=1463524268007, finishTime=1463524268122, timeTaken=115, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268093, Process_Duration=5, Process_End_Time=1463524268098, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:08,126 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524267802_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:08,126 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267802_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:08,127 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:08,127 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524267802_0001_00_000001
2016-05-17 22:31:08 Completed Dag: dag_1463524267802_0001_1
2016-05-17 22:31:08,129 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524267802_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:08,130 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524267802_0001_1_post
2016-05-17 22:31:08,130 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,131 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:08,137 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1463524267802_0001
2016-05-17 22:31:08,143 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:08,143 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:08,143 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:08,143 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:08,144 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:08,144 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:08,146 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:08,146 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:08,147 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:08,147 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:08,147 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:08,149 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:08,149 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:08,154 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001
2016-05-17 22:31:08,155 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall/_temporary
2016-05-17 22:31:08,156 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] completed in: 00:00.379
2016-05-17 22:31:08,206 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-05-17 22:31:08,242 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:08,243 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:08,302 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-05-17 22:31:08,313 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-05-17 22:31:08,314 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:08,314 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:08,314 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:08,335 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-05-17 22:31:08,336 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-05-17 22:31:08,349 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:08,350 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:08,350 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-05-17 22:31:08,350 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] parallel execution of steps is enabled: false
2016-05-17 22:31:08,351 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executing total steps: 1
2016-05-17 22:31:08,351 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] allocating management threads: 1
2016-05-17 22:31:08,352 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...Text/quoted/normcharfalse
2016-05-17 22:31:08,352 WARN flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:08,371 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:08,376 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:08,376 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:08,376 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:08,387 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001 doesn't exist and is created
2016-05-17 22:31:08,407 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:08,407 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:08,408 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001
2016-05-17 22:31:08,413 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524268376_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:08,431 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:08,433 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:08,435 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:08,436 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:08,436 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001/localmode-log-dir
2016-05-17 22:31:08,437 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001/localmode-log-dir/history.txt.appattempt_1463524268376_0001_000000, maxErrors=10
2016-05-17 22:31:08,437 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:08,438 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524268376_0001_000000, appSubmitTime=1463524268412, launchTime=1463524268412
2016-05-17 22:31:08,443 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:08,445 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:08,447 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:08,447 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:08,449 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:48399
2016-05-17 22:31:08,451 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:08,453 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524268376_0001_000000, startTime=1463524268453
2016-05-17 22:31:08,453 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:08,453 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:08,507 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:08,507 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:08,507 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1463524268376_0001, dagName=[E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse
2016-05-17 22:31:08,532 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse
2016-05-17 22:31:08,534 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524268376_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001/localmode-log-dir/dag_1463524268376_0001_1.dot
2016-05-17 22:31:08,535 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001/localmode-log-dir/dag_1463524268376_0001_1-tez-dag.pb.txt
2016-05-17 22:31:08,555 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524268376_0001_1
2016-05-17 22:31:08,556 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,556 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse
2016-05-17 22:31:08 Running Dag: dag_1463524268376_0001_1
2016-05-17 22:31:08,570 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524268376_0001_1, submitTime=1463524268532
2016-05-17 22:31:08,570 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:08,571 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C66F3EF8DFF246A89081EB90484801BD
2016-05-17 22:31:08,572 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:08,572 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524268376_0001_1, initTime=1463524268570
2016-05-17 22:31:08,572 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:08,573 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524268376_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:08,574 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:DAG_STARTED]: dagID=dag_1463524268376_0001_1, startTime=1463524268574
2016-05-17 22:31:08,575 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:08,575 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524268376_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:08,575 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C66F3EF8DFF246A89081EB90484801BD : {6C04D11160BA40C2A4B9CC3FA0C4A0A9={InputName=6C04D11160BA40C2A4B9CC3FA0C4A0A9}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:08,575 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 6C04D11160BA40C2A4B9CC3FA0C4A0A9, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:08,575 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,575 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,575 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,576 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]. Starting root input initializers: 1
2016-05-17 22:31:08,576 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:08,574 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:08,578 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 6C04D11160BA40C2A4B9CC3FA0C4A0A9 on vertex vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,579 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1463524268376_0001, dagName=[E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse
2016-05-17 22:31:08,582 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:08,583 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 6C04D11160BA40C2A4B9CC3FA0C4A0A9 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:08,583 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:08,584 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:08,588 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-05-17 22:31:08,588 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 6C04D11160BA40C2A4B9CC3FA0C4A0A9 on vertex vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,589 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:08,589 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {6C04D11160BA40C2A4B9CC3FA0C4A0A9=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:08,589 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] parallelism set to 1
2016-05-17 22:31:08,589 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:08,589 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524268376_0001_1_00, eventCount=1
2016-05-17 22:31:08,590 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,590 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6E116267BAF1496E88B36C2908D8FEC2, vertexId=vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:08,590 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6E116267BAF1496E88B36C2908D8FEC2, vertexId=vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,594 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6E116267BAF1496E88B36C2908D8FEC2, vertexName=C66F3EF8DFF246A89081EB90484801BD, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:08,594 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6E116267BAF1496E88B36C2908D8FEC2, vertexId=vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,596 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:08,596 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, vertexId=vertex_1463524268376_0001_1_00, initRequestedTime=1463524268575, initedTime=1463524268596, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:08,596 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] with distanceFromRoot: 0
2016-05-17 22:31:08,596 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:08,596 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C66F3EF8DFF246A89081EB90484801BD
2016-05-17 22:31:08,597 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,597 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:08,597 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524268376_0001_1_00, startRequestedTime=1463524268596, startedTime=1463524268596
2016-05-17 22:31:08,598 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:08,598 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:08,625 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:TASK_STARTED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, taskId=task_1463524268376_0001_1_00_000000, scheduledTime=1463524268598, launchTime=1463524268598
2016-05-17 22:31:08,625 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524268376_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:08,625 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,625 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: C66F3EF8DFF246A89081EB90484801BD, VertexParallelism: 1, TaskAttemptID:attempt_1463524268376_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6C04D11160BA40C2A4B9CC3FA0C4A0A9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6E116267BAF1496E88B36C2908D8FEC2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:08,625 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524268376_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:08,626 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:08,629 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:08,629 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:08,630 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:08,630 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524268376_0001_00_000001
2016-05-17 22:31:08,630 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:08,635 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1463524268376_0001_00_000001
2016-05-17 22:31:08,635 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:08,637 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:08,637 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:08,638 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524268376_0001_00_000001, launchTime=1463524268637
2016-05-17 22:31:08,638 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524268376_0001_00_000001
2016-05-17 22:31:08,639 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524268376_0001_1_00_000000_0] to container: [container_1463524268376_0001_00_000001]
2016-05-17 22:31:08,639 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:08,640 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524268376_0001_00_000001 given task: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,640 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524268376_0001_1_00_000000_0] started. Is using containerId: [container_1463524268376_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:08,640 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524268376_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,640 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:08,640 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0, startTime=1463524268640, containerId=container_1463524268376_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524268376_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:08,641 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524268376_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:08,641 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524268376_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:08 Starting to run new task attempt: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,642 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,642 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,642 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:08,642 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:08,643 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:08,643 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:08,643 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:08,643 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: C66F3EF8DFF246A89081EB90484801BD, VertexParallelism: 1, TaskAttemptID:attempt_1463524268376_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6C04D11160BA40C2A4B9CC3FA0C4A0A9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6E116267BAF1496E88B36C2908D8FEC2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:08,644 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:08,644 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524268376_0001, with dag id: dag_1463524268376_0001_1
2016-05-17 22:31:08,646 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,647 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:08,647 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,648 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524268376_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:08,648 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=6C04D11160BA40C2A4B9CC3FA0C4A0A9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:08,649 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,652 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6E116267BAF1496E88B36C2908D8FEC2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:08,653 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:08,653 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:08,653 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6E116267BAF1496E88B36C2908D8FEC2
2016-05-17 22:31:08,653 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:08,653 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6E116267BAF1496E88B36C2908D8FEC2
2016-05-17 22:31:08,657 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:08,657 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,657 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,660 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:08,661 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,661 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,667 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C66F3EF8DFF246A89081EB90484801BD, ordinal: 0
2016-05-17 22:31:08,667 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:08,668 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6E116267BAF1496E88B36C2908D8FEC2
2016-05-17 22:31:08,668 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C66F3EF8DFF246A89081EB90484801BD, mem on start (mb), free: 358, total: 397, max: 672
2016-05-17 22:31:08,668 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,668 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:08,668 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:08,670 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:08,670 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:08,671 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:08,671 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:08,671 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:08,671 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:08,671 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:08,672 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:08,672 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6E116267BAF1496E88B36C2908D8FEC2, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:08,672 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 6C04D11160BA40C2A4B9CC3FA0C4A0A9, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:08,673 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:08,673 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 6C04D11160BA40C2A4B9CC3FA0C4A0A9 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:08,673 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,673 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:08,674 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,673 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:08,674 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:08,674 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:08,675 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,675 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:08,676 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@27509e09
2016-05-17 22:31:08,677 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@27509e09
2016-05-17 22:31:08,677 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:08,677 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:08,678 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:08,679 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,679 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"], id: 6E116267BAF1496E88B36C2908D8FEC2
2016-05-17 22:31:08,679 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-05-17 22:31:08,679 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:08,679 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:08,680 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C66F3EF8DFF246A89081EB90484801BD, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:08,682 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:08,683 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:08,683 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,683 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524268376_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:08,684 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,685 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C66F3EF8DFF246A89081EB90484801BD, mem on close (mb), free: 356, total: 397, max: 672
2016-05-17 22:31:08 Completed running task attempt: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,685 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:08,687 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0, startTime=1463524268640, finishTime=1463524268687, timeTaken=47, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268680, Process_Duration=4, Process_End_Time=1463524268684, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:08,688 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:08,688 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524268376_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:08,688 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,689 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:08,689 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:TASK_FINISHED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, taskId=task_1463524268376_0001_1_00_000000, startTime=1463524268640, finishTime=1463524268688, timeTaken=48, status=SUCCEEDED, successfulAttemptID=attempt_1463524268376_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268680, Process_Duration=4, Process_End_Time=1463524268684, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:08,689 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524268376_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:08,690 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] : 1
2016-05-17 22:31:08,690 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,690 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524268680, Process_Duration=4, Process_End_Time=1463524268684, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-05-17 22:31:08,690 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:08,691 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-05-17 22:31:08,691 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,692 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524268376_0001_00_000001
2016-05-17 22:31:08,692 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:08,693 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:VERTEX_FINISHED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, vertexId=vertex_1463524268376_0001_1_00, initRequestedTime=1463524268575, initedTime=1463524268596, startRequestedTime=1463524268596, startedTime=1463524268596, finishTime=1463524268690, timeTaken=94, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268680, Process_Duration=4, Process_End_Time=1463524268684, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1463524268640, firstTasksToStart=[ task_1463524268376_0001_1_00_000000 ], lastTaskFinishTime=1463524268687, lastTasksToFinish=[ task_1463524268376_0001_1_00_000000 ], minTaskDuration=47, maxTaskDuration=47, avgTaskDuration=47.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524268376_0001_1_00_000000 ], longestDurationTasks=[ task_1463524268376_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:08,693 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:08,694 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:08,694 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:08,694 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524268376_0001_00_000001, stoppedTime=1463524268694, exitStatus=0
2016-05-17 22:31:08,694 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:08,695 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:08,695 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524268376_0001_1
2016-05-17 22:31:08,695 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524268376_0001_1
2016-05-17 22:31:08,695 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 6E116267BAF1496E88B36C2908D8FEC2 for vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,702 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524268376_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:08,702 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524268376_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:08,702 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524268376_0001_00_000001, Exiting
2016-05-17 22:31:08,703 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524268376_0001_00_000001
2016-05-17 22:31:08,703 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524268376_0001_00_000001
2016-05-17 22:31:08,705 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524268376_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:08,705 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524268376_0001_00_000001 completed successfully
2016-05-17 22:31:08,707 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524268376_0001_1, queueSize=0
2016-05-17 22:31:08,707 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:08,708 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524268376_0001_1, startTime=1463524268574, finishTime=1463524268706, timeTaken=132, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268680, Process_Duration=4, Process_End_Time=1463524268684, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:08,708 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524268376_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:08,708 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524268376_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:08,708 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:08 Completed Dag: dag_1463524268376_0001_1
2016-05-17 22:31:08,709 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524268376_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:08,709 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524268376_0001_00_000001
2016-05-17 22:31:08,709 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524268376_0001_1_post
2016-05-17 22:31:08,709 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,710 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:08,715 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1463524268376_0001
2016-05-17 22:31:08,718 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:08,718 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:08,718 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:08,718 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:08,718 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:08,719 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:08,719 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:08,720 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:08,720 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:08,720 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:08,721 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:08,721 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:08,721 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:08,726 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001
2016-05-17 22:31:08,727 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse/_temporary
2016-05-17 22:31:08,727 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] completed in: 00:00.377
2016-05-17 22:31:08,829 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-05-17 22:31:08,964 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:08,964 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:09,012 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-05-17 22:31:09,017 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-05-17 22:31:09,017 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:09,017 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:09,018 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:09,033 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt
2016-05-17 22:31:09,034 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-05-17 22:31:09,060 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:09,060 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-05-17 22:31:09,061 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] sink: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-05-17 22:31:09,061 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] parallel execution of steps is enabled: false
2016-05-17 22:31:09,061 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executing total steps: 1
2016-05-17 22:31:09,061 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] allocating management threads: 1
2016-05-17 22:31:09,063 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...oercion/testFieldCoercion
2016-05-17 22:31:09,064 WARN flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:09,077 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:09,082 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:09,083 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:09,083 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:09,092 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001 doesn't exist and is created
2016-05-17 22:31:09,110 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:09,110 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:09,110 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001
2016-05-17 22:31:09,115 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524269083_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:09,126 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:09,128 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:09,129 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:09,130 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:09,130 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001/localmode-log-dir
2016-05-17 22:31:09,132 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001/localmode-log-dir/history.txt.appattempt_1463524269083_0001_000000, maxErrors=10
2016-05-17 22:31:09,133 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:09,133 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524269083_0001_000000, appSubmitTime=1463524269114, launchTime=1463524269114
2016-05-17 22:31:09,137 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:09,139 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:09,141 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:09,142 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:09,144 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:55107
2016-05-17 22:31:09,146 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:09,148 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524269083_0001_000000, startTime=1463524269148
2016-05-17 22:31:09,148 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:09,149 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:09,210 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:09,210 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:09,210 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1463524269083_0001, dagName=[AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion
2016-05-17 22:31:09,229 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion
2016-05-17 22:31:09,232 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524269083_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001/localmode-log-dir/dag_1463524269083_0001_1.dot
2016-05-17 22:31:09,234 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001/localmode-log-dir/dag_1463524269083_0001_1-tez-dag.pb.txt
2016-05-17 22:31:09,265 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524269083_0001_1
2016-05-17 22:31:09,266 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,266 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion
2016-05-17 22:31:09 Running Dag: dag_1463524269083_0001_1
2016-05-17 22:31:09,286 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524269083_0001_1, submitTime=1463524269229
2016-05-17 22:31:09,286 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:09,287 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E8D15210398C41389683E008ACE75CED
2016-05-17 22:31:09,287 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:09,289 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:09,289 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524269083_0001_1, initTime=1463524269287
2016-05-17 22:31:09,289 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269083_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:09,291 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:DAG_STARTED]: dagID=dag_1463524269083_0001_1, startTime=1463524269290
2016-05-17 22:31:09,291 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:09,291 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269083_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:09,291 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:09,291 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E8D15210398C41389683E008ACE75CED : {F9C37A9130C3434A8F7AA3BA41E8F6B8={InputName=F9C37A9130C3434A8F7AA3BA41E8F6B8}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:09,292 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: F9C37A9130C3434A8F7AA3BA41E8F6B8, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:09,292 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1463524269083_0001, dagName=[AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion
2016-05-17 22:31:09,292 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,292 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,292 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,293 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]. Starting root input initializers: 1
2016-05-17 22:31:09,295 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:09,300 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: F9C37A9130C3434A8F7AA3BA41E8F6B8 on vertex vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,303 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:09,303 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input F9C37A9130C3434A8F7AA3BA41E8F6B8 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:09,304 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:09,304 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:09,306 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 420
2016-05-17 22:31:09,307 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: F9C37A9130C3434A8F7AA3BA41E8F6B8 on vertex vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,308 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:09,308 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {F9C37A9130C3434A8F7AA3BA41E8F6B8=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:09,308 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] parallelism set to 1
2016-05-17 22:31:09,308 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:09,309 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524269083_0001_1_00, eventCount=1
2016-05-17 22:31:09,310 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,310 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=CF96A65D444A42B7AB3BEB6AB9A115FF, vertexId=vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:09,311 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=CF96A65D444A42B7AB3BEB6AB9A115FF, vertexId=vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,315 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=CF96A65D444A42B7AB3BEB6AB9A115FF, vertexName=E8D15210398C41389683E008ACE75CED, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:09,315 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=CF96A65D444A42B7AB3BEB6AB9A115FF, vertexId=vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,317 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:09,317 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E8D15210398C41389683E008ACE75CED, vertexId=vertex_1463524269083_0001_1_00, initRequestedTime=1463524269291, initedTime=1463524269317, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:09,317 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] with distanceFromRoot: 0
2016-05-17 22:31:09,317 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:09,318 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E8D15210398C41389683E008ACE75CED
2016-05-17 22:31:09,318 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,318 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:09,318 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524269083_0001_1_00, startRequestedTime=1463524269318, startedTime=1463524269318
2016-05-17 22:31:09,318 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:09,319 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:09,319 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:TASK_STARTED]: vertexName=E8D15210398C41389683E008ACE75CED, taskId=task_1463524269083_0001_1_00_000000, scheduledTime=1463524269319, launchTime=1463524269319
2016-05-17 22:31:09,320 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269083_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:09,320 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,320 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: E8D15210398C41389683E008ACE75CED, VertexParallelism: 1, TaskAttemptID:attempt_1463524269083_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F9C37A9130C3434A8F7AA3BA41E8F6B8, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CF96A65D444A42B7AB3BEB6AB9A115FF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:09,321 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269083_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:09,321 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:09,322 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:09,323 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:09,323 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:09,324 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524269083_0001_00_000001
2016-05-17 22:31:09,324 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:09,325 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524269083_0001, with dag id: dag_1463524269083_0001_1
2016-05-17 22:31:09,327 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1463524269083_0001_00_000001
2016-05-17 22:31:09,327 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:09,328 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:09,328 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:09,330 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524269083_0001_00_000001, launchTime=1463524269328
2016-05-17 22:31:09,331 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524269083_0001_00_000001
2016-05-17 22:31:09,331 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524269083_0001_1_00_000000_0] to container: [container_1463524269083_0001_00_000001]
2016-05-17 22:31:09,332 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:09,332 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524269083_0001_00_000001 given task: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,332 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524269083_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,332 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524269083_0001_1_00_000000_0] started. Is using containerId: [container_1463524269083_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:09 Starting to run new task attempt: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,333 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E8D15210398C41389683E008ACE75CED, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0, startTime=1463524269332, containerId=container_1463524269083_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524269083_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:09,333 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,333 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,333 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269083_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:09,334 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269083_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:09,333 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:09,334 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:09,333 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:09,334 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:09,334 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:09,335 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:09,335 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: E8D15210398C41389683E008ACE75CED, VertexParallelism: 1, TaskAttemptID:attempt_1463524269083_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F9C37A9130C3434A8F7AA3BA41E8F6B8, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CF96A65D444A42B7AB3BEB6AB9A115FF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:09,335 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:09,339 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,340 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:09,341 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:09,341 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524269083_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:09,350 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=F9C37A9130C3434A8F7AA3BA41E8F6B8, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:09,351 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=CF96A65D444A42B7AB3BEB6AB9A115FF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:09,351 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:09,351 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:09,352 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,352 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,351 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:09,353 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: CF96A65D444A42B7AB3BEB6AB9A115FF
2016-05-17 22:31:09,353 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:09,354 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: CF96A65D444A42B7AB3BEB6AB9A115FF
2016-05-17 22:31:09,356 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:09,356 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,356 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,360 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:09,374 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:09,374 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: CF96A65D444A42B7AB3BEB6AB9A115FF
2016-05-17 22:31:09,386 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E8D15210398C41389683E008ACE75CED, ordinal: 0
2016-05-17 22:31:09,386 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E8D15210398C41389683E008ACE75CED, mem on start (mb), free: 260, total: 397, max: 672
2016-05-17 22:31:09,386 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:09,387 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:09,387 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:09,387 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:09,388 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:09,389 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:09,389 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:09,389 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:09,390 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:09,390 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:09,391 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:09,391 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, F9C37A9130C3434A8F7AA3BA41E8F6B8, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:09,391 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, CF96A65D444A42B7AB3BEB6AB9A115FF, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:09,392 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:09,392 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: F9C37A9130C3434A8F7AA3BA41E8F6B8 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:09,392 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,393 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:09,393 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,394 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:09,395 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:09,396 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:09,396 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,398 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:09,399 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7911fa29
2016-05-17 22:31:09,399 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-05-17 22:31:09,402 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7911fa29
2016-05-17 22:31:09,402 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:09,402 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:09,409 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"] streamed: true, id: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,409 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"], id: CF96A65D444A42B7AB3BEB6AB9A115FF
2016-05-17 22:31:09,410 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-05-17 22:31:09,514 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-05-17 22:31:09,514 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:09,515 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E8D15210398C41389683E008ACE75CED, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:09,523 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:09,523 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:09,524 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,524 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524269083_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:09,525 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,525 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E8D15210398C41389683E008ACE75CED, mem on close (mb), free: 252, total: 397, max: 672
2016-05-17 22:31:09 Completed running task attempt: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,527 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:09,528 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:09,528 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E8D15210398C41389683E008ACE75CED, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0, startTime=1463524269332, finishTime=1463524269528, timeTaken=196, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1826, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1463524269515, Process_Duration=10, Process_End_Time=1463524269525, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-05-17 22:31:09,529 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269083_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:09,529 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:09,529 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,530 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:09,530 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:TASK_FINISHED]: vertexName=E8D15210398C41389683E008ACE75CED, taskId=task_1463524269083_0001_1_00_000000, startTime=1463524269332, finishTime=1463524269530, timeTaken=198, status=SUCCEEDED, successfulAttemptID=attempt_1463524269083_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1826, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1463524269515, Process_Duration=10, Process_End_Time=1463524269525, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-05-17 22:31:09,531 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269083_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:09,531 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] : 1
2016-05-17 22:31:09,531 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,532 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:09,534 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:VERTEX_FINISHED]: vertexName=E8D15210398C41389683E008ACE75CED, vertexId=vertex_1463524269083_0001_1_00, initRequestedTime=1463524269291, initedTime=1463524269317, startRequestedTime=1463524269318, startedTime=1463524269318, finishTime=1463524269531, timeTaken=213, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1826, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1463524269515, Process_Duration=10, Process_End_Time=1463524269525, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9, vertexStats=firstTaskStartTime=1463524269332, firstTasksToStart=[ task_1463524269083_0001_1_00_000000 ], lastTaskFinishTime=1463524269528, lastTasksToFinish=[ task_1463524269083_0001_1_00_000000 ], minTaskDuration=196, maxTaskDuration=196, avgTaskDuration=196.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524269083_0001_1_00_000000 ], longestDurationTasks=[ task_1463524269083_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:09,534 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:09,535 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1826, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10][cascading.flow.SliceCounters Process_Begin_Time=1463524269515, Process_Duration=10, Process_End_Time=1463524269525, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=9, Tuples_Written=9]]
2016-05-17 22:31:09,535 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:09,536 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:09,537 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524269083_0001_00_000001, stoppedTime=1463524269536, exitStatus=0
2016-05-17 22:31:09,537 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:09,538 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:09,538 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-05-17 22:31:09,538 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,538 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524269083_0001_00_000001
2016-05-17 22:31:09,539 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524269083_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:09,539 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524269083_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:09,538 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524269083_0001_1
2016-05-17 22:31:09,539 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524269083_0001_00_000001, Exiting
2016-05-17 22:31:09,539 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524269083_0001_1
2016-05-17 22:31:09,540 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: CF96A65D444A42B7AB3BEB6AB9A115FF for vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,539 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524269083_0001_00_000001
2016-05-17 22:31:09,540 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524269083_0001_00_000001
2016-05-17 22:31:09,542 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524269083_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:09,543 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524269083_0001_00_000001 completed successfully
2016-05-17 22:31:09,552 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524269083_0001_1, queueSize=0
2016-05-17 22:31:09,552 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:09,553 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524269083_0001_1, startTime=1463524269290, finishTime=1463524269551, timeTaken=261, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1826, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1463524269515, Process_Duration=10, Process_End_Time=1463524269525, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-05-17 22:31:09,554 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524269083_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:09,554 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269083_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:09,554 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:09,554 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524269083_0001_00_000001
2016-05-17 22:31:09 Completed Dag: dag_1463524269083_0001_1
2016-05-17 22:31:09,557 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524269083_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:09,558 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524269083_0001_1_post
2016-05-17 22:31:09,558 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,559 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:09,563 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1463524269083_0001
2016-05-17 22:31:09,566 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:09,566 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:09,566 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:09,566 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:09,566 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:09,567 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:09,567 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:09,567 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:09,568 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:09,568 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:09,568 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:09,569 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:09,569 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:09,575 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001
2016-05-17 22:31:09,575 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion/_temporary
2016-05-17 22:31:09,576 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] completed in: 00:00.515
2016-05-17 22:31:09,616 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-05-17 22:31:09,646 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:09,646 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:09,720 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-05-17 22:31:09,735 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-05-17 22:31:09,735 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:09,736 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:09,736 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:09,752 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt
2016-05-17 22:31:09,757 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: __multisink_placeholder_A0175280100A4661B094E4B3E6586118
2016-05-17 22:31:09,769 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:09,769 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-05-17 22:31:09,769 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] sink: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-05-17 22:31:09,769 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] parallel execution of steps is enabled: false
2016-05-17 22:31:09,769 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executing total steps: 1
2016-05-17 22:31:09,769 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] allocating management threads: 1
2016-05-17 22:31:09,770 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...0100A4661B094E4B3E6586118
2016-05-17 22:31:09,770 WARN flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:09,787 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:09,791 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:09,792 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:09,792 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:09,802 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001 doesn't exist and is created
2016-05-17 22:31:09,819 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:09,819 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:09,820 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001
2016-05-17 22:31:09,823 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524269792_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:09,837 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:09,838 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:09,840 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:09,840 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:09,841 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001/localmode-log-dir
2016-05-17 22:31:09,841 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001/localmode-log-dir/history.txt.appattempt_1463524269792_0001_000000, maxErrors=10
2016-05-17 22:31:09,841 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:09,843 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524269792_0001_000000, appSubmitTime=1463524269823, launchTime=1463524269823
2016-05-17 22:31:09,846 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:09,848 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:09,850 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:09,850 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:09,855 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:46577
2016-05-17 22:31:09,856 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:09,858 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524269792_0001_000000, startTime=1463524269858
2016-05-17 22:31:09,858 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:09,858 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:09,920 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:09,920 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:09,920 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...0100A4661B094E4B3E6586118, applicationId=application_1463524269792_0001, dagName=[DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118
2016-05-17 22:31:09,937 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118
2016-05-17 22:31:09,940 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524269792_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001/localmode-log-dir/dag_1463524269792_0001_1.dot
2016-05-17 22:31:09,941 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001/localmode-log-dir/dag_1463524269792_0001_1-tez-dag.pb.txt
2016-05-17 22:31:09,951 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524269792_0001_1
2016-05-17 22:31:09,951 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,952 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118
2016-05-17 22:31:09 Running Dag: dag_1463524269792_0001_1
2016-05-17 22:31:09,965 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524269792_0001_1, submitTime=1463524269938
2016-05-17 22:31:09,965 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:09,966 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex FDFE6F8A49CE4E0599308FD52544A544
2016-05-17 22:31:09,966 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:09,967 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524269792_0001_1, initTime=1463524269966
2016-05-17 22:31:09,967 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269792_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:09,967 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:09,969 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:DAG_STARTED]: dagID=dag_1463524269792_0001_1, startTime=1463524269969
2016-05-17 22:31:09,969 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:09,969 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269792_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:09,969 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: FDFE6F8A49CE4E0599308FD52544A544 : {8DE3DD03AE0F4CCB920D7E9212EBBA5C={InputName=8DE3DD03AE0F4CCB920D7E9212EBBA5C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:09,969 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8DE3DD03AE0F4CCB920D7E9212EBBA5C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:09,970 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,970 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,970 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,970 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]. Starting root input initializers: 1
2016-05-17 22:31:09,969 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:09,969 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...0100A4661B094E4B3E6586118, applicationId=application_1463524269792_0001, dagName=[DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118
2016-05-17 22:31:09,970 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:09,972 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8DE3DD03AE0F4CCB920D7E9212EBBA5C on vertex vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,973 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:09,974 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8DE3DD03AE0F4CCB920D7E9212EBBA5C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:09,974 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:09,975 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:09,976 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 422
2016-05-17 22:31:09,977 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8DE3DD03AE0F4CCB920D7E9212EBBA5C on vertex vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,977 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:09,977 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8DE3DD03AE0F4CCB920D7E9212EBBA5C=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:09,977 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] parallelism set to 1
2016-05-17 22:31:09,978 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:09,978 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524269792_0001_1_00, eventCount=1
2016-05-17 22:31:09,978 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,979 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=E307C12E3ACA4CB9B084E9510B6FD81D, vertexId=vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:09,980 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=E307C12E3ACA4CB9B084E9510B6FD81D, vertexId=vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,981 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(120)) - Using mapred newApiCommitter.
2016-05-17 22:31:09,982 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=E307C12E3ACA4CB9B084E9510B6FD81D, vertexName=FDFE6F8A49CE4E0599308FD52544A544, outputCommitterClass=org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2016-05-17 22:31:09,982 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=E307C12E3ACA4CB9B084E9510B6FD81D, vertexId=vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,983 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, vertexId=vertex_1463524269792_0001_1_00, initRequestedTime=1463524269969, initedTime=1463524269983, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:09,983 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] with distanceFromRoot: 0
2016-05-17 22:31:09,983 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:09,984 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:09,984 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in FDFE6F8A49CE4E0599308FD52544A544
2016-05-17 22:31:09,984 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,985 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:09,985 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524269792_0001_1_00, startRequestedTime=1463524269984, startedTime=1463524269984
2016-05-17 22:31:09,985 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:09,986 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:09,986 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:TASK_STARTED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, taskId=task_1463524269792_0001_1_00_000000, scheduledTime=1463524269986, launchTime=1463524269986
2016-05-17 22:31:09,986 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269792_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:09,987 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,987 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118, VertexName: FDFE6F8A49CE4E0599308FD52544A544, VertexParallelism: 1, TaskAttemptID:attempt_1463524269792_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8DE3DD03AE0F4CCB920D7E9212EBBA5C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=E307C12E3ACA4CB9B084E9510B6FD81D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:09,987 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269792_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:09,988 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:09,988 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:09,989 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:09,989 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:09,989 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524269792_0001, with dag id: dag_1463524269792_0001_1
2016-05-17 22:31:09,989 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524269792_0001_00_000001
2016-05-17 22:31:09,990 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:09,993 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1463524269792_0001_00_000001
2016-05-17 22:31:09,993 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:09,993 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:09,994 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:09,994 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524269792_0001_00_000001, launchTime=1463524269993
2016-05-17 22:31:09,994 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524269792_0001_00_000001
2016-05-17 22:31:09,997 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524269792_0001_1_00_000000_0] to container: [container_1463524269792_0001_00_000001]
2016-05-17 22:31:09,997 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:09,997 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524269792_0001_00_000001 given task: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:09,997 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524269792_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:09,997 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524269792_0001_1_00_000000_0] started. Is using containerId: [container_1463524269792_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:09,997 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:09 Starting to run new task attempt: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:09,997 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0, startTime=1463524269997, containerId=container_1463524269792_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524269792_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:09,998 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269792_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:09,998 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:09,998 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,998 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269792_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:09,998 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:09,999 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:09,999 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:09,999 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:09,999 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:09,999 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118, VertexName: FDFE6F8A49CE4E0599308FD52544A544, VertexParallelism: 1, TaskAttemptID:attempt_1463524269792_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8DE3DD03AE0F4CCB920D7E9212EBBA5C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=E307C12E3ACA4CB9B084E9510B6FD81D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:09,999 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:10,000 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,000 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:10,000 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,003 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524269792_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:10,003 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,003 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=8DE3DD03AE0F4CCB920D7E9212EBBA5C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:10,006 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:10,006 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:10,007 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,007 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,003 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=E307C12E3ACA4CB9B084E9510B6FD81D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:10,009 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:10,010 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: E307C12E3ACA4CB9B084E9510B6FD81D
2016-05-17 22:31:10,010 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:10,011 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: E307C12E3ACA4CB9B084E9510B6FD81D
2016-05-17 22:31:10,010 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:10,011 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,013 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,013 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FDFE6F8A49CE4E0599308FD52544A544, ordinal: 0
2016-05-17 22:31:10,014 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FDFE6F8A49CE4E0599308FD52544A544, mem on start (mb), free: 173, total: 397, max: 672
2016-05-17 22:31:10,014 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,014 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:10,014 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:10,022 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: true
2016-05-17 22:31:10,022 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: E307C12E3ACA4CB9B084E9510B6FD81D
2016-05-17 22:31:10,022 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:10,022 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:10,023 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:10,023 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:10,023 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:10,023 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:10,023 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:10,023 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:10,024 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 8DE3DD03AE0F4CCB920D7E9212EBBA5C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:10,024 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, E307C12E3ACA4CB9B084E9510B6FD81D, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:10,024 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:10,024 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 8DE3DD03AE0F4CCB920D7E9212EBBA5C being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:10,024 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:10,024 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:10,024 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,024 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:10,025 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,025 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:10,025 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,026 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:10,027 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@59a13986
2016-05-17 22:31:10,028 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@59a13986
2016-05-17 22:31:10,028 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:10,028 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:10,028 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-05-17 22:31:10,029 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"] streamed: true, id: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,029 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]], id: E307C12E3ACA4CB9B084E9510B6FD81D
2016-05-17 22:31:10,030 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-05-17 22:31:10,033 INFO tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"]
2016-05-17 22:31:10,039 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14635242697920_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14635242697920_0001_m_000000_0
2016-05-17 22:31:10,039 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-05-17 22:31:10,048 INFO tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]
2016-05-17 22:31:10,052 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14635242697920_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14635242697920_0001_m_000000_0
2016-05-17 22:31:10,052 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-05-17 22:31:10,058 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-05-17 22:31:10,058 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:10,059 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FDFE6F8A49CE4E0599308FD52544A544, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:10,062 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/part-00000
2016-05-17 22:31:10,062 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14635242697920_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14635242697920_0001_m_000000_0
2016-05-17 22:31:10,067 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14635242697920_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-05-17 22:31:10,067 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/part-00000
2016-05-17 22:31:10,068 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14635242697920_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14635242697920_0001_m_000000_0
2016-05-17 22:31:10,071 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14635242697920_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-05-17 22:31:10,071 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,072 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524269792_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:10,072 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:10,072 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:10,074 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,074 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FDFE6F8A49CE4E0599308FD52544A544, mem on close (mb), free: 166, total: 397, max: 672
2016-05-17 22:31:10 Completed running task attempt: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,075 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:10,076 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1463524270059, Process_Duration=14, Process_End_Time=1463524270073, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=13, Tuples_Written=13]]
2016-05-17 22:31:10,076 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:10,076 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0, startTime=1463524269997, finishTime=1463524270076, timeTaken=79, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1463524270059, Process_Duration=14, Process_End_Time=1463524270073, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-05-17 22:31:10,077 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269792_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:10,077 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,076 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-05-17 22:31:10,078 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,078 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524269792_0001_00_000001
2016-05-17 22:31:10,079 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:10,079 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:10,080 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:TASK_FINISHED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, taskId=task_1463524269792_0001_1_00_000000, startTime=1463524269997, finishTime=1463524270077, timeTaken=80, status=SUCCEEDED, successfulAttemptID=attempt_1463524269792_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1463524270059, Process_Duration=14, Process_End_Time=1463524270073, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-05-17 22:31:10,080 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269792_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:10,080 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] : 1
2016-05-17 22:31:10,080 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:10,082 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:10,082 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:VERTEX_FINISHED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, vertexId=vertex_1463524269792_0001_1_00, initRequestedTime=1463524269969, initedTime=1463524269983, startRequestedTime=1463524269984, startedTime=1463524269984, finishTime=1463524270080, timeTaken=96, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1463524270059, Process_Duration=14, Process_End_Time=1463524270073, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13, vertexStats=firstTaskStartTime=1463524269997, firstTasksToStart=[ task_1463524269792_0001_1_00_000000 ], lastTaskFinishTime=1463524270076, lastTasksToFinish=[ task_1463524269792_0001_1_00_000000 ], minTaskDuration=79, maxTaskDuration=79, avgTaskDuration=79.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524269792_0001_1_00_000000 ], longestDurationTasks=[ task_1463524269792_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:10,082 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:10,082 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:10,083 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:10,083 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524269792_0001_1
2016-05-17 22:31:10,083 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524269792_0001_1
2016-05-17 22:31:10,083 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: E307C12E3ACA4CB9B084E9510B6FD81D for vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:10,091 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524269792_0001_1, queueSize=0
2016-05-17 22:31:10,091 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:10,093 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524269792_0001_1, startTime=1463524269969, finishTime=1463524270090, timeTaken=121, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1463524270059, Process_Duration=14, Process_End_Time=1463524270073, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-05-17 22:31:10,093 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524269792_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:10,093 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269792_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:10,093 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:10,094 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524269792_0001_00_000001, stoppedTime=1463524270093, exitStatus=0
2016-05-17 22:31:10,094 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:10 Completed Dag: dag_1463524269792_0001_1
2016-05-17 22:31:10,095 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524269792_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:10,095 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524269792_0001_1_post
2016-05-17 22:31:10,095 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,096 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:10,096 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1463524269792_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-17 22:31:10,096 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-05-17 22:31:10,101 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...0100A4661B094E4B3E6586118, applicationId=application_1463524269792_0001
2016-05-17 22:31:10,104 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:10,104 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:10,104 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:10,104 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:10,104 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:10,104 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:10,105 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:10,105 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:10,105 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:10,106 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:10,106 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:10,106 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:10,106 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:10,107 INFO task.TezChild (TezChild.java:run(198)) - Interrupted while waiting for new work for container container_1463524269792_0001_00_000001
2016-05-17 22:31:10,107 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524269792_0001_00_000001
2016-05-17 22:31:10,107 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524269792_0001_00_000001
2016-05-17 22:31:10,113 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001
2016-05-17 22:31:10,114 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] completed in: 00:00.344
2016-05-17 22:31:10,246 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-05-17 22:31:10,246 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-05-17 22:31:10,310 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:10,311 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:10,352 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-05-17 22:31:10,362 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-05-17 22:31:10,362 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:10,362 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:10,363 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:10,378 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-05-17 22:31:10,379 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header
2016-05-17 22:31:10,392 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:10,392 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:10,392 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-05-17 22:31:10,393 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] parallel execution of steps is enabled: false
2016-05-17 22:31:10,393 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executing total steps: 1
2016-05-17 22:31:10,394 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] allocating management threads: 1
2016-05-17 22:31:10,395 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...latform/testHeader/header
2016-05-17 22:31:10,395 WARN flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:10,409 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:10,413 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:10,414 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:10,414 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:10,423 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001 doesn't exist and is created
2016-05-17 22:31:10,440 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:10,440 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:10,441 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001
2016-05-17 22:31:10,445 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524270413_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:10,456 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:10,457 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:10,459 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:10,459 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:10,459 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001/localmode-log-dir
2016-05-17 22:31:10,459 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001/localmode-log-dir/history.txt.appattempt_1463524270413_0001_000000, maxErrors=10
2016-05-17 22:31:10,460 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:10,460 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524270413_0001_000000, appSubmitTime=1463524270444, launchTime=1463524270445
2016-05-17 22:31:10,464 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:10,465 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:10,468 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:10,468 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:10,469 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:42678
2016-05-17 22:31:10,471 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:10,473 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524270413_0001_000000, startTime=1463524270473
2016-05-17 22:31:10,473 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:10,474 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:10,541 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:10,541 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:10,541 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1463524270413_0001, dagName=[733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header
2016-05-17 22:31:10,559 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header
2016-05-17 22:31:10,561 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524270413_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001/localmode-log-dir/dag_1463524270413_0001_1.dot
2016-05-17 22:31:10,561 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001/localmode-log-dir/dag_1463524270413_0001_1-tez-dag.pb.txt
2016-05-17 22:31:10,572 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524270413_0001_1
2016-05-17 22:31:10,572 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,572 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header
2016-05-17 22:31:10 Running Dag: dag_1463524270413_0001_1
2016-05-17 22:31:10,585 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:10,586 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524270413_0001_1, submitTime=1463524270559
2016-05-17 22:31:10,586 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F2FFD5752CB346C4B32D0AFB28A083E0
2016-05-17 22:31:10,586 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:10,587 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:10,587 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524270413_0001_1, initTime=1463524270586
2016-05-17 22:31:10,588 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270413_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:10,590 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:DAG_STARTED]: dagID=dag_1463524270413_0001_1, startTime=1463524270590
2016-05-17 22:31:10,590 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:10,590 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:10,590 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270413_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:10,590 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F2FFD5752CB346C4B32D0AFB28A083E0 : {7B84F00CDA334593A8D2F6D1BBF27460={InputName=7B84F00CDA334593A8D2F6D1BBF27460}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:10,591 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 7B84F00CDA334593A8D2F6D1BBF27460, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:10,591 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,591 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,591 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,591 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]. Starting root input initializers: 1
2016-05-17 22:31:10,590 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1463524270413_0001, dagName=[733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header
2016-05-17 22:31:10,594 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:10,594 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 7B84F00CDA334593A8D2F6D1BBF27460 on vertex vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,596 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:10,596 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 7B84F00CDA334593A8D2F6D1BBF27460 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:10,597 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:10,597 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:10,600 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-05-17 22:31:10,600 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 7B84F00CDA334593A8D2F6D1BBF27460 on vertex vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,601 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:10,601 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {7B84F00CDA334593A8D2F6D1BBF27460=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:10,601 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] parallelism set to 1
2016-05-17 22:31:10,601 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:10,602 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524270413_0001_1_00, eventCount=1
2016-05-17 22:31:10,602 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,602 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=77A21CDB162C4379956547CC1384E7AB, vertexId=vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:10,602 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=77A21CDB162C4379956547CC1384E7AB, vertexId=vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,604 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=77A21CDB162C4379956547CC1384E7AB, vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:10,604 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=77A21CDB162C4379956547CC1384E7AB, vertexId=vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,606 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, vertexId=vertex_1463524270413_0001_1_00, initRequestedTime=1463524270590, initedTime=1463524270606, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:10,606 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:10,606 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] with distanceFromRoot: 0
2016-05-17 22:31:10,606 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:10,606 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F2FFD5752CB346C4B32D0AFB28A083E0
2016-05-17 22:31:10,607 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,607 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:10,607 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524270413_0001_1_00, startRequestedTime=1463524270606, startedTime=1463524270606
2016-05-17 22:31:10,607 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:10,608 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:10,608 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:TASK_STARTED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, taskId=task_1463524270413_0001_1_00_000000, scheduledTime=1463524270608, launchTime=1463524270608
2016-05-17 22:31:10,608 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270413_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:10,608 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,609 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header, VertexName: F2FFD5752CB346C4B32D0AFB28A083E0, VertexParallelism: 1, TaskAttemptID:attempt_1463524270413_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=7B84F00CDA334593A8D2F6D1BBF27460, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=77A21CDB162C4379956547CC1384E7AB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:10,609 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270413_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:10,609 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:10,610 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:10,611 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:10,612 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:10,612 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524270413_0001_00_000001
2016-05-17 22:31:10,612 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:10,614 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524270413_0001, with dag id: dag_1463524270413_0001_1
2016-05-17 22:31:10,614 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1463524270413_0001_00_000001
2016-05-17 22:31:10,615 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:10,617 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:10,618 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524270413_0001_00_000001, launchTime=1463524270617
2016-05-17 22:31:10,618 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:10,620 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524270413_0001_00_000001
2016-05-17 22:31:10,621 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524270413_0001_1_00_000000_0] to container: [container_1463524270413_0001_00_000001]
2016-05-17 22:31:10,621 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:10,621 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524270413_0001_00_000001 given task: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,622 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524270413_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,622 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524270413_0001_1_00_000000_0] started. Is using containerId: [container_1463524270413_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:10,626 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:10 Starting to run new task attempt: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,626 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,627 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,626 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0, startTime=1463524270622, containerId=container_1463524270413_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524270413_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:10,628 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270413_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:10,628 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270413_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:10,628 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:10,630 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:10,630 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:10,630 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:10,630 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:10,630 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header, VertexName: F2FFD5752CB346C4B32D0AFB28A083E0, VertexParallelism: 1, TaskAttemptID:attempt_1463524270413_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=7B84F00CDA334593A8D2F6D1BBF27460, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=77A21CDB162C4379956547CC1384E7AB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:10,630 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:10,631 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,631 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:10,631 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,632 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=7B84F00CDA334593A8D2F6D1BBF27460, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:10,632 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=77A21CDB162C4379956547CC1384E7AB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:10,632 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,635 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:10,635 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524270413_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:10,635 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,634 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:10,636 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,637 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 77A21CDB162C4379956547CC1384E7AB
2016-05-17 22:31:10,637 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:10,637 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 77A21CDB162C4379956547CC1384E7AB
2016-05-17 22:31:10,640 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:10,641 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:10,641 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,641 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,649 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F2FFD5752CB346C4B32D0AFB28A083E0, ordinal: 0
2016-05-17 22:31:10,649 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F2FFD5752CB346C4B32D0AFB28A083E0, mem on start (mb), free: 262, total: 362, max: 672
2016-05-17 22:31:10,650 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,650 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:10,650 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:10,652 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:10,652 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 77A21CDB162C4379956547CC1384E7AB
2016-05-17 22:31:10,652 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:10,653 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:10,653 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:10,653 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:10,653 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:10,653 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:10,654 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:10,654 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:10,654 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 7B84F00CDA334593A8D2F6D1BBF27460, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:10,654 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 77A21CDB162C4379956547CC1384E7AB, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:10,654 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:10,654 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 7B84F00CDA334593A8D2F6D1BBF27460 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:10,654 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:10,655 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:10,655 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,655 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:10,655 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,655 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:10,656 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,656 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:10,657 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1c962a81
2016-05-17 22:31:10,658 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1c962a81
2016-05-17 22:31:10,658 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:10,658 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:10,660 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:10,661 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,661 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"], id: 77A21CDB162C4379956547CC1384E7AB
2016-05-17 22:31:10,661 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-05-17 22:31:10,661 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:10,662 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:10,662 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F2FFD5752CB346C4B32D0AFB28A083E0, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:10,666 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:10,666 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:10,666 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,667 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524270413_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:10,667 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,668 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F2FFD5752CB346C4B32D0AFB28A083E0, mem on close (mb), free: 260, total: 362, max: 672
2016-05-17 22:31:10 Completed running task attempt: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,669 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:10,669 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524270663, Process_Duration=4, Process_End_Time=1463524270667, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-05-17 22:31:10,670 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:10,670 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-05-17 22:31:10,670 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,670 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524270413_0001_00_000001
2016-05-17 22:31:10,670 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0, startTime=1463524270622, finishTime=1463524270669, timeTaken=47, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524270663, Process_Duration=4, Process_End_Time=1463524270667, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:10,670 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270413_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:10,671 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:10,671 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,673 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:TASK_FINISHED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, taskId=task_1463524270413_0001_1_00_000000, startTime=1463524270622, finishTime=1463524270671, timeTaken=49, status=SUCCEEDED, successfulAttemptID=attempt_1463524270413_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524270663, Process_Duration=4, Process_End_Time=1463524270667, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:10,673 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:10,673 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270413_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:10,674 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] : 1
2016-05-17 22:31:10,674 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,676 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:10,676 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:VERTEX_FINISHED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, vertexId=vertex_1463524270413_0001_1_00, initRequestedTime=1463524270590, initedTime=1463524270606, startRequestedTime=1463524270606, startedTime=1463524270606, finishTime=1463524270674, timeTaken=68, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524270663, Process_Duration=4, Process_End_Time=1463524270667, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1463524270622, firstTasksToStart=[ task_1463524270413_0001_1_00_000000 ], lastTaskFinishTime=1463524270669, lastTasksToFinish=[ task_1463524270413_0001_1_00_000000 ], minTaskDuration=47, maxTaskDuration=47, avgTaskDuration=47.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524270413_0001_1_00_000000 ], longestDurationTasks=[ task_1463524270413_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:10,676 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:10,677 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:10,678 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524270413_0001_00_000001, stoppedTime=1463524270678, exitStatus=0
2016-05-17 22:31:10,678 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:10,678 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:10,679 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:10,679 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524270413_0001_1
2016-05-17 22:31:10,679 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524270413_0001_1
2016-05-17 22:31:10,679 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 77A21CDB162C4379956547CC1384E7AB for vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,680 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524270413_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:10,681 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524270413_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:10,681 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524270413_0001_00_000001, Exiting
2016-05-17 22:31:10,681 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524270413_0001_00_000001
2016-05-17 22:31:10,681 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524270413_0001_00_000001
2016-05-17 22:31:10,684 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524270413_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:10,685 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524270413_0001_00_000001 completed successfully
2016-05-17 22:31:10,691 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524270413_0001_1, queueSize=0
2016-05-17 22:31:10,692 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:10,692 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524270413_0001_1, startTime=1463524270590, finishTime=1463524270690, timeTaken=100, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524270663, Process_Duration=4, Process_End_Time=1463524270667, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:10,692 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524270413_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:10,693 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270413_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:10,693 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524270413_0001_00_000001
2016-05-17 22:31:10,693 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:10 Completed Dag: dag_1463524270413_0001_1
2016-05-17 22:31:10,694 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524270413_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:10,694 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524270413_0001_1_post
2016-05-17 22:31:10,694 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,694 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:10,700 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1463524270413_0001
2016-05-17 22:31:10,702 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:10,703 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:10,703 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:10,703 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:10,703 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:10,703 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:10,704 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:10,704 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:10,705 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:10,705 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:10,705 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:10,705 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:10,706 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:10,710 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001
2016-05-17 22:31:10,710 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header/_temporary
2016-05-17 22:31:10,711 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] completed in: 00:00.318
2016-05-17 22:31:10,747 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeader/header
2016-05-17 22:31:10,774 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:10,774 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:10,820 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-05-17 22:31:10,828 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-05-17 22:31:10,829 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:10,829 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:10,829 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:10,846 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt
2016-05-17 22:31:10,847 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic
2016-05-17 22:31:10,857 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:10,857 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-05-17 22:31:10,857 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-05-17 22:31:10,857 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] parallel execution of steps is enabled: false
2016-05-17 22:31:10,857 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executing total steps: 1
2016-05-17 22:31:10,858 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] allocating management threads: 1
2016-05-17 22:31:10,859 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...t/strict-nondeterministic
2016-05-17 22:31:10,859 WARN flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:10,872 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:10,876 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:10,877 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:10,878 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:10,888 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001 doesn't exist and is created
2016-05-17 22:31:10,904 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:10,905 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:10,905 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001
2016-05-17 22:31:10,909 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524270877_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:10,921 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:10,922 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:10,923 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:10,924 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:10,924 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001/localmode-log-dir
2016-05-17 22:31:10,925 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001/localmode-log-dir/history.txt.appattempt_1463524270877_0001_000000, maxErrors=10
2016-05-17 22:31:10,925 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:10,925 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524270877_0001_000000, appSubmitTime=1463524270908, launchTime=1463524270908
2016-05-17 22:31:10,932 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:10,933 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:10,935 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:56117
2016-05-17 22:31:10,940 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:10,940 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:10,942 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:10,944 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524270877_0001_000000, startTime=1463524270944
2016-05-17 22:31:10,944 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:10,944 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:11,005 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:11,005 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:11,005 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1463524270877_0001, dagName=[95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic
2016-05-17 22:31:11,022 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic
2016-05-17 22:31:11,024 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524270877_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001/localmode-log-dir/dag_1463524270877_0001_1.dot
2016-05-17 22:31:11,024 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001/localmode-log-dir/dag_1463524270877_0001_1-tez-dag.pb.txt
2016-05-17 22:31:11,030 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524270877_0001_1
2016-05-17 22:31:11,030 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:11,030 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic
2016-05-17 22:31:11 Running Dag: dag_1463524270877_0001_1
2016-05-17 22:31:11,042 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:11,043 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524270877_0001_1, submitTime=1463524271022
2016-05-17 22:31:11,044 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C0B1175D479444CABBDF066CF79D44D3
2016-05-17 22:31:11,044 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:11,044 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:11,045 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524270877_0001_1, initTime=1463524271043
2016-05-17 22:31:11,045 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270877_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:11,045 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:DAG_STARTED]: dagID=dag_1463524270877_0001_1, startTime=1463524271045
2016-05-17 22:31:11,046 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:11,045 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:11,046 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270877_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:11,046 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C0B1175D479444CABBDF066CF79D44D3 : {D65CF4CE93DB4F30BA47B12306638B00={InputName=D65CF4CE93DB4F30BA47B12306638B00}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:11,046 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: D65CF4CE93DB4F30BA47B12306638B00, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:11,046 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,047 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,047 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,047 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1463524270877_0001, dagName=[95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic
2016-05-17 22:31:11,047 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]. Starting root input initializers: 1
2016-05-17 22:31:11,048 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:11,048 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: D65CF4CE93DB4F30BA47B12306638B00 on vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,050 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:11,050 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input D65CF4CE93DB4F30BA47B12306638B00 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:11,051 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:11,051 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:11,053 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 432
2016-05-17 22:31:11,053 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: D65CF4CE93DB4F30BA47B12306638B00 on vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,054 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:11,054 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {D65CF4CE93DB4F30BA47B12306638B00=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:11,054 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] parallelism set to 1
2016-05-17 22:31:11,054 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:11,055 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524270877_0001_1_00, eventCount=1
2016-05-17 22:31:11,055 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,055 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=153E95D185734F2EB3CE26B25D70E426, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:11,055 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=153E95D185734F2EB3CE26B25D70E426, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,057 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=153E95D185734F2EB3CE26B25D70E426, vertexName=C0B1175D479444CABBDF066CF79D44D3, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:11,057 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=153E95D185734F2EB3CE26B25D70E426, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,059 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:11,059 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, vertexId=vertex_1463524270877_0001_1_00, initRequestedTime=1463524271046, initedTime=1463524271059, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:11,059 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] with distanceFromRoot: 0
2016-05-17 22:31:11,059 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:11,060 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C0B1175D479444CABBDF066CF79D44D3
2016-05-17 22:31:11,060 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,060 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524270877_0001_1_00, startRequestedTime=1463524271060, startedTime=1463524271060
2016-05-17 22:31:11,060 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:11,060 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:11,061 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:11,061 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:TASK_STARTED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, taskId=task_1463524270877_0001_1_00_000000, scheduledTime=1463524271061, launchTime=1463524271061
2016-05-17 22:31:11,061 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270877_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:11,061 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,061 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic, VertexName: C0B1175D479444CABBDF066CF79D44D3, VertexParallelism: 1, TaskAttemptID:attempt_1463524270877_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D65CF4CE93DB4F30BA47B12306638B00, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=153E95D185734F2EB3CE26B25D70E426, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:11,062 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270877_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:11,062 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:11,063 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:11,065 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:11,065 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:11,066 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524270877_0001_00_000001
2016-05-17 22:31:11,066 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270877_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:11,066 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524270877_0001, with dag id: dag_1463524270877_0001_1
2016-05-17 22:31:11,069 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1463524270877_0001_00_000001
2016-05-17 22:31:11,069 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:11,071 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:11,072 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270877_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:11,072 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524270877_0001_00_000001, launchTime=1463524271071
2016-05-17 22:31:11,074 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524270877_0001_00_000001
2016-05-17 22:31:11,076 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524270877_0001_1_00_000000_0] to container: [container_1463524270877_0001_00_000001]
2016-05-17 22:31:11,076 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270877_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:11,076 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524270877_0001_00_000001 given task: attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,076 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524270877_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,076 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524270877_0001_1_00_000000_0] started. Is using containerId: [container_1463524270877_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:11 Starting to run new task attempt: attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,077 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,077 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:11,077 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:11,077 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:11,078 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:11,078 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:11,078 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:11,078 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic, VertexName: C0B1175D479444CABBDF066CF79D44D3, VertexParallelism: 1, TaskAttemptID:attempt_1463524270877_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D65CF4CE93DB4F30BA47B12306638B00, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=153E95D185734F2EB3CE26B25D70E426, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:11,078 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:11,078 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:11,078 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, taskAttemptId=attempt_1463524270877_0001_1_00_000000_0, startTime=1463524271076, containerId=container_1463524270877_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524270877_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:11,079 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270877_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:11,079 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,079 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:11,079 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:11,079 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270877_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:11,081 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:11,081 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=D65CF4CE93DB4F30BA47B12306638B00, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:11,081 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:11,082 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,082 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,081 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=153E95D185734F2EB3CE26B25D70E426, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:11,084 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:11,084 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 153E95D185734F2EB3CE26B25D70E426
2016-05-17 22:31:11,086 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:11,083 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-05-17 22:31:11,086 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 153E95D185734F2EB3CE26B25D70E426
2016-05-17 22:31:11,086 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:11,087 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,087 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,085 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524270877_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:11,084 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:11,086 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-05-17 22:31:11,094 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C0B1175D479444CABBDF066CF79D44D3, ordinal: 0
2016-05-17 22:31:11,094 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C0B1175D479444CABBDF066CF79D44D3, mem on start (mb), free: 192, total: 362, max: 672
2016-05-17 22:31:11,094 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:11,095 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:11,095 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:11,097 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:11,097 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 153E95D185734F2EB3CE26B25D70E426
2016-05-17 22:31:11,097 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:11,098 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:11,098 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:11,098 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:11,099 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:11,099 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:11,099 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:11,099 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:11,100 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, D65CF4CE93DB4F30BA47B12306638B00, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:11,100 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 153E95D185734F2EB3CE26B25D70E426, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:11,100 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:11,101 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,101 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:11,101 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,101 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: D65CF4CE93DB4F30BA47B12306638B00 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:11,102 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:11,102 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:11,102 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:11,103 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,103 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:11,103 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1642337a
2016-05-17 22:31:11,104 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1642337a
2016-05-17 22:31:11,105 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:11,105 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:11,107 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-05-17 22:31:11,107 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"] streamed: true, id: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,107 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"], id: 153E95D185734F2EB3CE26B25D70E426
2016-05-17 22:31:11,108 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-05-17 22:31:11,108 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-05-17 22:31:11,108 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:11,109 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C0B1175D479444CABBDF066CF79D44D3, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:11,112 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
2016-05-17 22:31:11,118 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
2016-05-17 22:31:11,122 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:11,123 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:11,123 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,124 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524270877_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:11,125 INFO task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1463524270877_0001_1_00_000000_0
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
2016-05-17 22:31:11,134 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=655, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6][cascading.flow.SliceCounters Process_Begin_Time=1463524271109, Process_Duration=16, Process_End_Time=1463524271125, Read_Duration=1, Tuples_Read=6, Tuples_Written=6, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=6, Tuples_Written=6]]
2016-05-17 22:31:11,134 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C0B1175D479444CABBDF066CF79D44D3, mem on close (mb), free: 190, total: 362, max: 672
2016-05-17 22:31:11,134 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=C0B1175D479444CABBDF066CF79D44D3, index=0
2016-05-17 22:31:11,135 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=C0B1175D479444CABBDF066CF79D44D3, sourceVertex=D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,135 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=C0B1175D479444CABBDF066CF79D44D3, sourceVertex=153E95D185734F2EB3CE26B25D70E426
2016-05-17 22:31:11,136 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524270877_0001_00_000001
2016-05-17 22:31:11,136 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524270877_0001_00_000001
2016-05-17 22:31:11,136 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:11,138 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, taskAttemptId=attempt_1463524270877_0001_1_00_000000_0, startTime=1463524271076, finishTime=1463524271134, timeTaken=58, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=655, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6, cascading.flow.SliceCounters, Process_Begin_Time=1463524271109, Process_Duration=16, Process_End_Time=1463524271125, Read_Duration=1, Tuples_Read=6, Tuples_Written=6, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=6, Tuples_Written=6
2016-05-17 22:31:11,140 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270877_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-05-17 22:31:11,140 INFO impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1463524270877_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-05-17 22:31:11,141 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:TASK_FINISHED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, taskId=task_1463524270877_0001_1_00_000000, startTime=1463524271076, finishTime=1463524271140, timeTaken=64, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
], counters=Counters: 0
2016-05-17 22:31:11,141 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270877_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-05-17 22:31:11,141 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:11,141 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] : 1
2016-05-17 22:31:11,142 INFO impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] because task failed: task_1463524270877_0001_1_00_000000
2016-05-17 22:31:11,142 INFO impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] due to trigger: OWN_TASK_FAILURE
2016-05-17 22:31:11,143 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-05-17 22:31:11,143 INFO impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,144 INFO impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=153E95D185734F2EB3CE26B25D70E426, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,143 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:11,149 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:VERTEX_FINISHED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, vertexId=vertex_1463524270877_0001_1_00, initRequestedTime=1463524271046, initedTime=1463524271059, startRequestedTime=1463524271060, startedTime=1463524271060, finishTime=1463524271148, timeTaken=88, status=FAILED, diagnostics=Task failed, taskId=task_1463524270877_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1463524271076, firstTasksToStart=[ task_1463524270877_0001_1_00_000000 ], lastTaskFinishTime=1463524271134, lastTasksToFinish=[ task_1463524270877_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[ ], longestDurationTasks=[ ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-05-17 22:31:11,150 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:11,150 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524270877_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-05-17 22:31:11,154 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1463524270877_0001_00_000001 completed but with errors
2016-05-17 22:31:11,153 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-05-17 22:31:11,157 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:11,157 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524270877_0001_00_000001, stoppedTime=1463524271157, exitStatus=0
2016-05-17 22:31:11,157 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270877_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:11,157 INFO node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1463524270877_0001_1_00_000000_0 failed: true container: container_1463524270877_0001_00_000001 numFailedTAs: 0
2016-05-17 22:31:11,158 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-05-17 22:31:11,158 INFO impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-05-17 22:31:11,159 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524270877_0001_1
2016-05-17 22:31:11,159 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 153E95D185734F2EB3CE26B25D70E426 for vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,160 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524270877_0001_1, queueSize=0
2016-05-17 22:31:11,160 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:11,160 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524270877_0001_1, startTime=1463524271045, finishTime=1463524271159, timeTaken=114, status=FAILED, diagnostics=Vertex failed, vertexName=C0B1175D479444CABBDF066CF79D44D3, vertexId=vertex_1463524270877_0001_1_00, diagnostics=[Task failed, taskId=task_1463524270877_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-05-17 22:31:11,161 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524270877_0001_1 finished with state: FAILED
2016-05-17 22:31:11,161 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270877_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:11,161 INFO container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1463524270877_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-05-17 22:31:11,161 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270877_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:11,162 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524270877_0001_00_000001
2016-05-17 22:31:11 Completed Dag: dag_1463524270877_0001_1
2016-05-17 22:31:11,162 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524270877_0001_1, dagState=FAILED
2016-05-17 22:31:11,162 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524270877_0001_1_post
2016-05-17 22:31:11,162 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:11,162 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:11,163 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270877_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-05-17 22:31:11,172 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1463524270877_0001
2016-05-17 22:31:11,174 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:11,175 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:11,175 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:11,175 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:11,175 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:11,176 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:11,176 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:11,176 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:11,177 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:11,177 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:11,177 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:11,177 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:11,178 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:11,183 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001
2016-05-17 22:31:11,183 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] stopping all jobs
2016-05-17 22:31:11,183 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] stopping: (1/1) ...t/strict-nondeterministic
2016-05-17 22:31:11,184 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] stopped all jobs
2016-05-17 22:31:11,185 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic/_temporary
2016-05-17 22:31:11,185 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] completed in: 00:00.327
2016-05-17 22:31:11,185 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic