Class cascading.scheme.TextDelimitedPlatformTest

9

tests

0

failures

0

ignored

8.542s

duration

100%

successful

Tests

Test Duration Result
testFieldCoercion 0.788s passed
testHeader 0.502s passed
testHeaderAll 0.556s passed
testHeaderFieldsAll 0.628s passed
testQuotedText 0.623s passed
testQuotedTextAll 0.739s passed
testQuotedTextSpecChar 3.595s passed
testQuotedTextSpecCharAll 0.673s passed
testStrict 0.438s passed

Standard output

2016-05-17 22:31:02,595 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-17 22:31:02,617 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.scheme.TextDelimitedPlatformTest, with platform: hadoop2-tez
2016-05-17 22:31:02,643 INFO  tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-05-17 22:31:02,975 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-05-17 22:31:03,278 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides: 
2016-05-17 22:31:03,452 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:03,453 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:03,540 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 5EABBBA9D0C84A2AB153306C7CD4AA8D
2016-05-17 22:31:03,734 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.065
2016-05-17 22:31:03,745 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.076
2016-05-17 22:31:03,746 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:03,746 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:03,747 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:03,892 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-05-17 22:31:03,895 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-05-17 22:31:04,103 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-17 22:31:04,106 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:04,106 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:04,107 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-05-17 22:31:04,107 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  parallel execution of steps is enabled: false
2016-05-17 22:31:04,107 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  executing total steps: 1
2016-05-17 22:31:04,108 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  allocating management threads: 1
2016-05-17 22:31:04,109 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...Char/quoted/speccharfalse
2016-05-17 22:31:04,109 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:04,130 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:04,305 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:04,312 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:04,313 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:04,366 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001 doesn't exist and is created
2016-05-17 22:31:04,445 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:04,446 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:04,447 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001
2016-05-17 22:31:04,480 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524264312_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:04,522 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:04,538 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:04,546 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-05-17 22:31:04,547 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-05-17 22:31:04,547 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:04,564 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:04,569 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:04,573 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001/localmode-log-dir
2016-05-17 22:31:04,574 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001/localmode-log-dir/history.txt.appattempt_1463524264312_0001_000000, maxErrors=10
2016-05-17 22:31:04,574 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:04,576 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524264312_0001_000000, appSubmitTime=1463524264466, launchTime=1463524264479
2016-05-17 22:31:04,583 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:04,584 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:04,586 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:04,586 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:04,640 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:36445
2016-05-17 22:31:04,647 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-05-17 22:31:04,647 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-05-17 22:31:04,647 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:04,682 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:04,747 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:04,748 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-05-17 22:31:04,748 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-05-17 22:31:04,748 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:04,748 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524264312_0001_000000, startTime=1463524264747
2016-05-17 22:31:04,749 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:04,848 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:04,864 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:04,864 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1463524264312_0001, dagName=[B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse
2016-05-17 22:31:05,082 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse
2016-05-17 22:31:05,188 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524264312_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001/localmode-log-dir/dag_1463524264312_0001_1.dot
2016-05-17 22:31:05,191 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001/localmode-log-dir/dag_1463524264312_0001_1-tez-dag.pb.txt
2016-05-17 22:31:05,351 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524264312_0001_1
2016-05-17 22:31:05,351 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:05,352 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse
2016-05-17 22:31:05 Running Dag: dag_1463524264312_0001_1
2016-05-17 22:31:05,388 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:05,388 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524264312_0001_1, submitTime=1463524265083
2016-05-17 22:31:05,434 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E0EABA0A017146E5A99B747B36938AD8
2016-05-17 22:31:05,436 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:05,440 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524264312_0001_1, initTime=1463524265391
2016-05-17 22:31:05,440 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524264312_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:05,440 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:05,443 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:05,443 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:DAG_STARTED]: dagID=dag_1463524264312_0001_1, startTime=1463524265442
2016-05-17 22:31:05,444 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:05,446 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524264312_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:05,446 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E0EABA0A017146E5A99B747B36938AD8 : {6722142E3EF24B54838D556B108A2088={InputName=6722142E3EF24B54838D556B108A2088}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:05,446 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 6722142E3EF24B54838D556B108A2088, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:05,447 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,453 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,454 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,455 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1463524264312_0001, dagName=[B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse
2016-05-17 22:31:05,456 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]. Starting root input initializers: 1
2016-05-17 22:31:05,470 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 6722142E3EF24B54838D556B108A2088 on vertex vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,474 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:05,497 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:05,499 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 6722142E3EF24B54838D556B108A2088 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:05,500 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:05,501 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:05,501 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524264312_0001, with dag id: dag_1463524264312_0001_1
2016-05-17 22:31:05,551 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-05-17 22:31:05,554 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 6722142E3EF24B54838D556B108A2088 on vertex vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,555 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:05,556 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {6722142E3EF24B54838D556B108A2088=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:05,571 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] parallelism set to 1
2016-05-17 22:31:05,571 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:05,580 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524264312_0001_1_00, eventCount=1
2016-05-17 22:31:05,582 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,582 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=FD9CED7391CE415191F89182E8B687CE, vertexId=vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:05,585 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=FD9CED7391CE415191F89182E8B687CE, vertexId=vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,605 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=FD9CED7391CE415191F89182E8B687CE, vertexName=E0EABA0A017146E5A99B747B36938AD8, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:05,616 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=FD9CED7391CE415191F89182E8B687CE, vertexId=vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,621 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:05,621 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, vertexId=vertex_1463524264312_0001_1_00, initRequestedTime=1463524265446, initedTime=1463524265620, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:05,622 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] with distanceFromRoot: 0
2016-05-17 22:31:05,622 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:05,624 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E0EABA0A017146E5A99B747B36938AD8
2016-05-17 22:31:05,624 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,626 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:05,626 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524264312_0001_1_00, startRequestedTime=1463524265623, startedTime=1463524265623
2016-05-17 22:31:05,627 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:05,658 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:05,658 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:TASK_STARTED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, taskId=task_1463524264312_0001_1_00_000000, scheduledTime=1463524265657, launchTime=1463524265657
2016-05-17 22:31:05,659 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524264312_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:05,661 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:05,664 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: E0EABA0A017146E5A99B747B36938AD8, VertexParallelism: 1, TaskAttemptID:attempt_1463524264312_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6722142E3EF24B54838D556B108A2088, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=FD9CED7391CE415191F89182E8B687CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:05,667 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524264312_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:05,668 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:05,709 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:05,713 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:05,714 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:05,719 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524264312_0001_00_000001
2016-05-17 22:31:05,720 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:05,731 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463524264312_0001_00_000001
2016-05-17 22:31:05,732 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:05,736 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:05,738 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:05,738 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524264312_0001_00_000001, launchTime=1463524265738
2016-05-17 22:31:05,741 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524264312_0001_00_000001
2016-05-17 22:31:05,745 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524264312_0001_1_00_000000_0] to container: [container_1463524264312_0001_00_000001]
2016-05-17 22:31:05,745 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:05,746 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524264312_0001_00_000001 given task: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,746 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524264312_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05 Starting to run new task attempt: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,748 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,748 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:05,749 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524264312_0001_1_00_000000_0] started. Is using containerId: [container_1463524264312_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:05,750 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:05,751 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:05,752 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:05,753 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:05,754 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0, startTime=1463524265746, containerId=container_1463524264312_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524264312_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:05,756 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524264312_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:05,756 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:05,756 INFO  counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters:  GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-05-17 22:31:05,760 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524264312_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:05,782 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:05,782 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: E0EABA0A017146E5A99B747B36938AD8, VertexParallelism: 1, TaskAttemptID:attempt_1463524264312_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6722142E3EF24B54838D556B108A2088, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=FD9CED7391CE415191F89182E8B687CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:05,785 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:05,790 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,790 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:05,791 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:05,794 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524264312_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:05,797 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=6722142E3EF24B54838D556B108A2088, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:05,798 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:05,799 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=FD9CED7391CE415191F89182E8B687CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:05,800 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:05,800 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,801 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:05,801 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: FD9CED7391CE415191F89182E8B687CE
2016-05-17 22:31:05,801 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:05,804 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,804 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: FD9CED7391CE415191F89182E8B687CE
2016-05-17 22:31:05,830 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:05,831 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,832 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,838 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:05,855 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E0EABA0A017146E5A99B747B36938AD8, ordinal: 0
2016-05-17 22:31:05,857 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E0EABA0A017146E5A99B747B36938AD8, mem on start (mb), free: 159, total: 281, max: 672
2016-05-17 22:31:05,857 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:05,857 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:05,858 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:05,858 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:05,858 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: FD9CED7391CE415191F89182E8B687CE
2016-05-17 22:31:05,858 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:05,859 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:05,870 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:05,871 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:05,872 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:05,872 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:05,872 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:05,872 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:05,872 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 6722142E3EF24B54838D556B108A2088, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:05,873 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, FD9CED7391CE415191F89182E8B687CE, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:05,874 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:05,875 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 6722142E3EF24B54838D556B108A2088 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:05,875 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,876 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:05,876 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,876 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:05,877 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:05,878 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:05,879 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,882 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:05,893 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2ad5934b
2016-05-17 22:31:05,940 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2ad5934b
2016-05-17 22:31:05,945 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:05,945 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:05,958 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:05,962 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: 6722142E3EF24B54838D556B108A2088
2016-05-17 22:31:05,962 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"], id: FD9CED7391CE415191F89182E8B687CE
2016-05-17 22:31:05,963 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-05-17 22:31:05,967 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:05,967 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:05,971 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E0EABA0A017146E5A99B747B36938AD8, all 1 inputs ready in: 00:00:00.003
2016-05-17 22:31:05,982 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:05,982 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:05,984 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,984 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524264312_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:05,986 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,986 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E0EABA0A017146E5A99B747B36938AD8, mem on close (mb), free: 255, total: 281, max: 672
2016-05-17 22:31:05 Completed running task attempt: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05,993 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:05,997 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=32, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524265972, Process_Duration=14, Process_End_Time=1463524265986, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-05-17 22:31:05,998 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:05,998 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:31:05,999 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:05,999 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524264312_0001_00_000001
2016-05-17 22:31:06,002 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, taskAttemptId=attempt_1463524264312_0001_1_00_000000_0, startTime=1463524265746, finishTime=1463524265994, timeTaken=248, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=32, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524265972, Process_Duration=14, Process_End_Time=1463524265986, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,003 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524264312_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:06,004 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:06,005 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:06,008 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:06,007 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:TASK_FINISHED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, taskId=task_1463524264312_0001_1_00_000000, startTime=1463524265746, finishTime=1463524266005, timeTaken=259, status=SUCCEEDED, successfulAttemptID=attempt_1463524264312_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=32, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524265972, Process_Duration=14, Process_End_Time=1463524265986, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,017 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524264312_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:06,018 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] : 1
2016-05-17 22:31:06,018 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:06,025 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:06,028 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:VERTEX_FINISHED]: vertexName=E0EABA0A017146E5A99B747B36938AD8, vertexId=vertex_1463524264312_0001_1_00, initRequestedTime=1463524265446, initedTime=1463524265620, startRequestedTime=1463524265623, startedTime=1463524265623, finishTime=1463524266019, timeTaken=396, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=32, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524265972, Process_Duration=14, Process_End_Time=1463524265986, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1463524265746, firstTasksToStart=[ task_1463524264312_0001_1_00_000000 ], lastTaskFinishTime=1463524265994, lastTasksToFinish=[ task_1463524264312_0001_1_00_000000 ], minTaskDuration=248, maxTaskDuration=248, avgTaskDuration=248.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524264312_0001_1_00_000000 ], longestDurationTasks=[ task_1463524264312_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:06,029 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:06,030 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:06,031 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:06,031 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524264312_0001_00_000001, stoppedTime=1463524266031, exitStatus=0
2016-05-17 22:31:06,033 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:06,033 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:06,033 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524264312_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:06,034 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524264312_0001_00_000001: 35 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:06,034 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524264312_0001_00_000001, Exiting
2016-05-17 22:31:06,034 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524264312_0001_00_000001
2016-05-17 22:31:06,034 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524264312_0001_00_000001
2016-05-17 22:31:06,035 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524264312_0001_1
2016-05-17 22:31:06,036 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524264312_0001_1
2016-05-17 22:31:06,038 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524264312_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:06,039 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524264312_0001_00_000001 completed successfully
2016-05-17 22:31:06,039 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: FD9CED7391CE415191F89182E8B687CE for vertex: vertex_1463524264312_0001_1_00 [E0EABA0A017146E5A99B747B36938AD8]
2016-05-17 22:31:06,059 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524264312_0001_1, queueSize=0
2016-05-17 22:31:06,059 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:06,061 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524264312_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524264312_0001_1, startTime=1463524265442, finishTime=1463524266052, timeTaken=610, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=32, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524265972, Process_Duration=14, Process_End_Time=1463524265986, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,062 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524264312_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:06,065 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524264312_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:06,065 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524264312_0001_00_000001
2016-05-17 22:31:06,065 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524264312_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:06 Completed Dag: dag_1463524264312_0001_1
2016-05-17 22:31:06,066 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524264312_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:06,066 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524264312_0001_1_post
2016-05-17 22:31:06,066 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:06,066 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:06,076 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1463524264312_0001
2016-05-17 22:31:06,080 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:06,080 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:06,081 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:06,081 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:06,081 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:06,082 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:06,085 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:06,085 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:06,085 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:06,086 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:06,086 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:06,086 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:06,087 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:06,092 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/B81F034F65F24DE6879EF14822728E20/E430D53ED2094A59AA8A3D708F86A67A/.tez/application_1463524264312_0001
2016-05-17 22:31:06,094 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse/_temporary
2016-05-17 22:31:06,094 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  completed in: 00:01.987
2016-05-17 22:31:06,235 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-05-17 22:31:06,269 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:06,269 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:06,331 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-05-17 22:31:06,341 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.039
2016-05-17 22:31:06,342 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:06,342 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:06,343 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:06,362 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-05-17 22:31:06,363 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-05-17 22:31:06,389 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:06,390 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:06,390 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-05-17 22:31:06,390 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  parallel execution of steps is enabled: false
2016-05-17 22:31:06,391 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  executing total steps: 1
2016-05-17 22:31:06,392 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  allocating management threads: 1
2016-05-17 22:31:06,392 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...xtAll/quoted/normchartrue
2016-05-17 22:31:06,393 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:06,409 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:06,416 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:06,417 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:06,417 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:06,427 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001 doesn't exist and is created
2016-05-17 22:31:06,451 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:06,451 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:06,453 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001
2016-05-17 22:31:06,458 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524266416_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:06,474 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:06,475 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:06,478 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:06,478 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:06,478 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001/localmode-log-dir
2016-05-17 22:31:06,479 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001/localmode-log-dir/history.txt.appattempt_1463524266416_0001_000000, maxErrors=10
2016-05-17 22:31:06,480 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:06,480 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524266416_0001_000000, appSubmitTime=1463524266458, launchTime=1463524266458
2016-05-17 22:31:06,485 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:06,487 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:06,490 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:06,490 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:06,494 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:36177
2016-05-17 22:31:06,496 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:06,498 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:06,498 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524266416_0001_000000, startTime=1463524266498
2016-05-17 22:31:06,498 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:06,552 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:06,552 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:06,552 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1463524266416_0001, dagName=[4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-05-17 22:31:06,586 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-05-17 22:31:06,589 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524266416_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001/localmode-log-dir/dag_1463524266416_0001_1.dot
2016-05-17 22:31:06,590 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001/localmode-log-dir/dag_1463524266416_0001_1-tez-dag.pb.txt
2016-05-17 22:31:06,615 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524266416_0001_1
2016-05-17 22:31:06,615 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:06,615 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-05-17 22:31:06 Running Dag: dag_1463524266416_0001_1
2016-05-17 22:31:06,632 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:06,632 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524266416_0001_1, submitTime=1463524266586
2016-05-17 22:31:06,633 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B8E02653E84845E9AE73C631E278B1F5
2016-05-17 22:31:06,635 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:06,635 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:06,636 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524266416_0001_1, initTime=1463524266633
2016-05-17 22:31:06,637 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524266416_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:06,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:DAG_STARTED]: dagID=dag_1463524266416_0001_1, startTime=1463524266637
2016-05-17 22:31:06,637 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:06,638 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:06,638 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524266416_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:06,638 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B8E02653E84845E9AE73C631E278B1F5 : {4DEE49BF9F2D4181A740B9EF3BEB9D62={InputName=4DEE49BF9F2D4181A740B9EF3BEB9D62}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:06,638 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 4DEE49BF9F2D4181A740B9EF3BEB9D62, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:06,639 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,639 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1463524266416_0001, dagName=[4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-05-17 22:31:06,639 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,640 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,640 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]. Starting root input initializers: 1
2016-05-17 22:31:06,646 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:06,646 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 4DEE49BF9F2D4181A740B9EF3BEB9D62 on vertex vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,653 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:06,653 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 4DEE49BF9F2D4181A740B9EF3BEB9D62 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:06,655 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:06,655 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:06,658 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-05-17 22:31:06,659 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 4DEE49BF9F2D4181A740B9EF3BEB9D62 on vertex vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,659 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:06,659 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {4DEE49BF9F2D4181A740B9EF3BEB9D62=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:06,660 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] parallelism set to 1
2016-05-17 22:31:06,660 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:06,661 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524266416_0001_1_00, eventCount=1
2016-05-17 22:31:06,661 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,662 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=D6D78C5400A14A42AAF19AD2C383B81C, vertexId=vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:06,662 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=D6D78C5400A14A42AAF19AD2C383B81C, vertexId=vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,667 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524266416_0001, with dag id: dag_1463524266416_0001_1
2016-05-17 22:31:06,669 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=D6D78C5400A14A42AAF19AD2C383B81C, vertexName=B8E02653E84845E9AE73C631E278B1F5, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:06,669 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=D6D78C5400A14A42AAF19AD2C383B81C, vertexId=vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,670 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:06,671 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, vertexId=vertex_1463524266416_0001_1_00, initRequestedTime=1463524266638, initedTime=1463524266670, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:06,671 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] with distanceFromRoot: 0
2016-05-17 22:31:06,671 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:06,671 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B8E02653E84845E9AE73C631E278B1F5
2016-05-17 22:31:06,672 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,672 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:06,673 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524266416_0001_1_00, startRequestedTime=1463524266671, startedTime=1463524266671
2016-05-17 22:31:06,673 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:06,674 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:06,674 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:TASK_STARTED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, taskId=task_1463524266416_0001_1_00_000000, scheduledTime=1463524266674, launchTime=1463524266674
2016-05-17 22:31:06,675 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524266416_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:06,675 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,676 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: B8E02653E84845E9AE73C631E278B1F5, VertexParallelism: 1, TaskAttemptID:attempt_1463524266416_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4DEE49BF9F2D4181A740B9EF3BEB9D62, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D6D78C5400A14A42AAF19AD2C383B81C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:06,676 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524266416_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:06,677 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:06,678 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:06,679 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:06,679 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:06,680 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524266416_0001_00_000001
2016-05-17 22:31:06,680 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:06,686 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463524266416_0001_00_000001
2016-05-17 22:31:06,686 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:06,687 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:06,687 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524266416_0001_00_000001, launchTime=1463524266687
2016-05-17 22:31:06,687 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:06,688 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524266416_0001_00_000001
2016-05-17 22:31:06,690 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524266416_0001_1_00_000000_0] to container: [container_1463524266416_0001_00_000001]
2016-05-17 22:31:06,690 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:06,690 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524266416_0001_1_00_000000_0] started. Is using containerId: [container_1463524266416_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:06,691 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:06,691 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0, startTime=1463524266690, containerId=container_1463524266416_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524266416_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:06,692 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524266416_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:06,692 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524266416_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:06,692 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524266416_0001_00_000001 given task: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,692 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524266416_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06 Starting to run new task attempt: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,693 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,693 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:06,693 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:06,693 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:06,694 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:06,694 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:06,694 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:06,694 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: B8E02653E84845E9AE73C631E278B1F5, VertexParallelism: 1, TaskAttemptID:attempt_1463524266416_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4DEE49BF9F2D4181A740B9EF3BEB9D62, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D6D78C5400A14A42AAF19AD2C383B81C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:06,695 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:06,695 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,697 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:06,697 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:06,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:06,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=D6D78C5400A14A42AAF19AD2C383B81C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:06,702 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:06,703 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: D6D78C5400A14A42AAF19AD2C383B81C
2016-05-17 22:31:06,703 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:06,703 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: D6D78C5400A14A42AAF19AD2C383B81C
2016-05-17 22:31:06,702 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=4DEE49BF9F2D4181A740B9EF3BEB9D62, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:06,704 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:06,704 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,705 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,707 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524266416_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:06,710 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:06,717 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:06,717 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,717 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,725 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B8E02653E84845E9AE73C631E278B1F5, ordinal: 0
2016-05-17 22:31:06,726 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B8E02653E84845E9AE73C631E278B1F5, mem on start (mb), free: 162, total: 281, max: 672
2016-05-17 22:31:06,727 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:06,728 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:06,728 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:06,728 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:06,729 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: D6D78C5400A14A42AAF19AD2C383B81C
2016-05-17 22:31:06,729 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:06,729 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:06,730 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:06,730 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:06,730 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:06,731 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:06,732 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:06,733 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:06,733 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, D6D78C5400A14A42AAF19AD2C383B81C, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:06,733 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 4DEE49BF9F2D4181A740B9EF3BEB9D62, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:06,734 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:06,734 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,734 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:06,734 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,734 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 4DEE49BF9F2D4181A740B9EF3BEB9D62 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:06,735 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:06,735 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:06,735 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:06,736 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,738 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:06,740 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@6538b017
2016-05-17 22:31:06,746 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@6538b017
2016-05-17 22:31:06,746 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:06,747 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:06,746 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:06,748 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 4DEE49BF9F2D4181A740B9EF3BEB9D62
2016-05-17 22:31:06,748 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"], id: D6D78C5400A14A42AAF19AD2C383B81C
2016-05-17 22:31:06,748 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-05-17 22:31:06,749 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:06,749 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:06,750 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B8E02653E84845E9AE73C631E278B1F5, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:06,753 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:06,754 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:06,754 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,755 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524266416_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:06,756 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,756 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B8E02653E84845E9AE73C631E278B1F5, mem on close (mb), free: 160, total: 281, max: 672
2016-05-17 22:31:06 Completed running task attempt: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,757 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:06,759 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524266750, Process_Duration=6, Process_End_Time=1463524266756, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-05-17 22:31:06,759 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:06,760 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, taskAttemptId=attempt_1463524266416_0001_1_00_000000_0, startTime=1463524266690, finishTime=1463524266759, timeTaken=69, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524266750, Process_Duration=6, Process_End_Time=1463524266756, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,761 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524266416_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:06,761 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06,762 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:06,762 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:31:06,763 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:06,762 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:06,764 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:TASK_FINISHED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, taskId=task_1463524266416_0001_1_00_000000, startTime=1463524266690, finishTime=1463524266761, timeTaken=71, status=SUCCEEDED, successfulAttemptID=attempt_1463524266416_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524266750, Process_Duration=6, Process_End_Time=1463524266756, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,765 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524266416_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:06,765 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] : 1
2016-05-17 22:31:06,765 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,766 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524266416_0001_00_000001
2016-05-17 22:31:06,768 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:06,771 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:VERTEX_FINISHED]: vertexName=B8E02653E84845E9AE73C631E278B1F5, vertexId=vertex_1463524266416_0001_1_00, initRequestedTime=1463524266638, initedTime=1463524266670, startRequestedTime=1463524266671, startedTime=1463524266671, finishTime=1463524266765, timeTaken=94, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524266750, Process_Duration=6, Process_End_Time=1463524266756, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1463524266690, firstTasksToStart=[ task_1463524266416_0001_1_00_000000 ], lastTaskFinishTime=1463524266759, lastTasksToFinish=[ task_1463524266416_0001_1_00_000000 ], minTaskDuration=69, maxTaskDuration=69, avgTaskDuration=69.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524266416_0001_1_00_000000 ], longestDurationTasks=[ task_1463524266416_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:06,772 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:06,772 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:06,772 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:06,772 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524266416_0001_00_000001, stoppedTime=1463524266772, exitStatus=0
2016-05-17 22:31:06,773 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:06,773 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:06,774 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524266416_0001_1
2016-05-17 22:31:06,774 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524266416_0001_1
2016-05-17 22:31:06,775 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: D6D78C5400A14A42AAF19AD2C383B81C for vertex: vertex_1463524266416_0001_1_00 [B8E02653E84845E9AE73C631E278B1F5]
2016-05-17 22:31:06,778 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524266416_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:06,778 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524266416_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:06,779 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524266416_0001_00_000001, Exiting
2016-05-17 22:31:06,780 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524266416_0001_00_000001
2016-05-17 22:31:06,780 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524266416_0001_00_000001
2016-05-17 22:31:06,782 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524266416_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:06,782 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524266416_0001_00_000001 completed successfully
2016-05-17 22:31:06,788 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524266416_0001_1, queueSize=0
2016-05-17 22:31:06,788 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:06,789 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524266416_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524266416_0001_1, startTime=1463524266637, finishTime=1463524266787, timeTaken=150, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524266750, Process_Duration=6, Process_End_Time=1463524266756, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:06,789 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524266416_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:06,790 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524266416_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:06,790 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524266416_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:06,790 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524266416_0001_00_000001
2016-05-17 22:31:06 Completed Dag: dag_1463524266416_0001_1
2016-05-17 22:31:06,791 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524266416_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:06,792 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524266416_0001_1_post
2016-05-17 22:31:06,792 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:06,792 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:06,798 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1463524266416_0001
2016-05-17 22:31:06,801 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:06,801 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:06,801 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:06,801 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:06,801 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:06,802 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:06,802 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:06,803 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:06,803 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:06,804 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:06,804 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:06,805 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:06,805 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:06,810 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A08E494F24741A7B126E92C853E711F/E23A1CA77E4A42F69DBF095EAD5B84C3/.tez/application_1463524266416_0001
2016-05-17 22:31:06,811 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue/_temporary
2016-05-17 22:31:06,812 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  completed in: 00:00.421
2016-05-17 22:31:06,975 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-05-17 22:31:07,015 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:07,016 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:07,072 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-05-17 22:31:07,087 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-05-17 22:31:07,087 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:07,088 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:07,088 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:07,105 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-05-17 22:31:07,106 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-05-17 22:31:07,129 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:07,130 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:07,131 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-05-17 22:31:07,132 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  parallel execution of steps is enabled: false
2016-05-17 22:31:07,133 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  executing total steps: 1
2016-05-17 22:31:07,134 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  allocating management threads: 1
2016-05-17 22:31:07,135 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...arAll/quoted/specchartrue
2016-05-17 22:31:07,135 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:07,151 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:07,156 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:07,156 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:07,156 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:07,166 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001 doesn't exist and is created
2016-05-17 22:31:07,190 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:07,191 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:07,191 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001
2016-05-17 22:31:07,196 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524267156_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:07,207 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:07,209 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:07,211 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:07,212 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:07,212 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001/localmode-log-dir
2016-05-17 22:31:07,213 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001/localmode-log-dir/history.txt.appattempt_1463524267156_0001_000000, maxErrors=10
2016-05-17 22:31:07,213 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:07,213 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524267156_0001_000000, appSubmitTime=1463524267195, launchTime=1463524267195
2016-05-17 22:31:07,219 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:07,222 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:07,224 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:07,224 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:07,236 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:47038
2016-05-17 22:31:07,237 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:07,240 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524267156_0001_000000, startTime=1463524267240
2016-05-17 22:31:07,240 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:07,240 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:07,291 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:07,291 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:07,291 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1463524267156_0001, dagName=[4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue
2016-05-17 22:31:07,322 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue
2016-05-17 22:31:07,324 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524267156_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001/localmode-log-dir/dag_1463524267156_0001_1.dot
2016-05-17 22:31:07,325 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001/localmode-log-dir/dag_1463524267156_0001_1-tez-dag.pb.txt
2016-05-17 22:31:07,350 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524267156_0001_1
2016-05-17 22:31:07,350 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:07,350 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue
2016-05-17 22:31:07 Running Dag: dag_1463524267156_0001_1
2016-05-17 22:31:07,369 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524267156_0001_1, submitTime=1463524267322
2016-05-17 22:31:07,369 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:07,369 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A89FCAD7C4F844F3A497AE702C76E565
2016-05-17 22:31:07,370 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:07,370 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524267156_0001_1, initTime=1463524267369
2016-05-17 22:31:07,370 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267156_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:07,373 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:DAG_STARTED]: dagID=dag_1463524267156_0001_1, startTime=1463524267372
2016-05-17 22:31:07,373 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:07,373 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267156_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:07,373 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A89FCAD7C4F844F3A497AE702C76E565 : {8515E354D3884325AF7DE776BCCF723C={InputName=8515E354D3884325AF7DE776BCCF723C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:07,373 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8515E354D3884325AF7DE776BCCF723C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:07,374 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,374 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,374 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,374 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]. Starting root input initializers: 1
2016-05-17 22:31:07,374 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:07,375 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:07,376 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:07,377 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8515E354D3884325AF7DE776BCCF723C on vertex vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,377 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1463524267156_0001, dagName=[4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue
2016-05-17 22:31:07,379 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:07,380 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8515E354D3884325AF7DE776BCCF723C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:07,382 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:07,383 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:07,385 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-05-17 22:31:07,386 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8515E354D3884325AF7DE776BCCF723C on vertex vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,387 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:07,387 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8515E354D3884325AF7DE776BCCF723C=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:07,388 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] parallelism set to 1
2016-05-17 22:31:07,388 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:07,388 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524267156_0001_1_00, eventCount=1
2016-05-17 22:31:07,389 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,390 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=90102CEBF5FA4FA0AAB58F65B2F3658C, vertexId=vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:07,390 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=90102CEBF5FA4FA0AAB58F65B2F3658C, vertexId=vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,392 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=90102CEBF5FA4FA0AAB58F65B2F3658C, vertexName=A89FCAD7C4F844F3A497AE702C76E565, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:07,393 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=90102CEBF5FA4FA0AAB58F65B2F3658C, vertexId=vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,395 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:07,395 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, vertexId=vertex_1463524267156_0001_1_00, initRequestedTime=1463524267373, initedTime=1463524267395, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:07,396 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] with distanceFromRoot: 0
2016-05-17 22:31:07,397 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:07,397 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A89FCAD7C4F844F3A497AE702C76E565
2016-05-17 22:31:07,398 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,398 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:07,398 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524267156_0001_1_00, startRequestedTime=1463524267397, startedTime=1463524267397
2016-05-17 22:31:07,399 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:07,400 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:07,400 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:TASK_STARTED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, taskId=task_1463524267156_0001_1_00_000000, scheduledTime=1463524267400, launchTime=1463524267400
2016-05-17 22:31:07,401 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267156_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:07,401 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,402 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524267156_0001, with dag id: dag_1463524267156_0001_1
2016-05-17 22:31:07,403 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: A89FCAD7C4F844F3A497AE702C76E565, VertexParallelism: 1, TaskAttemptID:attempt_1463524267156_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8515E354D3884325AF7DE776BCCF723C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=90102CEBF5FA4FA0AAB58F65B2F3658C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:07,403 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267156_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:07,404 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:07,407 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:07,412 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:07,412 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:07,413 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524267156_0001_00_000001
2016-05-17 22:31:07,413 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:07,414 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463524267156_0001_00_000001
2016-05-17 22:31:07,415 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:07,416 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:07,416 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:07,417 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524267156_0001_00_000001, launchTime=1463524267415
2016-05-17 22:31:07,417 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524267156_0001_00_000001
2016-05-17 22:31:07,418 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524267156_0001_1_00_000000_0] to container: [container_1463524267156_0001_00_000001]
2016-05-17 22:31:07,418 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:07,419 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524267156_0001_00_000001 given task: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,419 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524267156_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,419 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524267156_0001_1_00_000000_0] started. Is using containerId: [container_1463524267156_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:07,419 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:07,419 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0, startTime=1463524267419, containerId=container_1463524267156_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524267156_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:07,420 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267156_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:07 Starting to run new task attempt: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,420 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267156_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:07,420 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,420 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:07,421 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:07,421 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:07,421 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:07,421 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:07,421 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:07,422 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: A89FCAD7C4F844F3A497AE702C76E565, VertexParallelism: 1, TaskAttemptID:attempt_1463524267156_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8515E354D3884325AF7DE776BCCF723C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=90102CEBF5FA4FA0AAB58F65B2F3658C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:07,422 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:07,422 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,423 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:07,423 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:07,424 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=8515E354D3884325AF7DE776BCCF723C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:07,425 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:07,425 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,425 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,428 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:07,432 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:07,433 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524267156_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:07,433 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=90102CEBF5FA4FA0AAB58F65B2F3658C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:07,435 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:07,437 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 90102CEBF5FA4FA0AAB58F65B2F3658C
2016-05-17 22:31:07,437 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:07,438 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 90102CEBF5FA4FA0AAB58F65B2F3658C
2016-05-17 22:31:07,434 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:07,441 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,441 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,445 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A89FCAD7C4F844F3A497AE702C76E565, ordinal: 0
2016-05-17 22:31:07,445 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A89FCAD7C4F844F3A497AE702C76E565, mem on start (mb), free: 300, total: 397, max: 672
2016-05-17 22:31:07,445 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:07,445 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:07,446 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:07,456 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:07,456 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 90102CEBF5FA4FA0AAB58F65B2F3658C
2016-05-17 22:31:07,457 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:07,457 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:07,457 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:07,457 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:07,457 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:07,457 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:07,458 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:07,458 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:07,458 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 8515E354D3884325AF7DE776BCCF723C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:07,458 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 90102CEBF5FA4FA0AAB58F65B2F3658C, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:07,458 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:07,459 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,459 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:07,459 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,459 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 8515E354D3884325AF7DE776BCCF723C being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:07,459 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:07,459 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:07,460 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:07,463 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,463 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:07,464 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5740807
2016-05-17 22:31:07,466 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5740807
2016-05-17 22:31:07,466 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:07,466 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:07,467 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:07,468 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: 8515E354D3884325AF7DE776BCCF723C
2016-05-17 22:31:07,468 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"], id: 90102CEBF5FA4FA0AAB58F65B2F3658C
2016-05-17 22:31:07,469 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-05-17 22:31:07,469 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-05-17 22:31:07,469 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:07,470 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A89FCAD7C4F844F3A497AE702C76E565, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:07,473 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:07,474 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:07,476 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,476 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524267156_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:07,478 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,478 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A89FCAD7C4F844F3A497AE702C76E565, mem on close (mb), free: 298, total: 397, max: 672
2016-05-17 22:31:07 Completed running task attempt: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,481 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:07,483 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524267470, Process_Duration=7, Process_End_Time=1463524267477, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-05-17 22:31:07,483 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:07,484 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:31:07,484 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, taskAttemptId=attempt_1463524267156_0001_1_00_000000_0, startTime=1463524267419, finishTime=1463524267483, timeTaken=64, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524267470, Process_Duration=7, Process_End_Time=1463524267477, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:07,486 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267156_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:07,486 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:07,485 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:07,486 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07,487 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:TASK_FINISHED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, taskId=task_1463524267156_0001_1_00_000000, startTime=1463524267419, finishTime=1463524267487, timeTaken=68, status=SUCCEEDED, successfulAttemptID=attempt_1463524267156_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524267470, Process_Duration=7, Process_End_Time=1463524267477, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:07,488 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267156_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:07,488 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] : 1
2016-05-17 22:31:07,488 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,489 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:07,490 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524267156_0001_00_000001
2016-05-17 22:31:07,492 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:07,495 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:VERTEX_FINISHED]: vertexName=A89FCAD7C4F844F3A497AE702C76E565, vertexId=vertex_1463524267156_0001_1_00, initRequestedTime=1463524267373, initedTime=1463524267395, startRequestedTime=1463524267397, startedTime=1463524267397, finishTime=1463524267488, timeTaken=91, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524267470, Process_Duration=7, Process_End_Time=1463524267477, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1463524267419, firstTasksToStart=[ task_1463524267156_0001_1_00_000000 ], lastTaskFinishTime=1463524267483, lastTasksToFinish=[ task_1463524267156_0001_1_00_000000 ], minTaskDuration=64, maxTaskDuration=64, avgTaskDuration=64.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524267156_0001_1_00_000000 ], longestDurationTasks=[ task_1463524267156_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:07,495 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:07,495 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:07,497 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524267156_0001_00_000001, stoppedTime=1463524267496, exitStatus=0
2016-05-17 22:31:07,497 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:07,497 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:07,498 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:07,499 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524267156_0001_1
2016-05-17 22:31:07,499 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524267156_0001_1
2016-05-17 22:31:07,500 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 90102CEBF5FA4FA0AAB58F65B2F3658C for vertex: vertex_1463524267156_0001_1_00 [A89FCAD7C4F844F3A497AE702C76E565]
2016-05-17 22:31:07,503 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524267156_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:07,503 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524267156_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:07,503 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524267156_0001_00_000001, Exiting
2016-05-17 22:31:07,503 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524267156_0001_00_000001
2016-05-17 22:31:07,503 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524267156_0001_00_000001
2016-05-17 22:31:07,507 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524267156_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:07,508 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524267156_0001_00_000001 completed successfully
2016-05-17 22:31:07,517 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524267156_0001_1, queueSize=0
2016-05-17 22:31:07,517 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:07,518 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267156_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524267156_0001_1, startTime=1463524267372, finishTime=1463524267515, timeTaken=143, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524267470, Process_Duration=7, Process_End_Time=1463524267477, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:07,518 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524267156_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:07,518 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267156_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:07,519 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267156_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:07,519 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524267156_0001_00_000001
2016-05-17 22:31:07 Completed Dag: dag_1463524267156_0001_1
2016-05-17 22:31:07,521 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524267156_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:07,522 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524267156_0001_1_post
2016-05-17 22:31:07,522 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:07,523 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:07,527 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1463524267156_0001
2016-05-17 22:31:07,530 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:07,530 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:07,530 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:07,530 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:07,531 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:07,531 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:07,531 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:07,533 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:07,533 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:07,533 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:07,533 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:07,535 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:07,535 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:07,541 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4A2A8A9AE90C4099AC004914DE5E8A05/FFFCE711CC84465588FB4912E22E3747/.tez/application_1463524267156_0001
2016-05-17 22:31:07,541 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue/_temporary
2016-05-17 22:31:07,542 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  completed in: 00:00.412
2016-05-17 22:31:07,649 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-05-17 22:31:07,678 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:07,679 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:07,725 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-05-17 22:31:07,740 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-05-17 22:31:07,741 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:07,741 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:07,741 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:07,759 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-05-17 22:31:07,759 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-05-17 22:31:07,776 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:07,777 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:07,777 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-05-17 22:31:07,778 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  parallel execution of steps is enabled: false
2016-05-17 22:31:07,779 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  executing total steps: 1
2016-05-17 22:31:07,779 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  allocating management threads: 1
2016-05-17 22:31:07,780 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...m/testHeaderAll/headerall
2016-05-17 22:31:07,780 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:07,797 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:07,802 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:07,803 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:07,803 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:07,814 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001 doesn't exist and is created
2016-05-17 22:31:07,831 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:07,832 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:07,832 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001
2016-05-17 22:31:07,837 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524267802_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:07,852 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:07,853 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:07,856 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:07,856 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:07,856 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001/localmode-log-dir
2016-05-17 22:31:07,857 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001/localmode-log-dir/history.txt.appattempt_1463524267802_0001_000000, maxErrors=10
2016-05-17 22:31:07,857 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:07,858 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524267802_0001_000000, appSubmitTime=1463524267837, launchTime=1463524267837
2016-05-17 22:31:07,863 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:07,868 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:07,871 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:57713
2016-05-17 22:31:07,873 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:07,873 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:07,874 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:07,877 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:07,877 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524267802_0001_000000, startTime=1463524267877
2016-05-17 22:31:07,877 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:07,932 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:07,932 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:07,932 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1463524267802_0001, dagName=[E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall
2016-05-17 22:31:07,957 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall
2016-05-17 22:31:07,959 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524267802_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001/localmode-log-dir/dag_1463524267802_0001_1.dot
2016-05-17 22:31:07,960 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001/localmode-log-dir/dag_1463524267802_0001_1-tez-dag.pb.txt
2016-05-17 22:31:07,988 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524267802_0001_1
2016-05-17 22:31:07,988 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:07,989 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall
2016-05-17 22:31:07 Running Dag: dag_1463524267802_0001_1
2016-05-17 22:31:08,003 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:08,004 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524267802_0001_1, submitTime=1463524267957
2016-05-17 22:31:08,005 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F4A755132C6A4CC7A4CB4D4AD949D557
2016-05-17 22:31:08,005 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:08,005 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:08,006 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524267802_0001_1, initTime=1463524268004
2016-05-17 22:31:08,006 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267802_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:08,007 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:08,007 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:DAG_STARTED]: dagID=dag_1463524267802_0001_1, startTime=1463524268007
2016-05-17 22:31:08,007 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:08,007 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267802_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:08,008 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F4A755132C6A4CC7A4CB4D4AD949D557 : {F60BD80950A942B3A59E05289627AE99={InputName=F60BD80950A942B3A59E05289627AE99}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:08,008 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: F60BD80950A942B3A59E05289627AE99, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:08,008 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,008 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,008 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,009 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]. Starting root input initializers: 1
2016-05-17 22:31:08,009 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1463524267802_0001, dagName=[E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall
2016-05-17 22:31:08,010 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:08,010 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: F60BD80950A942B3A59E05289627AE99 on vertex vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,013 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:08,013 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input F60BD80950A942B3A59E05289627AE99 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:08,015 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:08,015 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:08,019 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-05-17 22:31:08,020 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: F60BD80950A942B3A59E05289627AE99 on vertex vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,020 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:08,020 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {F60BD80950A942B3A59E05289627AE99=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:08,021 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] parallelism set to 1
2016-05-17 22:31:08,021 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:08,021 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524267802_0001_1_00, eventCount=1
2016-05-17 22:31:08,022 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,022 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=1A2C6632A98F45D6B330088DBD62B647, vertexId=vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:08,022 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=1A2C6632A98F45D6B330088DBD62B647, vertexId=vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,025 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=1A2C6632A98F45D6B330088DBD62B647, vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:08,026 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=1A2C6632A98F45D6B330088DBD62B647, vertexId=vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,027 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:08,027 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, vertexId=vertex_1463524267802_0001_1_00, initRequestedTime=1463524268008, initedTime=1463524268027, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:08,028 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] with distanceFromRoot: 0
2016-05-17 22:31:08,028 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:08,028 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F4A755132C6A4CC7A4CB4D4AD949D557
2016-05-17 22:31:08,029 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,029 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:08,029 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524267802_0001_1_00, startRequestedTime=1463524268028, startedTime=1463524268028
2016-05-17 22:31:08,030 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:08,030 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:08,030 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:TASK_STARTED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, taskId=task_1463524267802_0001_1_00_000000, scheduledTime=1463524268030, launchTime=1463524268030
2016-05-17 22:31:08,031 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267802_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:08,031 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,032 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: F4A755132C6A4CC7A4CB4D4AD949D557, VertexParallelism: 1, TaskAttemptID:attempt_1463524267802_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F60BD80950A942B3A59E05289627AE99, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1A2C6632A98F45D6B330088DBD62B647, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:08,032 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267802_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:08,032 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:08,034 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:08,034 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:08,034 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:08,035 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524267802_0001_00_000001
2016-05-17 22:31:08,035 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:08,037 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524267802_0001, with dag id: dag_1463524267802_0001_1
2016-05-17 22:31:08,038 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463524267802_0001_00_000001
2016-05-17 22:31:08,038 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:08,041 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:08,042 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:08,042 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524267802_0001_00_000001, launchTime=1463524268041
2016-05-17 22:31:08,043 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524267802_0001_00_000001
2016-05-17 22:31:08,044 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524267802_0001_1_00_000000_0] to container: [container_1463524267802_0001_00_000001]
2016-05-17 22:31:08,044 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:08,044 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524267802_0001_00_000001 given task: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,045 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524267802_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,045 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524267802_0001_1_00_000000_0] started. Is using containerId: [container_1463524267802_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:08,046 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:08,046 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0, startTime=1463524268045, containerId=container_1463524267802_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524267802_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:08,046 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267802_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:08,046 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267802_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:08 Starting to run new task attempt: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,048 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,049 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,049 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:08,049 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:08,050 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:08,050 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:08,050 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:08,051 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: F4A755132C6A4CC7A4CB4D4AD949D557, VertexParallelism: 1, TaskAttemptID:attempt_1463524267802_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F60BD80950A942B3A59E05289627AE99, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1A2C6632A98F45D6B330088DBD62B647, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:08,051 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:08,053 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,055 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:08,055 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,058 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524267802_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:08,058 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=1A2C6632A98F45D6B330088DBD62B647, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:08,058 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,059 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=F60BD80950A942B3A59E05289627AE99, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:08,060 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:08,060 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,060 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,059 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:08,062 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 1A2C6632A98F45D6B330088DBD62B647
2016-05-17 22:31:08,063 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:08,064 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 1A2C6632A98F45D6B330088DBD62B647
2016-05-17 22:31:08,064 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:08,066 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,066 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,066 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:08,078 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F4A755132C6A4CC7A4CB4D4AD949D557, ordinal: 0
2016-05-17 22:31:08,078 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F4A755132C6A4CC7A4CB4D4AD949D557, mem on start (mb), free: 209, total: 397, max: 672
2016-05-17 22:31:08,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:08,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:08,082 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:08,082 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 1A2C6632A98F45D6B330088DBD62B647
2016-05-17 22:31:08,083 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:08,083 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:08,083 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:08,083 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:08,083 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:08,083 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:08,083 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:08,084 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:08,084 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, F60BD80950A942B3A59E05289627AE99, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:08,084 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 1A2C6632A98F45D6B330088DBD62B647, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:08,084 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:08,084 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: F60BD80950A942B3A59E05289627AE99 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:08,084 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:08,085 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:08,085 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,086 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:08,086 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,086 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:08,087 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,087 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:08,087 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4c1df613
2016-05-17 22:31:08,089 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4c1df613
2016-05-17 22:31:08,089 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:08,089 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:08,091 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:08,092 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: F60BD80950A942B3A59E05289627AE99
2016-05-17 22:31:08,092 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"], id: 1A2C6632A98F45D6B330088DBD62B647
2016-05-17 22:31:08,092 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-05-17 22:31:08,092 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:08,092 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:08,093 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F4A755132C6A4CC7A4CB4D4AD949D557, all 1 inputs ready in: 00:00:00.001
2016-05-17 22:31:08,095 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:08,096 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:08,096 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,096 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524267802_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:08,098 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,098 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F4A755132C6A4CC7A4CB4D4AD949D557, mem on close (mb), free: 208, total: 397, max: 672
2016-05-17 22:31:08 Completed running task attempt: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,099 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:08,100 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, taskAttemptId=attempt_1463524267802_0001_1_00_000000_0, startTime=1463524268045, finishTime=1463524268100, timeTaken=55, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268093, Process_Duration=5, Process_End_Time=1463524268098, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:08,101 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524267802_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:08,101 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08,102 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:TASK_FINISHED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, taskId=task_1463524267802_0001_1_00_000000, startTime=1463524268045, finishTime=1463524268101, timeTaken=56, status=SUCCEEDED, successfulAttemptID=attempt_1463524267802_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268093, Process_Duration=5, Process_End_Time=1463524268098, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:08,102 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524267802_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:08,102 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] : 1
2016-05-17 22:31:08,102 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,103 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:08,104 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:08,103 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:08,106 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:08,107 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:VERTEX_FINISHED]: vertexName=F4A755132C6A4CC7A4CB4D4AD949D557, vertexId=vertex_1463524267802_0001_1_00, initRequestedTime=1463524268008, initedTime=1463524268027, startRequestedTime=1463524268028, startedTime=1463524268028, finishTime=1463524268102, timeTaken=74, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268093, Process_Duration=5, Process_End_Time=1463524268098, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1463524268045, firstTasksToStart=[ task_1463524267802_0001_1_00_000000 ], lastTaskFinishTime=1463524268100, lastTasksToFinish=[ task_1463524267802_0001_1_00_000000 ], minTaskDuration=55, maxTaskDuration=55, avgTaskDuration=55.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524267802_0001_1_00_000000 ], longestDurationTasks=[ task_1463524267802_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:08,107 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:08,108 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:08,108 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524267802_0001_00_000001, stoppedTime=1463524268108, exitStatus=0
2016-05-17 22:31:08,108 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:08,108 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:08,108 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524268093, Process_Duration=5, Process_End_Time=1463524268098, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-05-17 22:31:08,109 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:08,109 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:31:08,110 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,108 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524267802_0001_1
2016-05-17 22:31:08,111 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524267802_0001_00_000001
2016-05-17 22:31:08,111 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524267802_0001_1
2016-05-17 22:31:08,111 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 1A2C6632A98F45D6B330088DBD62B647 for vertex: vertex_1463524267802_0001_1_00 [F4A755132C6A4CC7A4CB4D4AD949D557]
2016-05-17 22:31:08,111 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524267802_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:08,111 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524267802_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:08,111 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524267802_0001_00_000001, Exiting
2016-05-17 22:31:08,112 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524267802_0001_00_000001
2016-05-17 22:31:08,112 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524267802_0001_00_000001
2016-05-17 22:31:08,115 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524267802_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:08,115 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524267802_0001_00_000001 completed successfully
2016-05-17 22:31:08,123 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524267802_0001_1, queueSize=0
2016-05-17 22:31:08,124 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:08,126 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524267802_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524267802_0001_1, startTime=1463524268007, finishTime=1463524268122, timeTaken=115, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268093, Process_Duration=5, Process_End_Time=1463524268098, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:08,126 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524267802_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:08,126 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524267802_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:08,127 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524267802_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:08,127 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524267802_0001_00_000001
2016-05-17 22:31:08 Completed Dag: dag_1463524267802_0001_1
2016-05-17 22:31:08,129 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524267802_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:08,130 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524267802_0001_1_post
2016-05-17 22:31:08,130 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,131 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:08,137 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1463524267802_0001
2016-05-17 22:31:08,143 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:08,143 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:08,143 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:08,143 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:08,144 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:08,144 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:08,146 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:08,146 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:08,147 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:08,147 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:08,147 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:08,149 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:08,149 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:08,154 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E0A35BBF2D7F406880D65A8930294016/C6968551FCE2413FB096485FD078DBA0/.tez/application_1463524267802_0001
2016-05-17 22:31:08,155 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall/_temporary
2016-05-17 22:31:08,156 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  completed in: 00:00.379
2016-05-17 22:31:08,206 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-05-17 22:31:08,242 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:08,243 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:08,302 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-05-17 22:31:08,313 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-05-17 22:31:08,314 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:08,314 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:08,314 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:08,335 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-05-17 22:31:08,336 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-05-17 22:31:08,349 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:08,350 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:08,350 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-05-17 22:31:08,350 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  parallel execution of steps is enabled: false
2016-05-17 22:31:08,351 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  executing total steps: 1
2016-05-17 22:31:08,351 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  allocating management threads: 1
2016-05-17 22:31:08,352 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...Text/quoted/normcharfalse
2016-05-17 22:31:08,352 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:08,371 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:08,376 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:08,376 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:08,376 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:08,387 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001 doesn't exist and is created
2016-05-17 22:31:08,407 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:08,407 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:08,408 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001
2016-05-17 22:31:08,413 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524268376_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:08,431 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:08,433 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:08,435 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:08,436 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:08,436 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001/localmode-log-dir
2016-05-17 22:31:08,437 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001/localmode-log-dir/history.txt.appattempt_1463524268376_0001_000000, maxErrors=10
2016-05-17 22:31:08,437 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:08,438 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524268376_0001_000000, appSubmitTime=1463524268412, launchTime=1463524268412
2016-05-17 22:31:08,443 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:08,445 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:08,447 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:08,447 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:08,449 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:48399
2016-05-17 22:31:08,451 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:08,453 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524268376_0001_000000, startTime=1463524268453
2016-05-17 22:31:08,453 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:08,453 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:08,507 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:08,507 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:08,507 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1463524268376_0001, dagName=[E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse
2016-05-17 22:31:08,532 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse
2016-05-17 22:31:08,534 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524268376_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001/localmode-log-dir/dag_1463524268376_0001_1.dot
2016-05-17 22:31:08,535 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001/localmode-log-dir/dag_1463524268376_0001_1-tez-dag.pb.txt
2016-05-17 22:31:08,555 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524268376_0001_1
2016-05-17 22:31:08,556 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,556 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse
2016-05-17 22:31:08 Running Dag: dag_1463524268376_0001_1
2016-05-17 22:31:08,570 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524268376_0001_1, submitTime=1463524268532
2016-05-17 22:31:08,570 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:08,571 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C66F3EF8DFF246A89081EB90484801BD
2016-05-17 22:31:08,572 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:08,572 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524268376_0001_1, initTime=1463524268570
2016-05-17 22:31:08,572 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:08,573 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524268376_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:08,574 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:DAG_STARTED]: dagID=dag_1463524268376_0001_1, startTime=1463524268574
2016-05-17 22:31:08,575 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:08,575 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524268376_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:08,575 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C66F3EF8DFF246A89081EB90484801BD : {6C04D11160BA40C2A4B9CC3FA0C4A0A9={InputName=6C04D11160BA40C2A4B9CC3FA0C4A0A9}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:08,575 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 6C04D11160BA40C2A4B9CC3FA0C4A0A9, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:08,575 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,575 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,575 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,576 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]. Starting root input initializers: 1
2016-05-17 22:31:08,576 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:08,574 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:08,578 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 6C04D11160BA40C2A4B9CC3FA0C4A0A9 on vertex vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,579 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1463524268376_0001, dagName=[E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse
2016-05-17 22:31:08,582 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:08,583 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 6C04D11160BA40C2A4B9CC3FA0C4A0A9 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:08,583 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:08,584 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:08,588 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-05-17 22:31:08,588 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 6C04D11160BA40C2A4B9CC3FA0C4A0A9 on vertex vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,589 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:08,589 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {6C04D11160BA40C2A4B9CC3FA0C4A0A9=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:08,589 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] parallelism set to 1
2016-05-17 22:31:08,589 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:08,589 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524268376_0001_1_00, eventCount=1
2016-05-17 22:31:08,590 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,590 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6E116267BAF1496E88B36C2908D8FEC2, vertexId=vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:08,590 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6E116267BAF1496E88B36C2908D8FEC2, vertexId=vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,594 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6E116267BAF1496E88B36C2908D8FEC2, vertexName=C66F3EF8DFF246A89081EB90484801BD, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:08,594 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6E116267BAF1496E88B36C2908D8FEC2, vertexId=vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,596 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:08,596 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, vertexId=vertex_1463524268376_0001_1_00, initRequestedTime=1463524268575, initedTime=1463524268596, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:08,596 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] with distanceFromRoot: 0
2016-05-17 22:31:08,596 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:08,596 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C66F3EF8DFF246A89081EB90484801BD
2016-05-17 22:31:08,597 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,597 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:08,597 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524268376_0001_1_00, startRequestedTime=1463524268596, startedTime=1463524268596
2016-05-17 22:31:08,598 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:08,598 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:08,625 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:TASK_STARTED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, taskId=task_1463524268376_0001_1_00_000000, scheduledTime=1463524268598, launchTime=1463524268598
2016-05-17 22:31:08,625 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524268376_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:08,625 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,625 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: C66F3EF8DFF246A89081EB90484801BD, VertexParallelism: 1, TaskAttemptID:attempt_1463524268376_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6C04D11160BA40C2A4B9CC3FA0C4A0A9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6E116267BAF1496E88B36C2908D8FEC2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:08,625 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524268376_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:08,626 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:08,629 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:08,629 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:08,630 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:08,630 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524268376_0001_00_000001
2016-05-17 22:31:08,630 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:08,635 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463524268376_0001_00_000001
2016-05-17 22:31:08,635 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:08,637 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:08,637 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:08,638 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524268376_0001_00_000001, launchTime=1463524268637
2016-05-17 22:31:08,638 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524268376_0001_00_000001
2016-05-17 22:31:08,639 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524268376_0001_1_00_000000_0] to container: [container_1463524268376_0001_00_000001]
2016-05-17 22:31:08,639 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:08,640 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524268376_0001_00_000001 given task: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,640 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524268376_0001_1_00_000000_0] started. Is using containerId: [container_1463524268376_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:08,640 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524268376_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,640 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:08,640 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0, startTime=1463524268640, containerId=container_1463524268376_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524268376_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:08,641 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524268376_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:08,641 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524268376_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:08 Starting to run new task attempt: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,642 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,642 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,642 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:08,642 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:08,643 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:08,643 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:08,643 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:08,643 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: C66F3EF8DFF246A89081EB90484801BD, VertexParallelism: 1, TaskAttemptID:attempt_1463524268376_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6C04D11160BA40C2A4B9CC3FA0C4A0A9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6E116267BAF1496E88B36C2908D8FEC2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:08,644 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:08,644 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524268376_0001, with dag id: dag_1463524268376_0001_1
2016-05-17 22:31:08,646 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,647 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:08,647 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,648 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524268376_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:08,648 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=6C04D11160BA40C2A4B9CC3FA0C4A0A9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:08,649 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,652 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6E116267BAF1496E88B36C2908D8FEC2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:08,653 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:08,653 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:08,653 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6E116267BAF1496E88B36C2908D8FEC2
2016-05-17 22:31:08,653 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:08,653 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6E116267BAF1496E88B36C2908D8FEC2
2016-05-17 22:31:08,657 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:08,657 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,657 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,660 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:08,661 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,661 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,667 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C66F3EF8DFF246A89081EB90484801BD, ordinal: 0
2016-05-17 22:31:08,667 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:08,668 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6E116267BAF1496E88B36C2908D8FEC2
2016-05-17 22:31:08,668 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C66F3EF8DFF246A89081EB90484801BD, mem on start (mb), free: 358, total: 397, max: 672
2016-05-17 22:31:08,668 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:08,668 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:08,668 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:08,670 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:08,670 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:08,671 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:08,671 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:08,671 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:08,671 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:08,671 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:08,672 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:08,672 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6E116267BAF1496E88B36C2908D8FEC2, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:08,672 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 6C04D11160BA40C2A4B9CC3FA0C4A0A9, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:08,673 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:08,673 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 6C04D11160BA40C2A4B9CC3FA0C4A0A9 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:08,673 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,673 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:08,674 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,673 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:08,674 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:08,674 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:08,675 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,675 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:08,676 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@27509e09
2016-05-17 22:31:08,677 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@27509e09
2016-05-17 22:31:08,677 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:08,677 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:08,678 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:08,679 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 6C04D11160BA40C2A4B9CC3FA0C4A0A9
2016-05-17 22:31:08,679 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"], id: 6E116267BAF1496E88B36C2908D8FEC2
2016-05-17 22:31:08,679 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-05-17 22:31:08,679 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:08,679 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:08,680 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C66F3EF8DFF246A89081EB90484801BD, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:08,682 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:08,683 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:08,683 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,683 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524268376_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:08,684 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,685 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C66F3EF8DFF246A89081EB90484801BD, mem on close (mb), free: 356, total: 397, max: 672
2016-05-17 22:31:08 Completed running task attempt: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,685 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:08,687 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, taskAttemptId=attempt_1463524268376_0001_1_00_000000_0, startTime=1463524268640, finishTime=1463524268687, timeTaken=47, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268680, Process_Duration=4, Process_End_Time=1463524268684, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:08,688 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:08,688 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524268376_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:08,688 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08,689 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:08,689 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:TASK_FINISHED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, taskId=task_1463524268376_0001_1_00_000000, startTime=1463524268640, finishTime=1463524268688, timeTaken=48, status=SUCCEEDED, successfulAttemptID=attempt_1463524268376_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268680, Process_Duration=4, Process_End_Time=1463524268684, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:08,689 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524268376_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:08,690 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] : 1
2016-05-17 22:31:08,690 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,690 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524268680, Process_Duration=4, Process_End_Time=1463524268684, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-05-17 22:31:08,690 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:08,691 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:31:08,691 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,692 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524268376_0001_00_000001
2016-05-17 22:31:08,692 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:08,693 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:VERTEX_FINISHED]: vertexName=C66F3EF8DFF246A89081EB90484801BD, vertexId=vertex_1463524268376_0001_1_00, initRequestedTime=1463524268575, initedTime=1463524268596, startRequestedTime=1463524268596, startedTime=1463524268596, finishTime=1463524268690, timeTaken=94, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268680, Process_Duration=4, Process_End_Time=1463524268684, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1463524268640, firstTasksToStart=[ task_1463524268376_0001_1_00_000000 ], lastTaskFinishTime=1463524268687, lastTasksToFinish=[ task_1463524268376_0001_1_00_000000 ], minTaskDuration=47, maxTaskDuration=47, avgTaskDuration=47.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524268376_0001_1_00_000000 ], longestDurationTasks=[ task_1463524268376_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:08,693 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:08,694 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:08,694 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:08,694 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524268376_0001_00_000001, stoppedTime=1463524268694, exitStatus=0
2016-05-17 22:31:08,694 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:08,695 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:08,695 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524268376_0001_1
2016-05-17 22:31:08,695 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524268376_0001_1
2016-05-17 22:31:08,695 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 6E116267BAF1496E88B36C2908D8FEC2 for vertex: vertex_1463524268376_0001_1_00 [C66F3EF8DFF246A89081EB90484801BD]
2016-05-17 22:31:08,702 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524268376_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:08,702 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524268376_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:08,702 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524268376_0001_00_000001, Exiting
2016-05-17 22:31:08,703 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524268376_0001_00_000001
2016-05-17 22:31:08,703 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524268376_0001_00_000001
2016-05-17 22:31:08,705 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524268376_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:08,705 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524268376_0001_00_000001 completed successfully
2016-05-17 22:31:08,707 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524268376_0001_1, queueSize=0
2016-05-17 22:31:08,707 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:08,708 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524268376_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524268376_0001_1, startTime=1463524268574, finishTime=1463524268706, timeTaken=132, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524268680, Process_Duration=4, Process_End_Time=1463524268684, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-05-17 22:31:08,708 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524268376_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:08,708 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524268376_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:08,708 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524268376_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:08 Completed Dag: dag_1463524268376_0001_1
2016-05-17 22:31:08,709 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524268376_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:08,709 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524268376_0001_00_000001
2016-05-17 22:31:08,709 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524268376_0001_1_post
2016-05-17 22:31:08,709 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:08,710 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:08,715 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1463524268376_0001
2016-05-17 22:31:08,718 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:08,718 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:08,718 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:08,718 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:08,718 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:08,719 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:08,719 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:08,720 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:08,720 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:08,720 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:08,721 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:08,721 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:08,721 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:08,726 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/E8D6CC154BF74BB3925EA1A08461DA49/E0BE69068A5743B7B6F454C7A16B6821/.tez/application_1463524268376_0001
2016-05-17 22:31:08,727 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse/_temporary
2016-05-17 22:31:08,727 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  completed in: 00:00.377
2016-05-17 22:31:08,829 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-05-17 22:31:08,964 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:08,964 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:09,012 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-05-17 22:31:09,017 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-05-17 22:31:09,017 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:09,017 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:09,018 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:09,033 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt
2016-05-17 22:31:09,034 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-05-17 22:31:09,060 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:09,060 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-05-17 22:31:09,061 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  sink: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-05-17 22:31:09,061 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  parallel execution of steps is enabled: false
2016-05-17 22:31:09,061 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  executing total steps: 1
2016-05-17 22:31:09,061 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  allocating management threads: 1
2016-05-17 22:31:09,063 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...oercion/testFieldCoercion
2016-05-17 22:31:09,064 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:09,077 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:09,082 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:09,083 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:09,083 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:09,092 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001 doesn't exist and is created
2016-05-17 22:31:09,110 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:09,110 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:09,110 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001
2016-05-17 22:31:09,115 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524269083_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:09,126 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:09,128 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:09,129 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:09,130 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:09,130 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001/localmode-log-dir
2016-05-17 22:31:09,132 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001/localmode-log-dir/history.txt.appattempt_1463524269083_0001_000000, maxErrors=10
2016-05-17 22:31:09,133 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:09,133 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524269083_0001_000000, appSubmitTime=1463524269114, launchTime=1463524269114
2016-05-17 22:31:09,137 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:09,139 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:09,141 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:09,142 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:09,144 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:55107
2016-05-17 22:31:09,146 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:09,148 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524269083_0001_000000, startTime=1463524269148
2016-05-17 22:31:09,148 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:09,149 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:09,210 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:09,210 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:09,210 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1463524269083_0001, dagName=[AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion
2016-05-17 22:31:09,229 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion
2016-05-17 22:31:09,232 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524269083_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001/localmode-log-dir/dag_1463524269083_0001_1.dot
2016-05-17 22:31:09,234 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001/localmode-log-dir/dag_1463524269083_0001_1-tez-dag.pb.txt
2016-05-17 22:31:09,265 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524269083_0001_1
2016-05-17 22:31:09,266 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,266 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion
2016-05-17 22:31:09 Running Dag: dag_1463524269083_0001_1
2016-05-17 22:31:09,286 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524269083_0001_1, submitTime=1463524269229
2016-05-17 22:31:09,286 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:09,287 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E8D15210398C41389683E008ACE75CED
2016-05-17 22:31:09,287 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:09,289 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:09,289 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524269083_0001_1, initTime=1463524269287
2016-05-17 22:31:09,289 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269083_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:09,291 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:DAG_STARTED]: dagID=dag_1463524269083_0001_1, startTime=1463524269290
2016-05-17 22:31:09,291 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:09,291 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269083_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:09,291 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:09,291 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E8D15210398C41389683E008ACE75CED : {F9C37A9130C3434A8F7AA3BA41E8F6B8={InputName=F9C37A9130C3434A8F7AA3BA41E8F6B8}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:09,292 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: F9C37A9130C3434A8F7AA3BA41E8F6B8, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:09,292 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1463524269083_0001, dagName=[AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion
2016-05-17 22:31:09,292 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,292 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,292 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,293 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]. Starting root input initializers: 1
2016-05-17 22:31:09,295 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:09,300 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: F9C37A9130C3434A8F7AA3BA41E8F6B8 on vertex vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,303 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:09,303 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input F9C37A9130C3434A8F7AA3BA41E8F6B8 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:09,304 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:09,304 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:09,306 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 420
2016-05-17 22:31:09,307 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: F9C37A9130C3434A8F7AA3BA41E8F6B8 on vertex vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,308 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:09,308 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {F9C37A9130C3434A8F7AA3BA41E8F6B8=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:09,308 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] parallelism set to 1
2016-05-17 22:31:09,308 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:09,309 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524269083_0001_1_00, eventCount=1
2016-05-17 22:31:09,310 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,310 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=CF96A65D444A42B7AB3BEB6AB9A115FF, vertexId=vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:09,311 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=CF96A65D444A42B7AB3BEB6AB9A115FF, vertexId=vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,315 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=CF96A65D444A42B7AB3BEB6AB9A115FF, vertexName=E8D15210398C41389683E008ACE75CED, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:09,315 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=CF96A65D444A42B7AB3BEB6AB9A115FF, vertexId=vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,317 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:09,317 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E8D15210398C41389683E008ACE75CED, vertexId=vertex_1463524269083_0001_1_00, initRequestedTime=1463524269291, initedTime=1463524269317, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:09,317 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] with distanceFromRoot: 0
2016-05-17 22:31:09,317 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:09,318 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E8D15210398C41389683E008ACE75CED
2016-05-17 22:31:09,318 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,318 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:09,318 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524269083_0001_1_00, startRequestedTime=1463524269318, startedTime=1463524269318
2016-05-17 22:31:09,318 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:09,319 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:09,319 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:TASK_STARTED]: vertexName=E8D15210398C41389683E008ACE75CED, taskId=task_1463524269083_0001_1_00_000000, scheduledTime=1463524269319, launchTime=1463524269319
2016-05-17 22:31:09,320 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269083_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:09,320 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,320 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: E8D15210398C41389683E008ACE75CED, VertexParallelism: 1, TaskAttemptID:attempt_1463524269083_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F9C37A9130C3434A8F7AA3BA41E8F6B8, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CF96A65D444A42B7AB3BEB6AB9A115FF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:09,321 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269083_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:09,321 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:09,322 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:09,323 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:09,323 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:09,324 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524269083_0001_00_000001
2016-05-17 22:31:09,324 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:09,325 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524269083_0001, with dag id: dag_1463524269083_0001_1
2016-05-17 22:31:09,327 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463524269083_0001_00_000001
2016-05-17 22:31:09,327 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:09,328 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:09,328 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:09,330 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524269083_0001_00_000001, launchTime=1463524269328
2016-05-17 22:31:09,331 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524269083_0001_00_000001
2016-05-17 22:31:09,331 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524269083_0001_1_00_000000_0] to container: [container_1463524269083_0001_00_000001]
2016-05-17 22:31:09,332 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:09,332 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524269083_0001_00_000001 given task: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,332 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524269083_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,332 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524269083_0001_1_00_000000_0] started. Is using containerId: [container_1463524269083_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:09 Starting to run new task attempt: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,333 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E8D15210398C41389683E008ACE75CED, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0, startTime=1463524269332, containerId=container_1463524269083_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524269083_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:09,333 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,333 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,333 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269083_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:09,334 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269083_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:09,333 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:09,334 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:09,333 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:09,334 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:09,334 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:09,335 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:09,335 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: E8D15210398C41389683E008ACE75CED, VertexParallelism: 1, TaskAttemptID:attempt_1463524269083_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F9C37A9130C3434A8F7AA3BA41E8F6B8, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CF96A65D444A42B7AB3BEB6AB9A115FF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:09,335 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:09,339 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,340 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:09,341 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:09,341 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524269083_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:09,350 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=F9C37A9130C3434A8F7AA3BA41E8F6B8, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:09,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=CF96A65D444A42B7AB3BEB6AB9A115FF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:09,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:09,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:09,352 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,352 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,351 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:09,353 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: CF96A65D444A42B7AB3BEB6AB9A115FF
2016-05-17 22:31:09,353 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:09,354 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: CF96A65D444A42B7AB3BEB6AB9A115FF
2016-05-17 22:31:09,356 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:09,356 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,356 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,360 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:09,374 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:09,374 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: CF96A65D444A42B7AB3BEB6AB9A115FF
2016-05-17 22:31:09,386 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E8D15210398C41389683E008ACE75CED, ordinal: 0
2016-05-17 22:31:09,386 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E8D15210398C41389683E008ACE75CED, mem on start (mb), free: 260, total: 397, max: 672
2016-05-17 22:31:09,386 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:09,387 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:09,387 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:09,387 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:09,388 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:09,389 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:09,389 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:09,389 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:09,390 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:09,390 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:09,391 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:09,391 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, F9C37A9130C3434A8F7AA3BA41E8F6B8, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:09,391 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, CF96A65D444A42B7AB3BEB6AB9A115FF, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:09,392 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:09,392 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: F9C37A9130C3434A8F7AA3BA41E8F6B8 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:09,392 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,393 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:09,393 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,394 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:09,395 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:09,396 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:09,396 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,398 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:09,399 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7911fa29
2016-05-17 22:31:09,399 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-05-17 22:31:09,402 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7911fa29
2016-05-17 22:31:09,402 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:09,402 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:09,409 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"] streamed: true, id: F9C37A9130C3434A8F7AA3BA41E8F6B8
2016-05-17 22:31:09,409 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"], id: CF96A65D444A42B7AB3BEB6AB9A115FF
2016-05-17 22:31:09,410 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-05-17 22:31:09,514 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z',canonicalType='long'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-05-17 22:31:09,514 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:09,515 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E8D15210398C41389683E008ACE75CED, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:09,523 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:09,523 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:09,524 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,524 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524269083_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:09,525 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,525 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E8D15210398C41389683E008ACE75CED, mem on close (mb), free: 252, total: 397, max: 672
2016-05-17 22:31:09 Completed running task attempt: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,527 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:09,528 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:09,528 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E8D15210398C41389683E008ACE75CED, taskAttemptId=attempt_1463524269083_0001_1_00_000000_0, startTime=1463524269332, finishTime=1463524269528, timeTaken=196, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1826, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1463524269515, Process_Duration=10, Process_End_Time=1463524269525, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-05-17 22:31:09,529 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269083_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:09,529 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:09,529 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09,530 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:09,530 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:TASK_FINISHED]: vertexName=E8D15210398C41389683E008ACE75CED, taskId=task_1463524269083_0001_1_00_000000, startTime=1463524269332, finishTime=1463524269530, timeTaken=198, status=SUCCEEDED, successfulAttemptID=attempt_1463524269083_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1826, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1463524269515, Process_Duration=10, Process_End_Time=1463524269525, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-05-17 22:31:09,531 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269083_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:09,531 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] : 1
2016-05-17 22:31:09,531 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,532 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:09,534 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:VERTEX_FINISHED]: vertexName=E8D15210398C41389683E008ACE75CED, vertexId=vertex_1463524269083_0001_1_00, initRequestedTime=1463524269291, initedTime=1463524269317, startRequestedTime=1463524269318, startedTime=1463524269318, finishTime=1463524269531, timeTaken=213, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1826, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1463524269515, Process_Duration=10, Process_End_Time=1463524269525, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9, vertexStats=firstTaskStartTime=1463524269332, firstTasksToStart=[ task_1463524269083_0001_1_00_000000 ], lastTaskFinishTime=1463524269528, lastTasksToFinish=[ task_1463524269083_0001_1_00_000000 ], minTaskDuration=196, maxTaskDuration=196, avgTaskDuration=196.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524269083_0001_1_00_000000 ], longestDurationTasks=[ task_1463524269083_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:09,534 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:09,535 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1826, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10][cascading.flow.SliceCounters Process_Begin_Time=1463524269515, Process_Duration=10, Process_End_Time=1463524269525, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=9, Tuples_Written=9]]
2016-05-17 22:31:09,535 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:09,536 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:09,537 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524269083_0001_00_000001, stoppedTime=1463524269536, exitStatus=0
2016-05-17 22:31:09,537 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:09,538 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:09,538 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:31:09,538 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,538 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524269083_0001_00_000001
2016-05-17 22:31:09,539 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524269083_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:09,539 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524269083_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:09,538 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524269083_0001_1
2016-05-17 22:31:09,539 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524269083_0001_00_000001, Exiting
2016-05-17 22:31:09,539 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524269083_0001_1
2016-05-17 22:31:09,540 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: CF96A65D444A42B7AB3BEB6AB9A115FF for vertex: vertex_1463524269083_0001_1_00 [E8D15210398C41389683E008ACE75CED]
2016-05-17 22:31:09,539 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524269083_0001_00_000001
2016-05-17 22:31:09,540 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524269083_0001_00_000001
2016-05-17 22:31:09,542 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524269083_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:09,543 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524269083_0001_00_000001 completed successfully
2016-05-17 22:31:09,552 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524269083_0001_1, queueSize=0
2016-05-17 22:31:09,552 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:09,553 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269083_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524269083_0001_1, startTime=1463524269290, finishTime=1463524269551, timeTaken=261, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1826, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1463524269515, Process_Duration=10, Process_End_Time=1463524269525, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-05-17 22:31:09,554 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524269083_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:09,554 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269083_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:09,554 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269083_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:09,554 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524269083_0001_00_000001
2016-05-17 22:31:09 Completed Dag: dag_1463524269083_0001_1
2016-05-17 22:31:09,557 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524269083_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:09,558 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524269083_0001_1_post
2016-05-17 22:31:09,558 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,559 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:09,563 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1463524269083_0001
2016-05-17 22:31:09,566 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:09,566 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:09,566 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:09,566 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:09,566 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:09,567 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:09,567 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:09,567 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:09,568 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:09,568 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:09,568 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:09,569 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:09,569 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:09,575 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/AEAE80F59BBA4B7FA7F27B55C40AD5C8/CF5C9AF4C26B4968B1713E9100B8E6DA/.tez/application_1463524269083_0001
2016-05-17 22:31:09,575 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion/_temporary
2016-05-17 22:31:09,576 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  completed in: 00:00.515
2016-05-17 22:31:09,616 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-05-17 22:31:09,646 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:09,646 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:09,720 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-05-17 22:31:09,735 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-05-17 22:31:09,735 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:09,736 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:09,736 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:09,752 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt
2016-05-17 22:31:09,757 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: __multisink_placeholder_A0175280100A4661B094E4B3E6586118
2016-05-17 22:31:09,769 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:09,769 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-05-17 22:31:09,769 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  sink: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-05-17 22:31:09,769 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  parallel execution of steps is enabled: false
2016-05-17 22:31:09,769 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  executing total steps: 1
2016-05-17 22:31:09,769 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  allocating management threads: 1
2016-05-17 22:31:09,770 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...0100A4661B094E4B3E6586118
2016-05-17 22:31:09,770 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:09,787 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:09,791 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:09,792 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:09,792 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:09,802 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001 doesn't exist and is created
2016-05-17 22:31:09,819 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:09,819 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:09,820 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001
2016-05-17 22:31:09,823 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524269792_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:09,837 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:09,838 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:09,840 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:09,840 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:09,841 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001/localmode-log-dir
2016-05-17 22:31:09,841 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001/localmode-log-dir/history.txt.appattempt_1463524269792_0001_000000, maxErrors=10
2016-05-17 22:31:09,841 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:09,843 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524269792_0001_000000, appSubmitTime=1463524269823, launchTime=1463524269823
2016-05-17 22:31:09,846 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:09,848 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:09,850 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:09,850 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:09,855 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:46577
2016-05-17 22:31:09,856 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:09,858 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524269792_0001_000000, startTime=1463524269858
2016-05-17 22:31:09,858 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:09,858 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:09,920 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:09,920 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:09,920 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...0100A4661B094E4B3E6586118, applicationId=application_1463524269792_0001, dagName=[DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118
2016-05-17 22:31:09,937 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118
2016-05-17 22:31:09,940 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524269792_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001/localmode-log-dir/dag_1463524269792_0001_1.dot
2016-05-17 22:31:09,941 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001/localmode-log-dir/dag_1463524269792_0001_1-tez-dag.pb.txt
2016-05-17 22:31:09,951 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524269792_0001_1
2016-05-17 22:31:09,951 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,952 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118
2016-05-17 22:31:09 Running Dag: dag_1463524269792_0001_1
2016-05-17 22:31:09,965 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524269792_0001_1, submitTime=1463524269938
2016-05-17 22:31:09,965 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:09,966 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex FDFE6F8A49CE4E0599308FD52544A544
2016-05-17 22:31:09,966 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:09,967 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524269792_0001_1, initTime=1463524269966
2016-05-17 22:31:09,967 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269792_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:09,967 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:09,969 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:DAG_STARTED]: dagID=dag_1463524269792_0001_1, startTime=1463524269969
2016-05-17 22:31:09,969 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:09,969 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269792_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:09,969 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: FDFE6F8A49CE4E0599308FD52544A544 : {8DE3DD03AE0F4CCB920D7E9212EBBA5C={InputName=8DE3DD03AE0F4CCB920D7E9212EBBA5C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:09,969 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8DE3DD03AE0F4CCB920D7E9212EBBA5C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:09,970 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,970 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,970 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,970 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]. Starting root input initializers: 1
2016-05-17 22:31:09,969 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:09,969 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...0100A4661B094E4B3E6586118, applicationId=application_1463524269792_0001, dagName=[DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118
2016-05-17 22:31:09,970 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:09,972 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8DE3DD03AE0F4CCB920D7E9212EBBA5C on vertex vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,973 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:09,974 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8DE3DD03AE0F4CCB920D7E9212EBBA5C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:09,974 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:09,975 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:09,976 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 422
2016-05-17 22:31:09,977 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8DE3DD03AE0F4CCB920D7E9212EBBA5C on vertex vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,977 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:09,977 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8DE3DD03AE0F4CCB920D7E9212EBBA5C=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:09,977 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] parallelism set to 1
2016-05-17 22:31:09,978 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:09,978 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524269792_0001_1_00, eventCount=1
2016-05-17 22:31:09,978 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,979 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=E307C12E3ACA4CB9B084E9510B6FD81D, vertexId=vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:09,980 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=E307C12E3ACA4CB9B084E9510B6FD81D, vertexId=vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,981 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(120)) - Using mapred newApiCommitter.
2016-05-17 22:31:09,982 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=E307C12E3ACA4CB9B084E9510B6FD81D, vertexName=FDFE6F8A49CE4E0599308FD52544A544, outputCommitterClass=org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2016-05-17 22:31:09,982 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=E307C12E3ACA4CB9B084E9510B6FD81D, vertexId=vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,983 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, vertexId=vertex_1463524269792_0001_1_00, initRequestedTime=1463524269969, initedTime=1463524269983, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:09,983 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] with distanceFromRoot: 0
2016-05-17 22:31:09,983 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:09,984 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:09,984 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in FDFE6F8A49CE4E0599308FD52544A544
2016-05-17 22:31:09,984 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,985 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:09,985 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524269792_0001_1_00, startRequestedTime=1463524269984, startedTime=1463524269984
2016-05-17 22:31:09,985 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:09,986 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:09,986 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:TASK_STARTED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, taskId=task_1463524269792_0001_1_00_000000, scheduledTime=1463524269986, launchTime=1463524269986
2016-05-17 22:31:09,986 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269792_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:09,987 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:09,987 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118, VertexName: FDFE6F8A49CE4E0599308FD52544A544, VertexParallelism: 1, TaskAttemptID:attempt_1463524269792_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8DE3DD03AE0F4CCB920D7E9212EBBA5C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=E307C12E3ACA4CB9B084E9510B6FD81D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:09,987 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269792_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:09,988 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:09,988 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:09,989 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:09,989 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:09,989 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524269792_0001, with dag id: dag_1463524269792_0001_1
2016-05-17 22:31:09,989 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524269792_0001_00_000001
2016-05-17 22:31:09,990 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:09,993 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463524269792_0001_00_000001
2016-05-17 22:31:09,993 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:09,993 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:09,994 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:09,994 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524269792_0001_00_000001, launchTime=1463524269993
2016-05-17 22:31:09,994 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524269792_0001_00_000001
2016-05-17 22:31:09,997 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524269792_0001_1_00_000000_0] to container: [container_1463524269792_0001_00_000001]
2016-05-17 22:31:09,997 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:09,997 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524269792_0001_00_000001 given task: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:09,997 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524269792_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:09,997 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524269792_0001_1_00_000000_0] started. Is using containerId: [container_1463524269792_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:09,997 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:09 Starting to run new task attempt: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:09,997 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0, startTime=1463524269997, containerId=container_1463524269792_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524269792_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:09,998 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269792_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:09,998 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:09,998 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:09,998 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269792_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:09,998 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:09,999 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:09,999 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:09,999 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:09,999 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:09,999 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2] pipe/(1/1) ...0100A4661B094E4B3E6586118, VertexName: FDFE6F8A49CE4E0599308FD52544A544, VertexParallelism: 1, TaskAttemptID:attempt_1463524269792_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8DE3DD03AE0F4CCB920D7E9212EBBA5C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=E307C12E3ACA4CB9B084E9510B6FD81D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:09,999 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:10,000 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,000 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:10,000 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,003 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524269792_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:10,003 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,003 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=8DE3DD03AE0F4CCB920D7E9212EBBA5C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:10,006 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:10,006 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:10,007 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,007 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,003 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=E307C12E3ACA4CB9B084E9510B6FD81D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:10,009 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:10,010 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: E307C12E3ACA4CB9B084E9510B6FD81D
2016-05-17 22:31:10,010 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:10,011 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: E307C12E3ACA4CB9B084E9510B6FD81D
2016-05-17 22:31:10,010 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:10,011 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,013 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,013 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FDFE6F8A49CE4E0599308FD52544A544, ordinal: 0
2016-05-17 22:31:10,014 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FDFE6F8A49CE4E0599308FD52544A544, mem on start (mb), free: 173, total: 397, max: 672
2016-05-17 22:31:10,014 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,014 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:10,014 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:10,022 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: true
2016-05-17 22:31:10,022 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: E307C12E3ACA4CB9B084E9510B6FD81D
2016-05-17 22:31:10,022 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:10,022 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:10,023 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:10,023 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:10,023 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:10,023 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:10,023 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:10,023 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:10,024 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 8DE3DD03AE0F4CCB920D7E9212EBBA5C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:10,024 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, E307C12E3ACA4CB9B084E9510B6FD81D, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:10,024 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:10,024 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 8DE3DD03AE0F4CCB920D7E9212EBBA5C being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:10,024 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:10,024 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:10,024 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,024 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:10,025 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,025 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:10,025 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,026 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:10,027 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@59a13986
2016-05-17 22:31:10,028 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@59a13986
2016-05-17 22:31:10,028 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:10,028 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:10,028 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-05-17 22:31:10,029 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"] streamed: true, id: 8DE3DD03AE0F4CCB920D7E9212EBBA5C
2016-05-17 22:31:10,029 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]], id: E307C12E3ACA4CB9B084E9510B6FD81D
2016-05-17 22:31:10,030 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-05-17 22:31:10,033 INFO  tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"]
2016-05-17 22:31:10,039 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14635242697920_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14635242697920_0001_m_000000_0
2016-05-17 22:31:10,039 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-05-17 22:31:10,048 INFO  tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]
2016-05-17 22:31:10,052 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14635242697920_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14635242697920_0001_m_000000_0
2016-05-17 22:31:10,052 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-05-17 22:31:10,058 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-05-17 22:31:10,058 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:10,059 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FDFE6F8A49CE4E0599308FD52544A544, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:10,062 INFO  io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/part-00000
2016-05-17 22:31:10,062 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14635242697920_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14635242697920_0001_m_000000_0
2016-05-17 22:31:10,067 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14635242697920_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-05-17 22:31:10,067 INFO  io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/part-00000
2016-05-17 22:31:10,068 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14635242697920_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14635242697920_0001_m_000000_0
2016-05-17 22:31:10,071 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14635242697920_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-05-17 22:31:10,071 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,072 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524269792_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:10,072 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:10,072 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:10,074 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,074 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FDFE6F8A49CE4E0599308FD52544A544, mem on close (mb), free: 166, total: 397, max: 672
2016-05-17 22:31:10 Completed running task attempt: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,075 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:10,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1463524270059, Process_Duration=14, Process_End_Time=1463524270073, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=13, Tuples_Written=13]]
2016-05-17 22:31:10,076 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:10,076 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, taskAttemptId=attempt_1463524269792_0001_1_00_000000_0, startTime=1463524269997, finishTime=1463524270076, timeTaken=79, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1463524270059, Process_Duration=14, Process_End_Time=1463524270073, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-05-17 22:31:10,077 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524269792_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:10,077 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10,076 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:31:10,078 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,078 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524269792_0001_00_000001
2016-05-17 22:31:10,079 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:10,079 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:10,080 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:TASK_FINISHED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, taskId=task_1463524269792_0001_1_00_000000, startTime=1463524269997, finishTime=1463524270077, timeTaken=80, status=SUCCEEDED, successfulAttemptID=attempt_1463524269792_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1463524270059, Process_Duration=14, Process_End_Time=1463524270073, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-05-17 22:31:10,080 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524269792_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:10,080 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] : 1
2016-05-17 22:31:10,080 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:10,082 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:10,082 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:VERTEX_FINISHED]: vertexName=FDFE6F8A49CE4E0599308FD52544A544, vertexId=vertex_1463524269792_0001_1_00, initRequestedTime=1463524269969, initedTime=1463524269983, startRequestedTime=1463524269984, startedTime=1463524269984, finishTime=1463524270080, timeTaken=96, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1463524270059, Process_Duration=14, Process_End_Time=1463524270073, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13, vertexStats=firstTaskStartTime=1463524269997, firstTasksToStart=[ task_1463524269792_0001_1_00_000000 ], lastTaskFinishTime=1463524270076, lastTasksToFinish=[ task_1463524269792_0001_1_00_000000 ], minTaskDuration=79, maxTaskDuration=79, avgTaskDuration=79.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524269792_0001_1_00_000000 ], longestDurationTasks=[ task_1463524269792_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:10,082 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:10,082 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:10,083 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:10,083 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524269792_0001_1
2016-05-17 22:31:10,083 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524269792_0001_1
2016-05-17 22:31:10,083 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: E307C12E3ACA4CB9B084E9510B6FD81D for vertex: vertex_1463524269792_0001_1_00 [FDFE6F8A49CE4E0599308FD52544A544]
2016-05-17 22:31:10,091 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524269792_0001_1, queueSize=0
2016-05-17 22:31:10,091 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:10,093 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524269792_0001_1, startTime=1463524269969, finishTime=1463524270090, timeTaken=121, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1463524270059, Process_Duration=14, Process_End_Time=1463524270073, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-05-17 22:31:10,093 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524269792_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:10,093 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524269792_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:10,093 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:10,094 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524269792_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524269792_0001_00_000001, stoppedTime=1463524270093, exitStatus=0
2016-05-17 22:31:10,094 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:10 Completed Dag: dag_1463524269792_0001_1
2016-05-17 22:31:10,095 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524269792_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:10,095 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524269792_0001_1_post
2016-05-17 22:31:10,095 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,096 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:10,096 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1463524269792_0001_00_000001. Relying on regular task shutdown for it to end
2016-05-17 22:31:10,096 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524269792_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-05-17 22:31:10,101 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...0100A4661B094E4B3E6586118, applicationId=application_1463524269792_0001
2016-05-17 22:31:10,104 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:10,104 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:10,104 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:10,104 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:10,104 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:10,104 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:10,105 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:10,105 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:10,105 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:10,106 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:10,106 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:10,106 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:10,106 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:10,107 INFO  task.TezChild (TezChild.java:run(198)) - Interrupted while waiting for new work for container container_1463524269792_0001_00_000001
2016-05-17 22:31:10,107 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524269792_0001_00_000001
2016-05-17 22:31:10,107 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524269792_0001_00_000001
2016-05-17 22:31:10,113 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/DF9FFD2B309A43BEB18F3CB339E2E99E/E45F11DF5F18463CA2EA30BE847628D2/.tez/application_1463524269792_0001
2016-05-17 22:31:10,114 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  completed in: 00:00.344
2016-05-17 22:31:10,246 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-05-17 22:31:10,246 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-05-17 22:31:10,310 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:10,311 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:10,352 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-05-17 22:31:10,362 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-05-17 22:31:10,362 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:10,362 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:10,363 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:10,378 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-05-17 22:31:10,379 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header
2016-05-17 22:31:10,392 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:10,392 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:10,392 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-05-17 22:31:10,393 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  parallel execution of steps is enabled: false
2016-05-17 22:31:10,393 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  executing total steps: 1
2016-05-17 22:31:10,394 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  allocating management threads: 1
2016-05-17 22:31:10,395 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...latform/testHeader/header
2016-05-17 22:31:10,395 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:10,409 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:10,413 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:10,414 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:10,414 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:10,423 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001 doesn't exist and is created
2016-05-17 22:31:10,440 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:10,440 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:10,441 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001
2016-05-17 22:31:10,445 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524270413_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:10,456 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:10,457 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:10,459 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:10,459 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:10,459 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001/localmode-log-dir
2016-05-17 22:31:10,459 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001/localmode-log-dir/history.txt.appattempt_1463524270413_0001_000000, maxErrors=10
2016-05-17 22:31:10,460 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:10,460 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524270413_0001_000000, appSubmitTime=1463524270444, launchTime=1463524270445
2016-05-17 22:31:10,464 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:10,465 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:10,468 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:10,468 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:10,469 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:42678
2016-05-17 22:31:10,471 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:10,473 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524270413_0001_000000, startTime=1463524270473
2016-05-17 22:31:10,473 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:10,474 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:10,541 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:10,541 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:10,541 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1463524270413_0001, dagName=[733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header
2016-05-17 22:31:10,559 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header
2016-05-17 22:31:10,561 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524270413_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001/localmode-log-dir/dag_1463524270413_0001_1.dot
2016-05-17 22:31:10,561 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001/localmode-log-dir/dag_1463524270413_0001_1-tez-dag.pb.txt
2016-05-17 22:31:10,572 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524270413_0001_1
2016-05-17 22:31:10,572 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,572 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header
2016-05-17 22:31:10 Running Dag: dag_1463524270413_0001_1
2016-05-17 22:31:10,585 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:10,586 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524270413_0001_1, submitTime=1463524270559
2016-05-17 22:31:10,586 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F2FFD5752CB346C4B32D0AFB28A083E0
2016-05-17 22:31:10,586 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:10,587 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:10,587 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524270413_0001_1, initTime=1463524270586
2016-05-17 22:31:10,588 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270413_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:10,590 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:DAG_STARTED]: dagID=dag_1463524270413_0001_1, startTime=1463524270590
2016-05-17 22:31:10,590 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:10,590 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:10,590 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270413_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:10,590 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F2FFD5752CB346C4B32D0AFB28A083E0 : {7B84F00CDA334593A8D2F6D1BBF27460={InputName=7B84F00CDA334593A8D2F6D1BBF27460}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:10,591 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 7B84F00CDA334593A8D2F6D1BBF27460, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:10,591 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,591 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,591 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,591 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]. Starting root input initializers: 1
2016-05-17 22:31:10,590 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1463524270413_0001, dagName=[733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header
2016-05-17 22:31:10,594 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:10,594 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 7B84F00CDA334593A8D2F6D1BBF27460 on vertex vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,596 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:10,596 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 7B84F00CDA334593A8D2F6D1BBF27460 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:10,597 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:10,597 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:10,600 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-05-17 22:31:10,600 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 7B84F00CDA334593A8D2F6D1BBF27460 on vertex vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,601 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:10,601 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {7B84F00CDA334593A8D2F6D1BBF27460=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:10,601 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] parallelism set to 1
2016-05-17 22:31:10,601 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:10,602 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524270413_0001_1_00, eventCount=1
2016-05-17 22:31:10,602 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,602 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=77A21CDB162C4379956547CC1384E7AB, vertexId=vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:10,602 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=77A21CDB162C4379956547CC1384E7AB, vertexId=vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,604 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=77A21CDB162C4379956547CC1384E7AB, vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:10,604 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=77A21CDB162C4379956547CC1384E7AB, vertexId=vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,606 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, vertexId=vertex_1463524270413_0001_1_00, initRequestedTime=1463524270590, initedTime=1463524270606, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:10,606 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:10,606 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] with distanceFromRoot: 0
2016-05-17 22:31:10,606 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:10,606 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F2FFD5752CB346C4B32D0AFB28A083E0
2016-05-17 22:31:10,607 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,607 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:10,607 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524270413_0001_1_00, startRequestedTime=1463524270606, startedTime=1463524270606
2016-05-17 22:31:10,607 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:10,608 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:10,608 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:TASK_STARTED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, taskId=task_1463524270413_0001_1_00_000000, scheduledTime=1463524270608, launchTime=1463524270608
2016-05-17 22:31:10,608 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270413_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:10,608 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,609 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header, VertexName: F2FFD5752CB346C4B32D0AFB28A083E0, VertexParallelism: 1, TaskAttemptID:attempt_1463524270413_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=7B84F00CDA334593A8D2F6D1BBF27460, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=77A21CDB162C4379956547CC1384E7AB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:10,609 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270413_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:10,609 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:10,610 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:10,611 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:10,612 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:10,612 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524270413_0001_00_000001
2016-05-17 22:31:10,612 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:10,614 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524270413_0001, with dag id: dag_1463524270413_0001_1
2016-05-17 22:31:10,614 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463524270413_0001_00_000001
2016-05-17 22:31:10,615 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:10,617 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:10,618 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524270413_0001_00_000001, launchTime=1463524270617
2016-05-17 22:31:10,618 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:10,620 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524270413_0001_00_000001
2016-05-17 22:31:10,621 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524270413_0001_1_00_000000_0] to container: [container_1463524270413_0001_00_000001]
2016-05-17 22:31:10,621 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:10,621 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524270413_0001_00_000001 given task: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,622 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524270413_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,622 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524270413_0001_1_00_000000_0] started. Is using containerId: [container_1463524270413_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:10,626 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:10 Starting to run new task attempt: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,626 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,627 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,626 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0, startTime=1463524270622, containerId=container_1463524270413_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524270413_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:10,628 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270413_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:10,628 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270413_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:10,628 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:10,630 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:10,630 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:10,630 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:10,630 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:10,630 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB] pipe/(1/1) ...latform/testHeader/header, VertexName: F2FFD5752CB346C4B32D0AFB28A083E0, VertexParallelism: 1, TaskAttemptID:attempt_1463524270413_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=7B84F00CDA334593A8D2F6D1BBF27460, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=77A21CDB162C4379956547CC1384E7AB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:10,630 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:10,631 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,631 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:10,631 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,632 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=7B84F00CDA334593A8D2F6D1BBF27460, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:10,632 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=77A21CDB162C4379956547CC1384E7AB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:10,632 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,635 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:10,635 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524270413_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:10,635 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,634 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:10,636 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 77A21CDB162C4379956547CC1384E7AB
2016-05-17 22:31:10,637 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:10,637 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 77A21CDB162C4379956547CC1384E7AB
2016-05-17 22:31:10,640 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:10,641 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:10,641 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,641 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,649 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F2FFD5752CB346C4B32D0AFB28A083E0, ordinal: 0
2016-05-17 22:31:10,649 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F2FFD5752CB346C4B32D0AFB28A083E0, mem on start (mb), free: 262, total: 362, max: 672
2016-05-17 22:31:10,650 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:10,650 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:10,650 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:10,652 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:10,652 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 77A21CDB162C4379956547CC1384E7AB
2016-05-17 22:31:10,652 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:10,653 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:10,653 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:10,653 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:10,653 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:10,653 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:10,654 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:10,654 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:10,654 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 7B84F00CDA334593A8D2F6D1BBF27460, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:10,654 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 77A21CDB162C4379956547CC1384E7AB, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:10,654 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:10,654 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 7B84F00CDA334593A8D2F6D1BBF27460 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:10,654 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:10,655 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:10,655 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,655 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:10,655 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,655 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:10,656 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,656 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:10,657 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1c962a81
2016-05-17 22:31:10,658 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1c962a81
2016-05-17 22:31:10,658 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:10,658 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:10,660 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:10,661 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 7B84F00CDA334593A8D2F6D1BBF27460
2016-05-17 22:31:10,661 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"], id: 77A21CDB162C4379956547CC1384E7AB
2016-05-17 22:31:10,661 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-05-17 22:31:10,661 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-05-17 22:31:10,662 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:10,662 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F2FFD5752CB346C4B32D0AFB28A083E0, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:10,666 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:10,666 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:10,666 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,667 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524270413_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:10,667 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,668 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F2FFD5752CB346C4B32D0AFB28A083E0, mem on close (mb), free: 260, total: 362, max: 672
2016-05-17 22:31:10 Completed running task attempt: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,669 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0, fatalErrorOccurred=false
2016-05-17 22:31:10,669 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1463524270663, Process_Duration=4, Process_End_Time=1463524270667, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-05-17 22:31:10,670 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:10,670 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-05-17 22:31:10,670 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,670 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524270413_0001_00_000001
2016-05-17 22:31:10,670 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, taskAttemptId=attempt_1463524270413_0001_1_00_000000_0, startTime=1463524270622, finishTime=1463524270669, timeTaken=47, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524270663, Process_Duration=4, Process_End_Time=1463524270667, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:10,670 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270413_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-05-17 22:31:10,671 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:10,671 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10,673 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:TASK_FINISHED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, taskId=task_1463524270413_0001_1_00_000000, startTime=1463524270622, finishTime=1463524270671, timeTaken=49, status=SUCCEEDED, successfulAttemptID=attempt_1463524270413_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524270663, Process_Duration=4, Process_End_Time=1463524270667, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:10,673 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:10,673 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270413_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-05-17 22:31:10,674 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] : 1
2016-05-17 22:31:10,674 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,676 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:10,676 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:VERTEX_FINISHED]: vertexName=F2FFD5752CB346C4B32D0AFB28A083E0, vertexId=vertex_1463524270413_0001_1_00, initRequestedTime=1463524270590, initedTime=1463524270606, startRequestedTime=1463524270606, startedTime=1463524270606, finishTime=1463524270674, timeTaken=68, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524270663, Process_Duration=4, Process_End_Time=1463524270667, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1463524270622, firstTasksToStart=[ task_1463524270413_0001_1_00_000000 ], lastTaskFinishTime=1463524270669, lastTasksToFinish=[ task_1463524270413_0001_1_00_000000 ], minTaskDuration=47, maxTaskDuration=47, avgTaskDuration=47.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1463524270413_0001_1_00_000000 ], longestDurationTasks=[ task_1463524270413_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-05-17 22:31:10,676 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-05-17 22:31:10,677 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-05-17 22:31:10,678 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524270413_0001_00_000001, stoppedTime=1463524270678, exitStatus=0
2016-05-17 22:31:10,678 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:10,678 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:10,679 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-05-17 22:31:10,679 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524270413_0001_1
2016-05-17 22:31:10,679 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1463524270413_0001_1
2016-05-17 22:31:10,679 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 77A21CDB162C4379956547CC1384E7AB for vertex: vertex_1463524270413_0001_1_00 [F2FFD5752CB346C4B32D0AFB28A083E0]
2016-05-17 22:31:10,680 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1463524270413_0001_00_000001 is valid, but no longer registered, and will be killed
2016-05-17 22:31:10,681 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524270413_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-05-17 22:31:10,681 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1463524270413_0001_00_000001, Exiting
2016-05-17 22:31:10,681 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524270413_0001_00_000001
2016-05-17 22:31:10,681 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524270413_0001_00_000001
2016-05-17 22:31:10,684 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524270413_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-05-17 22:31:10,685 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1463524270413_0001_00_000001 completed successfully
2016-05-17 22:31:10,691 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524270413_0001_1, queueSize=0
2016-05-17 22:31:10,692 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:10,692 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270413_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524270413_0001_1, startTime=1463524270590, finishTime=1463524270690, timeTaken=100, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1463524270663, Process_Duration=4, Process_End_Time=1463524270667, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-05-17 22:31:10,692 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524270413_0001_1 finished with state: SUCCEEDED
2016-05-17 22:31:10,693 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270413_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:10,693 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524270413_0001_00_000001
2016-05-17 22:31:10,693 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270413_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:10 Completed Dag: dag_1463524270413_0001_1
2016-05-17 22:31:10,694 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524270413_0001_1, dagState=SUCCEEDED
2016-05-17 22:31:10,694 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524270413_0001_1_post
2016-05-17 22:31:10,694 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:10,694 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:10,700 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1463524270413_0001
2016-05-17 22:31:10,702 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:10,703 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:10,703 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:10,703 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:10,703 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:10,703 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:10,704 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:10,704 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:10,705 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:10,705 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:10,705 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:10,705 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:10,706 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:10,710 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/733C6F66B1C24A7E98659C8D410F67DB/BC45FDE3FB994E66A9874AC1873EADEB/.tez/application_1463524270413_0001
2016-05-17 22:31:10,710 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header/_temporary
2016-05-17 22:31:10,711 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  completed in: 00:00.318
2016-05-17 22:31:10,747 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeader/header
2016-05-17 22:31:10,774 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-17 22:31:10,774 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(151)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.1.0/226af02e24d5195c60e4ebe911d0c7c9780f59f0/cascading-hadoop2-tez-3.1.0.jar
2016-05-17 22:31:10,820 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-05-17 22:31:10,828 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-05-17 22:31:10,829 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:10,829 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-17 22:31:10,829 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-17 22:31:10,846 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt
2016-05-17 22:31:10,847 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic
2016-05-17 22:31:10,857 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting
2016-05-17 22:31:10,857 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-05-17 22:31:10,857 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-05-17 22:31:10,857 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  parallel execution of steps is enabled: false
2016-05-17 22:31:10,857 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  executing total steps: 1
2016-05-17 22:31:10,858 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  allocating management threads: 1
2016-05-17 22:31:10,859 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] starting step: (1/1) ...t/strict-nondeterministic
2016-05-17 22:31:10,859 WARN  flow.Flow (BaseFlow.java:logWarn(1516)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-05-17 22:31:10,872 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] tez session mode enabled: true
2016-05-17 22:31:10,876 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:10,877 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-05-17 22:31:10,878 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-05-17 22:31:10,888 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001 doesn't exist and is created
2016-05-17 22:31:10,904 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-05-17 22:31:10,905 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-05-17 22:31:10,905 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001
2016-05-17 22:31:10,909 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1463524270877_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-05-17 22:31:10,921 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-05-17 22:31:10,922 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-05-17 22:31:10,923 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-05-17 22:31:10,924 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-05-17 22:31:10,924 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001/localmode-log-dir
2016-05-17 22:31:10,925 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001/localmode-log-dir/history.txt.appattempt_1463524270877_0001_000000, maxErrors=10
2016-05-17 22:31:10,925 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-05-17 22:31:10,925 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1463524270877_0001_000000, appSubmitTime=1463524270908, launchTime=1463524270908
2016-05-17 22:31:10,932 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-05-17 22:31:10,933 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-05-17 22:31:10,935 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-123-148-208.ec2.internal/10.123.148.208:56117
2016-05-17 22:31:10,940 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-05-17 22:31:10,940 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-05-17 22:31:10,942 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-05-17 22:31:10,944 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1463524270877_0001_000000, startTime=1463524270944
2016-05-17 22:31:10,944 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-05-17 22:31:10,944 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-05-17 22:31:11,005 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-05-17 22:31:11,005 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-05-17 22:31:11,005 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1463524270877_0001, dagName=[95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic
2016-05-17 22:31:11,022 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic
2016-05-17 22:31:11,024 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1463524270877_0001_1, filePath=/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001/localmode-log-dir/dag_1463524270877_0001_1.dot
2016-05-17 22:31:11,024 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001/localmode-log-dir/dag_1463524270877_0001_1-tez-dag.pb.txt
2016-05-17 22:31:11,030 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524270877_0001_1
2016-05-17 22:31:11,030 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:11,030 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic
2016-05-17 22:31:11 Running Dag: dag_1463524270877_0001_1
2016-05-17 22:31:11,042 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-05-17 22:31:11,043 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1463524270877_0001_1, submitTime=1463524271022
2016-05-17 22:31:11,044 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C0B1175D479444CABBDF066CF79D44D3
2016-05-17 22:31:11,044 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-05-17 22:31:11,044 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-05-17 22:31:11,045 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1463524270877_0001_1, initTime=1463524271043
2016-05-17 22:31:11,045 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270877_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-05-17 22:31:11,045 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:DAG_STARTED]: dagID=dag_1463524270877_0001_1, startTime=1463524271045
2016-05-17 22:31:11,046 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-05-17 22:31:11,045 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-05-17 22:31:11,046 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270877_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-05-17 22:31:11,046 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C0B1175D479444CABBDF066CF79D44D3 : {D65CF4CE93DB4F30BA47B12306638B00={InputName=D65CF4CE93DB4F30BA47B12306638B00}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-05-17 22:31:11,046 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: D65CF4CE93DB4F30BA47B12306638B00, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-05-17 22:31:11,046 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,047 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,047 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,047 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1463524270877_0001, dagName=[95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic
2016-05-17 22:31:11,047 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]. Starting root input initializers: 1
2016-05-17 22:31:11,048 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] transitioned from NEW to INITIALIZING due to event V_INIT
2016-05-17 22:31:11,048 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: D65CF4CE93DB4F30BA47B12306638B00 on vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,050 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-05-17 22:31:11,050 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input D65CF4CE93DB4F30BA47B12306638B00 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-05-17 22:31:11,051 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-05-17 22:31:11,051 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-05-17 22:31:11,053 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 432
2016-05-17 22:31:11,053 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: D65CF4CE93DB4F30BA47B12306638B00 on vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,054 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:11,054 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {D65CF4CE93DB4F30BA47B12306638B00=forAllWorkUnits=true, update=[1]}
2016-05-17 22:31:11,054 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] parallelism set to 1
2016-05-17 22:31:11,054 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-05-17 22:31:11,055 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1463524270877_0001_1_00, eventCount=1
2016-05-17 22:31:11,055 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,055 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=153E95D185734F2EB3CE26B25D70E426, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-05-17 22:31:11,055 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=153E95D185734F2EB3CE26B25D70E426, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,057 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=153E95D185734F2EB3CE26B25D70E426, vertexName=C0B1175D479444CABBDF066CF79D44D3, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-05-17 22:31:11,057 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=153E95D185734F2EB3CE26B25D70E426, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,059 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-05-17 22:31:11,059 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, vertexId=vertex_1463524270877_0001_1_00, initRequestedTime=1463524271046, initedTime=1463524271059, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-05-17 22:31:11,059 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] with distanceFromRoot: 0
2016-05-17 22:31:11,059 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-05-17 22:31:11,060 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C0B1175D479444CABBDF066CF79D44D3
2016-05-17 22:31:11,060 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,060 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1463524270877_0001_1_00, startRequestedTime=1463524271060, startedTime=1463524271060
2016-05-17 22:31:11,060 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] transitioned from INITED to RUNNING due to event V_START
2016-05-17 22:31:11,060 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-05-17 22:31:11,061 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-05-17 22:31:11,061 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:TASK_STARTED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, taskId=task_1463524270877_0001_1_00_000000, scheduledTime=1463524271061, launchTime=1463524271061
2016-05-17 22:31:11,061 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270877_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-05-17 22:31:11,061 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,061 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic, VertexName: C0B1175D479444CABBDF066CF79D44D3, VertexParallelism: 1, TaskAttemptID:attempt_1463524270877_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D65CF4CE93DB4F30BA47B12306638B00, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=153E95D185734F2EB3CE26B25D70E426, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:11,062 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270877_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-05-17 22:31:11,062 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-05-17 22:31:11,063 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-05-17 22:31:11,065 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-05-17 22:31:11,065 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-05-17 22:31:11,066 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1463524270877_0001_00_000001
2016-05-17 22:31:11,066 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270877_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-05-17 22:31:11,066 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] submitted tez dag to app master: application_1463524270877_0001, with dag id: dag_1463524270877_0001_1
2016-05-17 22:31:11,069 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1463524270877_0001_00_000001
2016-05-17 22:31:11,069 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-05-17 22:31:11,071 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-05-17 22:31:11,072 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270877_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-05-17 22:31:11,072 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1463524270877_0001_00_000001, launchTime=1463524271071
2016-05-17 22:31:11,074 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1463524270877_0001_00_000001
2016-05-17 22:31:11,076 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1463524270877_0001_1_00_000000_0] to container: [container_1463524270877_0001_00_000001]
2016-05-17 22:31:11,076 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270877_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-05-17 22:31:11,076 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1463524270877_0001_00_000001 given task: attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,076 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1463524270877_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,076 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1463524270877_0001_1_00_000000_0] started. Is using containerId: [container_1463524270877_0001_00_000001] on NM: [127.0.0.1:0]
2016-05-17 22:31:11 Starting to run new task attempt: attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,077 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,077 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:11,077 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-05-17 22:31:11,077 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-05-17 22:31:11,078 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-05-17 22:31:11,078 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-05-17 22:31:11,078 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-05-17 22:31:11,078 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E] pipe/(1/1) ...t/strict-nondeterministic, VertexName: C0B1175D479444CABBDF066CF79D44D3, VertexParallelism: 1, TaskAttemptID:attempt_1463524270877_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D65CF4CE93DB4F30BA47B12306638B00, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=153E95D185734F2EB3CE26B25D70E426, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-05-17 22:31:11,078 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-05-17 22:31:11,078 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-05-17 22:31:11,078 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, taskAttemptId=attempt_1463524270877_0001_1_00_000000_0, startTime=1463524271076, containerId=container_1463524270877_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1463524270877_0001_00_000001/teamcity, completedLogs=
2016-05-17 22:31:11,079 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270877_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-05-17 22:31:11,079 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-05-17 22:31:11,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:11,079 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270877_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-05-17 22:31:11,081 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:11,081 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=D65CF4CE93DB4F30BA47B12306638B00, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-05-17 22:31:11,081 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-05-17 22:31:11,082 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,082 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,081 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=153E95D185734F2EB3CE26B25D70E426, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-05-17 22:31:11,084 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-05-17 22:31:11,084 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 153E95D185734F2EB3CE26B25D70E426
2016-05-17 22:31:11,086 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-05-17 22:31:11,083 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-05-17 22:31:11,086 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 153E95D185734F2EB3CE26B25D70E426
2016-05-17 22:31:11,086 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-05-17 22:31:11,087 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,087 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,085 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1463524270877_0001_1_00_000000_0 sent events: (0-1)
2016-05-17 22:31:11,084 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.1.0
2016-05-17 22:31:11,086 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-05-17 22:31:11,094 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C0B1175D479444CABBDF066CF79D44D3, ordinal: 0
2016-05-17 22:31:11,094 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C0B1175D479444CABBDF066CF79D44D3, mem on start (mb), free: 192, total: 362, max: 672
2016-05-17 22:31:11,094 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-05-17 22:31:11,095 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-05-17 22:31:11,095 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-05-17 22:31:11,097 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-05-17 22:31:11,097 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 153E95D185734F2EB3CE26B25D70E426
2016-05-17 22:31:11,097 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-05-17 22:31:11,098 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-05-17 22:31:11,098 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-05-17 22:31:11,098 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:11,099 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-05-17 22:31:11,099 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-05-17 22:31:11,099 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-05-17 22:31:11,099 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-05-17 22:31:11,100 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, D65CF4CE93DB4F30BA47B12306638B00, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-05-17 22:31:11,100 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 153E95D185734F2EB3CE26B25D70E426, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-05-17 22:31:11,100 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-05-17 22:31:11,101 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,101 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:11,101 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,101 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: D65CF4CE93DB4F30BA47B12306638B00 being auto started by the framework. Subsequent instances will not be auto-started
2016-05-17 22:31:11,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-05-17 22:31:11,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-05-17 22:31:11,102 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-05-17 22:31:11,103 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,103 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-05-17 22:31:11,103 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1642337a
2016-05-17 22:31:11,104 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1642337a
2016-05-17 22:31:11,105 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-05-17 22:31:11,105 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-05-17 22:31:11,107 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-05-17 22:31:11,107 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"] streamed: true, id: D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,107 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"], id: 153E95D185734F2EB3CE26B25D70E426
2016-05-17 22:31:11,108 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-05-17 22:31:11,108 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-05-17 22:31:11,108 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-05-17 22:31:11,109 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C0B1175D479444CABBDF066CF79D44D3, all 1 inputs ready in: 00:00:00.000
2016-05-17 22:31:11,112 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
2016-05-17 22:31:11,118 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
2016-05-17 22:31:11,122 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-05-17 22:31:11,123 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-05-17 22:31:11,123 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11,124 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1463524270877_0001_1_00_000000_0 given a go for committing the task output.
2016-05-17 22:31:11,125 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1463524270877_0001_1_00_000000_0
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
2016-05-17 22:31:11,134 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=655, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6][cascading.flow.SliceCounters Process_Begin_Time=1463524271109, Process_Duration=16, Process_End_Time=1463524271125, Read_Duration=1, Tuples_Read=6, Tuples_Written=6, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=6, Tuples_Written=6]]
2016-05-17 22:31:11,134 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C0B1175D479444CABBDF066CF79D44D3, mem on close (mb), free: 190, total: 362, max: 672
2016-05-17 22:31:11,134 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=C0B1175D479444CABBDF066CF79D44D3, index=0
2016-05-17 22:31:11,135 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=C0B1175D479444CABBDF066CF79D44D3, sourceVertex=D65CF4CE93DB4F30BA47B12306638B00
2016-05-17 22:31:11,135 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=C0B1175D479444CABBDF066CF79D44D3, sourceVertex=153E95D185734F2EB3CE26B25D70E426
2016-05-17 22:31:11,136 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1463524270877_0001_00_000001
2016-05-17 22:31:11,136 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1463524270877_0001_00_000001
2016-05-17 22:31:11,136 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-05-17 22:31:11,138 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, taskAttemptId=attempt_1463524270877_0001_1_00_000000_0, startTime=1463524271076, finishTime=1463524271134, timeTaken=58, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=655, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=380108800, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6, cascading.flow.SliceCounters, Process_Begin_Time=1463524271109, Process_Duration=16, Process_End_Time=1463524271125, Read_Duration=1, Tuples_Read=6, Tuples_Written=6, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=6, Tuples_Written=6
2016-05-17 22:31:11,140 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270877_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-05-17 22:31:11,140 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1463524270877_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-05-17 22:31:11,141 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:TASK_FINISHED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, taskId=task_1463524270877_0001_1_00_000000, startTime=1463524271076, finishTime=1463524271140, timeTaken=64, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
], counters=Counters: 0
2016-05-17 22:31:11,141 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1463524270877_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-05-17 22:31:11,141 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-05-17 22:31:11,141 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] : 1
2016-05-17 22:31:11,142 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] because task failed: task_1463524270877_0001_1_00_000000
2016-05-17 22:31:11,142 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] due to trigger: OWN_TASK_FAILURE
2016-05-17 22:31:11,143 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-05-17 22:31:11,143 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,144 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=153E95D185734F2EB3CE26B25D70E426, vertexId=vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,143 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-05-17 22:31:11,149 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:VERTEX_FINISHED]: vertexName=C0B1175D479444CABBDF066CF79D44D3, vertexId=vertex_1463524270877_0001_1_00, initRequestedTime=1463524271046, initedTime=1463524271059, startRequestedTime=1463524271060, startedTime=1463524271060, finishTime=1463524271148, timeTaken=88, status=FAILED, diagnostics=Task failed, taskId=task_1463524270877_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1463524271076, firstTasksToStart=[ task_1463524270877_0001_1_00_000000 ], lastTaskFinishTime=1463524271134, lastTasksToFinish=[ task_1463524270877_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-05-17 22:31:11,150 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-05-17 22:31:11,150 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1463524270877_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-05-17 22:31:11,154 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1463524270877_0001_00_000001 completed but with errors
2016-05-17 22:31:11,153 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-05-17 22:31:11,157 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-05-17 22:31:11,157 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1463524270877_0001_00_000001, stoppedTime=1463524271157, exitStatus=0
2016-05-17 22:31:11,157 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270877_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-05-17 22:31:11,157 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1463524270877_0001_1_00_000000_0 failed: true container: container_1463524270877_0001_00_000001 numFailedTAs: 0
2016-05-17 22:31:11,158 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-05-17 22:31:11,158 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-05-17 22:31:11,159 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1463524270877_0001_1
2016-05-17 22:31:11,159 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 153E95D185734F2EB3CE26B25D70E426 for vertex: vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3]
2016-05-17 22:31:11,160 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1463524270877_0001_1, queueSize=0
2016-05-17 22:31:11,160 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-05-17 22:31:11,160 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1463524270877_0001_1][Event:DAG_FINISHED]: dagId=dag_1463524270877_0001_1, startTime=1463524271045, finishTime=1463524271159, timeTaken=114, status=FAILED, diagnostics=Vertex failed, vertexName=C0B1175D479444CABBDF066CF79D44D3, vertexId=vertex_1463524270877_0001_1_00, diagnostics=[Task failed, taskId=task_1463524270877_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1463524270877_0001_1_00 [C0B1175D479444CABBDF066CF79D44D3] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-05-17 22:31:11,161 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1463524270877_0001_1 finished with state: FAILED
2016-05-17 22:31:11,161 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1463524270877_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-05-17 22:31:11,161 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1463524270877_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-05-17 22:31:11,161 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1463524270877_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-05-17 22:31:11,162 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1463524270877_0001_00_000001
2016-05-17 22:31:11 Completed Dag: dag_1463524270877_0001_1
2016-05-17 22:31:11,162 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1463524270877_0001_1, dagState=FAILED
2016-05-17 22:31:11,162 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1463524270877_0001_1_post
2016-05-17 22:31:11,162 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-05-17 22:31:11,162 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-05-17 22:31:11,163 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1463524270877_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-05-17 22:31:11,172 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1463524270877_0001
2016-05-17 22:31:11,174 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-05-17 22:31:11,175 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-05-17 22:31:11,175 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-05-17 22:31:11,175 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-05-17 22:31:11,175 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-05-17 22:31:11,176 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-05-17 22:31:11,176 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-05-17 22:31:11,176 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-05-17 22:31:11,177 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-05-17 22:31:11,177 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-05-17 22:31:11,177 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-05-17 22:31:11,177 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-05-17 22:31:11,178 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-05-17 22:31:11,183 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/95AE51933C1B499D99843CCCE09F50F4/D95B6875E4D749368E2C948E3A0C062E/.tez/application_1463524270877_0001
2016-05-17 22:31:11,183 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] stopping all jobs
2016-05-17 22:31:11,183 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] stopping: (1/1) ...t/strict-nondeterministic
2016-05-17 22:31:11,184 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe] stopped all jobs
2016-05-17 22:31:11,185 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic/_temporary
2016-05-17 22:31:11,185 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [pipe]  completed in: 00:00.327
2016-05-17 22:31:11,185 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/2f4c45215847827d/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic

Standard error

2016-05-17 22:31:05 Running Dag: dag_1463524264312_0001_1
2016-05-17 22:31:05 Starting to run new task attempt: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:05 Completed running task attempt: attempt_1463524264312_0001_1_00_000000_0
2016-05-17 22:31:06 Completed Dag: dag_1463524264312_0001_1
2016-05-17 22:31:06 Running Dag: dag_1463524266416_0001_1
2016-05-17 22:31:06 Starting to run new task attempt: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06 Completed running task attempt: attempt_1463524266416_0001_1_00_000000_0
2016-05-17 22:31:06 Completed Dag: dag_1463524266416_0001_1
2016-05-17 22:31:07 Running Dag: dag_1463524267156_0001_1
2016-05-17 22:31:07 Starting to run new task attempt: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07 Completed running task attempt: attempt_1463524267156_0001_1_00_000000_0
2016-05-17 22:31:07 Completed Dag: dag_1463524267156_0001_1
2016-05-17 22:31:07 Running Dag: dag_1463524267802_0001_1
2016-05-17 22:31:08 Starting to run new task attempt: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08 Completed running task attempt: attempt_1463524267802_0001_1_00_000000_0
2016-05-17 22:31:08 Completed Dag: dag_1463524267802_0001_1
2016-05-17 22:31:08 Running Dag: dag_1463524268376_0001_1
2016-05-17 22:31:08 Starting to run new task attempt: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08 Completed running task attempt: attempt_1463524268376_0001_1_00_000000_0
2016-05-17 22:31:08 Completed Dag: dag_1463524268376_0001_1
2016-05-17 22:31:09 Running Dag: dag_1463524269083_0001_1
2016-05-17 22:31:09 Starting to run new task attempt: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09 Completed running task attempt: attempt_1463524269083_0001_1_00_000000_0
2016-05-17 22:31:09 Completed Dag: dag_1463524269083_0001_1
2016-05-17 22:31:09 Running Dag: dag_1463524269792_0001_1
2016-05-17 22:31:09 Starting to run new task attempt: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10 Completed running task attempt: attempt_1463524269792_0001_1_00_000000_0
2016-05-17 22:31:10 Completed Dag: dag_1463524269792_0001_1
May 17, 2016 10:31:10 PM com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair execute
SEVERE: RuntimeException while executing runnable com.google.common.util.concurrent.Futures$6@f105b77 with executor java.util.concurrent.ThreadPoolExecutor@7ae4e95a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
java.util.concurrent.RejectedExecutionException: Task com.google.common.util.concurrent.Futures$6@f105b77 rejected from java.util.concurrent.ThreadPoolExecutor@7ae4e95a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
	at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149)
	at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134)
	at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86)
	at java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:380)
	at java.util.concurrent.FutureTask.set(FutureTask.java:229)
	at java.util.concurrent.FutureTask.run(FutureTask.java:270)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

2016-05-17 22:31:10 Running Dag: dag_1463524270413_0001_1
2016-05-17 22:31:10 Starting to run new task attempt: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10 Completed running task attempt: attempt_1463524270413_0001_1_00_000000_0
2016-05-17 22:31:10 Completed Dag: dag_1463524270413_0001_1
2016-05-17 22:31:11 Running Dag: dag_1463524270877_0001_1
2016-05-17 22:31:11 Starting to run new task attempt: attempt_1463524270877_0001_1_00_000000_0
2016-05-17 22:31:11 Completed Dag: dag_1463524270877_0001_1