2016-01-14 18:24:26,788 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 18:24:26,816 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.scheme.TextDelimitedPlatformTest, with platform: hadoop2-tez
2016-01-14 18:24:26,851 INFO tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-01-14 18:24:27,417 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 18:24:27,734 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 18:24:27,932 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:24:27,933 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:24:28,017 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 7B0B23465618403983D77DFEFAFBE59C
2016-01-14 18:24:28,206 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.069
2016-01-14 18:24:28,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.080
2016-01-14 18:24:28,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:28,218 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:28,219 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:24:28,375 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-01-14 18:24:28,377 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-01-14 18:24:28,558 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 18:24:28,560 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 18:24:28,560 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 18:24:28,561 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-01-14 18:24:28,561 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 18:24:28,562 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 18:24:28,562 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 18:24:28,563 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...Char/quoted/speccharfalse
2016-01-14 18:24:28,563 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:24:28,584 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 18:24:28,753 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:28,763 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:24:28,763 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:24:28,838 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F/.tez/application_1452795868762_0001 doesn't exist and is created
2016-01-14 18:24:28,926 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:24:28,926 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:28,927 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F/.tez/application_1452795868762_0001
2016-01-14 18:24:28,973 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452795868762_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:29,018 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:24:29,027 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-01-14 18:24:29,027 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-01-14 18:24:29,027 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:29,033 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:24:29,055 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:24:29,061 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:24:29,065 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F/.tez/application_1452795868762_0001/localmode-log-dir
2016-01-14 18:24:29,066 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F/.tez/application_1452795868762_0001/localmode-log-dir/history.txt.appattempt_1452795868762_0001_000000, maxErrors=10
2016-01-14 18:24:29,067 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:24:29,069 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452795868762_0001_000000, appSubmitTime=1452795868957, launchTime=1452795868972
2016-01-14 18:24:29,075 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:24:29,075 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:24:29,077 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:24:29,077 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:24:29,127 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 18:24:29,128 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 18:24:29,128 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:29,136 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:37866
2016-01-14 18:24:29,164 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:24:29,228 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 18:24:29,228 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 18:24:29,229 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:29,243 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:24:29,243 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452795868762_0001_000000, startTime=1452795869242
2016-01-14 18:24:29,243 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:24:29,329 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:24:29,346 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:24:29,346 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452795868762_0001, dagName=[8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 18:24:29,572 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 18:24:29,675 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452795868762_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F/.tez/application_1452795868762_0001/localmode-log-dir/dag_1452795868762_0001_1.dot
2016-01-14 18:24:29,679 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F/.tez/application_1452795868762_0001/localmode-log-dir/dag_1452795868762_0001_1-tez-dag.pb.txt
2016-01-14 18:24:29,790 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795868762_0001_1
2016-01-14 18:24:29,790 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:29,791 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 18:24:29 Running Dag: dag_1452795868762_0001_1
2016-01-14 18:24:29,815 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:24:29,818 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452795868762_0001_1, submitTime=1452795869572
2016-01-14 18:24:29,850 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BDFBF67650D14DBEB6702D1DBD36F5CE
2016-01-14 18:24:29,852 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:24:29,854 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:24:29,855 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452795868762_0001_1, initTime=1452795869819
2016-01-14 18:24:29,855 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795868762_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:24:29,857 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:DAG_STARTED]: dagID=dag_1452795868762_0001_1, startTime=1452795869856
2016-01-14 18:24:29,857 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:24:29,858 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:24:29,859 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795868762_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:24:29,860 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BDFBF67650D14DBEB6702D1DBD36F5CE : {34819669F26E4016B7543FE274FAB126={InputName=34819669F26E4016B7543FE274FAB126}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:24:29,860 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 34819669F26E4016B7543FE274FAB126, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:24:29,860 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:29,869 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:29,870 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:29,870 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452795868762_0001, dagName=[8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 18:24:29,874 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]. Starting root input initializers: 1
2016-01-14 18:24:29,886 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 34819669F26E4016B7543FE274FAB126 on vertex vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:29,893 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:24:29,916 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:24:29,919 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 34819669F26E4016B7543FE274FAB126 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:24:29,920 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:24:29,920 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:24:29,924 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452795868762_0001, with dag id: dag_1452795868762_0001_1
2016-01-14 18:24:29,973 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-01-14 18:24:29,976 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 34819669F26E4016B7543FE274FAB126 on vertex vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:29,977 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:29,977 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {34819669F26E4016B7543FE274FAB126=forAllWorkUnits=true, update=[1]}
2016-01-14 18:24:30,028 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE] parallelism set to 1
2016-01-14 18:24:30,029 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:30,037 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452795868762_0001_1_00, eventCount=1
2016-01-14 18:24:30,040 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:30,040 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=868D62E12FB54566A9C3D04EBEA5ED66, vertexId=vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:24:30,043 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=868D62E12FB54566A9C3D04EBEA5ED66, vertexId=vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:30,062 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=868D62E12FB54566A9C3D04EBEA5ED66, vertexName=BDFBF67650D14DBEB6702D1DBD36F5CE, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:24:30,070 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=868D62E12FB54566A9C3D04EBEA5ED66, vertexId=vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:30,073 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:24:30,073 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BDFBF67650D14DBEB6702D1DBD36F5CE, vertexId=vertex_1452795868762_0001_1_00, initRequestedTime=1452795869859, initedTime=1452795870072, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:24:30,074 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE] with distanceFromRoot: 0
2016-01-14 18:24:30,074 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:24:30,077 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BDFBF67650D14DBEB6702D1DBD36F5CE
2016-01-14 18:24:30,077 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:30,078 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:24:30,078 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452795868762_0001_1_00, startRequestedTime=1452795870076, startedTime=1452795870076
2016-01-14 18:24:30,079 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:24:30,100 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:24:30,100 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:TASK_STARTED]: vertexName=BDFBF67650D14DBEB6702D1DBD36F5CE, taskId=task_1452795868762_0001_1_00_000000, scheduledTime=1452795870099, launchTime=1452795870099
2016-01-14 18:24:30,101 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795868762_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:24:30,104 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:30,106 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: BDFBF67650D14DBEB6702D1DBD36F5CE, VertexParallelism: 1, TaskAttemptID:attempt_1452795868762_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=34819669F26E4016B7543FE274FAB126, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=868D62E12FB54566A9C3D04EBEA5ED66, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:30,109 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795868762_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:24:30,109 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:24:30,146 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:24:30,151 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:24:30,151 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:24:30,157 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452795868762_0001_00_000001
2016-01-14 18:24:30,157 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795868762_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:24:30,171 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452795868762_0001_00_000001
2016-01-14 18:24:30,171 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:24:30,178 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795868762_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:24:30,178 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:24:30,179 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452795868762_0001_00_000001, launchTime=1452795870178
2016-01-14 18:24:30,184 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795868762_0001_00_000001
2016-01-14 18:24:30,187 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452795868762_0001_1_00_000000_0] to container: [container_1452795868762_0001_00_000001]
2016-01-14 18:24:30,187 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795868762_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:24:30,188 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452795868762_0001_00_000001 given task: attempt_1452795868762_0001_1_00_000000_0
2016-01-14 18:24:30,188 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795868762_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452795868762_0001_1_00_000000_0
2016-01-14 18:24:30 Starting to run new task attempt: attempt_1452795868762_0001_1_00_000000_0
2016-01-14 18:24:30,189 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452795868762_0001_1_00_000000_0
2016-01-14 18:24:30,190 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:30,190 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452795868762_0001_1_00_000000_0] started. Is using containerId: [container_1452795868762_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:24:30,191 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:24:30,192 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:24:30,192 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:24:30,193 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:24:30,193 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BDFBF67650D14DBEB6702D1DBD36F5CE, taskAttemptId=attempt_1452795868762_0001_1_00_000000_0, startTime=1452795870188, containerId=container_1452795868762_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452795868762_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:24:30,194 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795868762_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:24:30,194 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:24:30,195 INFO counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-01-14 18:24:30,198 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795868762_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:24:30,217 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:24:30,217 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: BDFBF67650D14DBEB6702D1DBD36F5CE, VertexParallelism: 1, TaskAttemptID:attempt_1452795868762_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=34819669F26E4016B7543FE274FAB126, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=868D62E12FB54566A9C3D04EBEA5ED66, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:30,219 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:24:30,223 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452795868762_0001_1_00_000000_0
2016-01-14 18:24:30,224 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:24:30,224 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:30,228 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452795868762_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:24:30,231 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=34819669F26E4016B7543FE274FAB126, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:24:30,233 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:30,233 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=868D62E12FB54566A9C3D04EBEA5ED66, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:24:30,233 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:24:30,234 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 34819669F26E4016B7543FE274FAB126
2016-01-14 18:24:30,234 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:24:30,235 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 868D62E12FB54566A9C3D04EBEA5ED66
2016-01-14 18:24:30,235 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:24:30,239 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 34819669F26E4016B7543FE274FAB126
2016-01-14 18:24:30,239 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 868D62E12FB54566A9C3D04EBEA5ED66
2016-01-14 18:24:30,258 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:24:30,259 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 34819669F26E4016B7543FE274FAB126
2016-01-14 18:24:30,260 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:24:30,261 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 34819669F26E4016B7543FE274FAB126
2016-01-14 18:24:30,278 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:24:30,278 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 868D62E12FB54566A9C3D04EBEA5ED66
2016-01-14 18:24:30,280 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BDFBF67650D14DBEB6702D1DBD36F5CE, ordinal: 0
2016-01-14 18:24:30,281 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BDFBF67650D14DBEB6702D1DBD36F5CE, mem on start (mb), free: 241, total: 281, max: 672
2016-01-14 18:24:30,281 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:30,281 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:24:30,282 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:24:30,282 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:24:30,282 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:24:30,289 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:24:30,289 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:30,289 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:24:30,289 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:30,290 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:24:30,290 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:24:30,290 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 868D62E12FB54566A9C3D04EBEA5ED66, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:24:30,291 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 34819669F26E4016B7543FE274FAB126, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:24:30,291 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:24:30,292 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 34819669F26E4016B7543FE274FAB126
2016-01-14 18:24:30,292 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:30,293 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 34819669F26E4016B7543FE274FAB126
2016-01-14 18:24:30,293 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 34819669F26E4016B7543FE274FAB126 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:24:30,293 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:24:30,294 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:24:30,294 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:24:30,295 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452795868762_0001_1_00_000000_0
2016-01-14 18:24:30,296 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:24:30,306 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@ed3ecf7
2016-01-14 18:24:30,314 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@ed3ecf7
2016-01-14 18:24:30,315 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:24:30,315 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:24:30,335 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 18:24:30,339 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: 34819669F26E4016B7543FE274FAB126
2016-01-14 18:24:30,339 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"], id: 868D62E12FB54566A9C3D04EBEA5ED66
2016-01-14 18:24:30,340 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-01-14 18:24:30,344 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 18:24:30,344 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:30,346 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BDFBF67650D14DBEB6702D1DBD36F5CE, all 1 inputs ready in: 00:00:00.002
2016-01-14 18:24:30,356 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:24:30,357 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:24:30,358 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452795868762_0001_1_00_000000_0
2016-01-14 18:24:30,359 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452795868762_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:24:30,360 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452795868762_0001_1_00_000000_0
2016-01-14 18:24:30,360 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BDFBF67650D14DBEB6702D1DBD36F5CE, mem on close (mb), free: 235, total: 281, max: 672
2016-01-14 18:24:30 Completed running task attempt: attempt_1452795868762_0001_1_00_000000_0
2016-01-14 18:24:30,368 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452795868762_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:24:30,371 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:24:30,381 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BDFBF67650D14DBEB6702D1DBD36F5CE, taskAttemptId=attempt_1452795868762_0001_1_00_000000_0, startTime=1452795870188, finishTime=1452795870369, timeTaken=181, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795870346, Process_Duration=14, Process_End_Time=1452795870360, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:30,382 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452795870346, Process_Duration=14, Process_End_Time=1452795870360, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 18:24:30,382 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795868762_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:24:30,382 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:24:30,383 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:30,383 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:24:30,384 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795868762_0001_00_000001
2016-01-14 18:24:30,387 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452795868762_0001_1_00_000000_0
2016-01-14 18:24:30,390 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:24:30,393 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:TASK_FINISHED]: vertexName=BDFBF67650D14DBEB6702D1DBD36F5CE, taskId=task_1452795868762_0001_1_00_000000, startTime=1452795870188, finishTime=1452795870388, timeTaken=200, status=SUCCEEDED, successfulAttemptID=attempt_1452795868762_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795870346, Process_Duration=14, Process_End_Time=1452795870360, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:30,397 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795868762_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:24:30,398 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795868762_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:24:30,399 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:24:30,400 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452795868762_0001_00_000001, stoppedTime=1452795870399, exitStatus=0
2016-01-14 18:24:30,401 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795868762_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:24:30,401 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE] : 1
2016-01-14 18:24:30,402 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:30,410 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:24:30,412 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:VERTEX_FINISHED]: vertexName=BDFBF67650D14DBEB6702D1DBD36F5CE, vertexId=vertex_1452795868762_0001_1_00, initRequestedTime=1452795869859, initedTime=1452795870072, startRequestedTime=1452795870076, startedTime=1452795870076, finishTime=1452795870402, timeTaken=326, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795870346, Process_Duration=14, Process_End_Time=1452795870360, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452795870188, firstTasksToStart=[ task_1452795868762_0001_1_00_000000 ], lastTaskFinishTime=1452795870369, lastTasksToFinish=[ task_1452795868762_0001_1_00_000000 ], minTaskDuration=181, maxTaskDuration=181, avgTaskDuration=181.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452795868762_0001_1_00_000000 ], longestDurationTasks=[ task_1452795868762_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:24:30,414 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:24:30,417 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452795868762_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:24:30,417 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452795868762_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 18:24:30,419 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795868762_0001_00_000001: 35 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:24:30,420 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452795868762_0001_00_000001, Exiting
2016-01-14 18:24:30,420 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452795868762_0001_00_000001
2016-01-14 18:24:30,420 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452795868762_0001_00_000001
2016-01-14 18:24:30,421 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:24:30,421 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452795868762_0001_1
2016-01-14 18:24:30,423 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452795868762_0001_1
2016-01-14 18:24:30,423 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 868D62E12FB54566A9C3D04EBEA5ED66 for vertex: vertex_1452795868762_0001_1_00 [BDFBF67650D14DBEB6702D1DBD36F5CE]
2016-01-14 18:24:30,425 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452795868762_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:24:30,426 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452795868762_0001_00_000001 completed successfully
2016-01-14 18:24:30,442 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452795868762_0001_1, queueSize=0
2016-01-14 18:24:30,443 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:24:30,448 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795868762_0001_1][Event:DAG_FINISHED]: dagId=dag_1452795868762_0001_1, startTime=1452795869856, finishTime=1452795870437, timeTaken=581, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795870346, Process_Duration=14, Process_End_Time=1452795870360, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:30,449 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452795868762_0001_1 finished with state: SUCCEEDED
2016-01-14 18:24:30,450 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795868762_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:24:30,450 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795868762_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 18:24:30,450 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795868762_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 18:24:30 Completed Dag: dag_1452795868762_0001_1
2016-01-14 18:24:30,452 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452795868762_0001_1, dagState=SUCCEEDED
2016-01-14 18:24:30,452 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795868762_0001_1_post
2016-01-14 18:24:30,452 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:30,453 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:24:30,463 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452795868762_0001
2016-01-14 18:24:30,469 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:24:30,469 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:24:30,469 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:24:30,469 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:24:30,469 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:24:30,470 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:24:30,473 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:24:30,473 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:24:30,473 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:24:30,474 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:24:30,474 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:24:30,474 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:24:30,474 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:24:30,479 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8500A0C967A143CA8802590EE817EFAB/A89B7BD1120D4C8BA151AFCCE8107F5F/.tez/application_1452795868762_0001
2016-01-14 18:24:30,480 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:01.920
2016-01-14 18:24:30,639 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-01-14 18:24:30,686 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:24:30,687 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:24:30,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 18:24:30,768 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.043
2016-01-14 18:24:30,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:30,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:30,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:24:30,795 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 18:24:30,796 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-01-14 18:24:30,829 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 18:24:30,830 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:30,830 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-01-14 18:24:30,831 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 18:24:30,831 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 18:24:30,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 18:24:30,834 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...xtAll/quoted/normchartrue
2016-01-14 18:24:30,834 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:24:30,852 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 18:24:30,858 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:30,858 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:24:30,858 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:24:30,869 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7/.tez/application_1452795870858_0001 doesn't exist and is created
2016-01-14 18:24:30,891 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:24:30,891 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:30,892 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7/.tez/application_1452795870858_0001
2016-01-14 18:24:30,894 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452795870858_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:30,911 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:24:30,913 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:24:30,915 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:24:30,915 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:24:30,915 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7/.tez/application_1452795870858_0001/localmode-log-dir
2016-01-14 18:24:30,916 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7/.tez/application_1452795870858_0001/localmode-log-dir/history.txt.appattempt_1452795870858_0001_000000, maxErrors=10
2016-01-14 18:24:30,916 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:24:30,916 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452795870858_0001_000000, appSubmitTime=1452795870894, launchTime=1452795870894
2016-01-14 18:24:30,922 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:24:30,925 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:24:30,926 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:24:30,929 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:24:30,931 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:58667
2016-01-14 18:24:30,936 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:24:30,938 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452795870858_0001_000000, startTime=1452795870938
2016-01-14 18:24:30,938 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:24:30,938 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:24:30,991 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:24:30,991 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:24:30,991 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452795870858_0001, dagName=[B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 18:24:31,027 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 18:24:31,032 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452795870858_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7/.tez/application_1452795870858_0001/localmode-log-dir/dag_1452795870858_0001_1.dot
2016-01-14 18:24:31,033 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7/.tez/application_1452795870858_0001/localmode-log-dir/dag_1452795870858_0001_1-tez-dag.pb.txt
2016-01-14 18:24:31,115 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795870858_0001_1
2016-01-14 18:24:31,115 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:31,115 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 18:24:31 Running Dag: dag_1452795870858_0001_1
2016-01-14 18:24:31,129 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452795870858_0001_1, submitTime=1452795871027
2016-01-14 18:24:31,129 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:24:31,130 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A285B840AE9D43A6B81AE391AAE3E235
2016-01-14 18:24:31,130 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:24:31,131 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:24:31,131 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452795870858_0001_1, initTime=1452795871129
2016-01-14 18:24:31,132 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795870858_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:24:31,133 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:24:31,133 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:DAG_STARTED]: dagID=dag_1452795870858_0001_1, startTime=1452795871133
2016-01-14 18:24:31,133 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:24:31,133 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795870858_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:24:31,134 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A285B840AE9D43A6B81AE391AAE3E235 : {0DF1F884D56D4872992D286DB0FE5D58={InputName=0DF1F884D56D4872992D286DB0FE5D58}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:24:31,134 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 0DF1F884D56D4872992D286DB0FE5D58, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:24:31,134 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,134 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,135 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,135 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452795870858_0001, dagName=[B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 18:24:31,135 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]. Starting root input initializers: 1
2016-01-14 18:24:31,138 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:24:31,139 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 0DF1F884D56D4872992D286DB0FE5D58 on vertex vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,144 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:24:31,145 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 0DF1F884D56D4872992D286DB0FE5D58 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:24:31,147 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:24:31,148 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:24:31,151 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 18:24:31,152 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 0DF1F884D56D4872992D286DB0FE5D58 on vertex vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,153 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:31,153 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {0DF1F884D56D4872992D286DB0FE5D58=forAllWorkUnits=true, update=[1]}
2016-01-14 18:24:31,153 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235] parallelism set to 1
2016-01-14 18:24:31,154 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:31,154 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452795870858_0001_1_00, eventCount=1
2016-01-14 18:24:31,154 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,155 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=5E961593A32C41E9B7C6937D48004E4B, vertexId=vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:24:31,156 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=5E961593A32C41E9B7C6937D48004E4B, vertexId=vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,162 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=5E961593A32C41E9B7C6937D48004E4B, vertexName=A285B840AE9D43A6B81AE391AAE3E235, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:24:31,164 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=5E961593A32C41E9B7C6937D48004E4B, vertexId=vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,169 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:24:31,169 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A285B840AE9D43A6B81AE391AAE3E235, vertexId=vertex_1452795870858_0001_1_00, initRequestedTime=1452795871134, initedTime=1452795871166, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:24:31,169 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235] with distanceFromRoot: 0
2016-01-14 18:24:31,169 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:24:31,169 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A285B840AE9D43A6B81AE391AAE3E235
2016-01-14 18:24:31,169 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,170 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:24:31,170 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452795870858_0001_1_00, startRequestedTime=1452795871169, startedTime=1452795871169
2016-01-14 18:24:31,170 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:24:31,171 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:24:31,171 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:TASK_STARTED]: vertexName=A285B840AE9D43A6B81AE391AAE3E235, taskId=task_1452795870858_0001_1_00_000000, scheduledTime=1452795871170, launchTime=1452795871170
2016-01-14 18:24:31,171 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795870858_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:24:31,171 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,172 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: A285B840AE9D43A6B81AE391AAE3E235, VertexParallelism: 1, TaskAttemptID:attempt_1452795870858_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0DF1F884D56D4872992D286DB0FE5D58, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=5E961593A32C41E9B7C6937D48004E4B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:31,172 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795870858_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:24:31,172 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:24:31,173 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:24:31,174 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:24:31,174 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:24:31,175 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452795870858_0001_00_000001
2016-01-14 18:24:31,175 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795870858_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:24:31,179 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452795870858_0001_00_000001
2016-01-14 18:24:31,179 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:24:31,182 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:24:31,182 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452795870858_0001, with dag id: dag_1452795870858_0001_1
2016-01-14 18:24:31,183 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795870858_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:24:31,183 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452795870858_0001_00_000001, launchTime=1452795871181
2016-01-14 18:24:31,187 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795870858_0001_00_000001
2016-01-14 18:24:31,188 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452795870858_0001_1_00_000000_0] to container: [container_1452795870858_0001_00_000001]
2016-01-14 18:24:31,188 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795870858_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:24:31,189 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452795870858_0001_00_000001 given task: attempt_1452795870858_0001_1_00_000000_0
2016-01-14 18:24:31,189 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795870858_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452795870858_0001_1_00_000000_0
2016-01-14 18:24:31,189 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452795870858_0001_1_00_000000_0] started. Is using containerId: [container_1452795870858_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:24:31 Starting to run new task attempt: attempt_1452795870858_0001_1_00_000000_0
2016-01-14 18:24:31,190 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452795870858_0001_1_00_000000_0
2016-01-14 18:24:31,190 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:24:31,191 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A285B840AE9D43A6B81AE391AAE3E235, taskAttemptId=attempt_1452795870858_0001_1_00_000000_0, startTime=1452795871189, containerId=container_1452795870858_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452795870858_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:24:31,191 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795870858_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:24:31,192 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795870858_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:24:31,192 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:31,193 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:24:31,193 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:24:31,193 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:24:31,193 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:24:31,194 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:24:31,194 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: A285B840AE9D43A6B81AE391AAE3E235, VertexParallelism: 1, TaskAttemptID:attempt_1452795870858_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0DF1F884D56D4872992D286DB0FE5D58, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=5E961593A32C41E9B7C6937D48004E4B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:31,194 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:24:31,195 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452795870858_0001_1_00_000000_0
2016-01-14 18:24:31,195 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:24:31,195 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:31,196 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=0DF1F884D56D4872992D286DB0FE5D58, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:24:31,196 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:31,196 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=5E961593A32C41E9B7C6937D48004E4B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:24:31,197 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:24:31,197 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 5E961593A32C41E9B7C6937D48004E4B
2016-01-14 18:24:31,197 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:24:31,198 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 5E961593A32C41E9B7C6937D48004E4B
2016-01-14 18:24:31,202 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:24:31,202 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 0DF1F884D56D4872992D286DB0FE5D58
2016-01-14 18:24:31,204 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 0DF1F884D56D4872992D286DB0FE5D58
2016-01-14 18:24:31,204 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:24:31,210 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452795870858_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:24:31,213 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:24:31,213 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 0DF1F884D56D4872992D286DB0FE5D58
2016-01-14 18:24:31,213 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 0DF1F884D56D4872992D286DB0FE5D58
2016-01-14 18:24:31,218 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:24:31,218 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 5E961593A32C41E9B7C6937D48004E4B
2016-01-14 18:24:31,222 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A285B840AE9D43A6B81AE391AAE3E235, ordinal: 0
2016-01-14 18:24:31,222 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A285B840AE9D43A6B81AE391AAE3E235, mem on start (mb), free: 353, total: 397, max: 672
2016-01-14 18:24:31,222 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:31,222 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:24:31,223 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:24:31,223 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:24:31,223 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:24:31,224 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:24:31,224 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:31,225 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:24:31,225 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:31,226 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:24:31,226 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:24:31,226 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 5E961593A32C41E9B7C6937D48004E4B, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:24:31,227 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 0DF1F884D56D4872992D286DB0FE5D58, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:24:31,227 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:24:31,227 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 0DF1F884D56D4872992D286DB0FE5D58 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:24:31,227 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 0DF1F884D56D4872992D286DB0FE5D58
2016-01-14 18:24:31,228 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:24:31,228 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:24:31,228 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:31,229 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 0DF1F884D56D4872992D286DB0FE5D58
2016-01-14 18:24:31,230 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:24:31,230 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452795870858_0001_1_00_000000_0
2016-01-14 18:24:31,230 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:24:31,232 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@36993bdc
2016-01-14 18:24:31,236 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@36993bdc
2016-01-14 18:24:31,236 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:24:31,236 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:24:31,239 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:31,239 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 0DF1F884D56D4872992D286DB0FE5D58
2016-01-14 18:24:31,240 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"], id: 5E961593A32C41E9B7C6937D48004E4B
2016-01-14 18:24:31,240 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-01-14 18:24:31,240 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:31,241 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:31,241 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A285B840AE9D43A6B81AE391AAE3E235, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:24:31,244 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:24:31,245 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:24:31,245 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452795870858_0001_1_00_000000_0
2016-01-14 18:24:31,246 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452795870858_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:24:31,247 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452795870858_0001_1_00_000000_0
2016-01-14 18:24:31,247 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A285B840AE9D43A6B81AE391AAE3E235, mem on close (mb), free: 351, total: 397, max: 672
2016-01-14 18:24:31 Completed running task attempt: attempt_1452795870858_0001_1_00_000000_0
2016-01-14 18:24:31,250 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452795870858_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:24:31,252 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452795871241, Process_Duration=6, Process_End_Time=1452795871247, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 18:24:31,252 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:24:31,252 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:31,253 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795870858_0001_00_000001
2016-01-14 18:24:31,253 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A285B840AE9D43A6B81AE391AAE3E235, taskAttemptId=attempt_1452795870858_0001_1_00_000000_0, startTime=1452795871189, finishTime=1452795871252, timeTaken=63, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795871241, Process_Duration=6, Process_End_Time=1452795871247, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:31,253 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:24:31,255 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795870858_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:24:31,255 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:24:31,256 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452795870858_0001_1_00_000000_0
2016-01-14 18:24:31,256 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:24:31,258 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:TASK_FINISHED]: vertexName=A285B840AE9D43A6B81AE391AAE3E235, taskId=task_1452795870858_0001_1_00_000000, startTime=1452795871189, finishTime=1452795871256, timeTaken=67, status=SUCCEEDED, successfulAttemptID=attempt_1452795870858_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795871241, Process_Duration=6, Process_End_Time=1452795871247, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:31,258 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795870858_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:24:31,259 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235] : 1
2016-01-14 18:24:31,259 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,261 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:24:31,263 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:VERTEX_FINISHED]: vertexName=A285B840AE9D43A6B81AE391AAE3E235, vertexId=vertex_1452795870858_0001_1_00, initRequestedTime=1452795871134, initedTime=1452795871166, startRequestedTime=1452795871169, startedTime=1452795871169, finishTime=1452795871259, timeTaken=90, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795871241, Process_Duration=6, Process_End_Time=1452795871247, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452795871189, firstTasksToStart=[ task_1452795870858_0001_1_00_000000 ], lastTaskFinishTime=1452795871252, lastTasksToFinish=[ task_1452795870858_0001_1_00_000000 ], minTaskDuration=63, maxTaskDuration=63, avgTaskDuration=63.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452795870858_0001_1_00_000000 ], longestDurationTasks=[ task_1452795870858_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:24:31,263 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:24:31,265 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795870858_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:24:31,266 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:24:31,266 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452795870858_0001_00_000001, stoppedTime=1452795871266, exitStatus=0
2016-01-14 18:24:31,267 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795870858_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:24:31,267 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:24:31,268 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452795870858_0001_1
2016-01-14 18:24:31,267 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452795870858_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:24:31,268 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795870858_0001_00_000001: 12 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:24:31,268 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452795870858_0001_00_000001, Exiting
2016-01-14 18:24:31,269 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452795870858_0001_00_000001
2016-01-14 18:24:31,269 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452795870858_0001_00_000001
2016-01-14 18:24:31,268 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452795870858_0001_1
2016-01-14 18:24:31,271 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 5E961593A32C41E9B7C6937D48004E4B for vertex: vertex_1452795870858_0001_1_00 [A285B840AE9D43A6B81AE391AAE3E235]
2016-01-14 18:24:31,272 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452795870858_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:24:31,273 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452795870858_0001_00_000001 completed successfully
2016-01-14 18:24:31,280 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452795870858_0001_1, queueSize=0
2016-01-14 18:24:31,281 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:24:31,281 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795870858_0001_1][Event:DAG_FINISHED]: dagId=dag_1452795870858_0001_1, startTime=1452795871133, finishTime=1452795871279, timeTaken=146, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795871241, Process_Duration=6, Process_End_Time=1452795871247, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:31,282 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452795870858_0001_1 finished with state: SUCCEEDED
2016-01-14 18:24:31,282 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795870858_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:24:31,282 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452795870858_0001_00_000001
2016-01-14 18:24:31,282 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795870858_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:24:31 Completed Dag: dag_1452795870858_0001_1
2016-01-14 18:24:31,284 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452795870858_0001_1, dagState=SUCCEEDED
2016-01-14 18:24:31,284 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795870858_0001_1_post
2016-01-14 18:24:31,284 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:31,284 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:24:31,291 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452795870858_0001
2016-01-14 18:24:31,294 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:24:31,294 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:24:31,294 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:24:31,294 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:24:31,294 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:24:31,295 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:24:31,295 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:24:31,297 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:24:31,297 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:24:31,297 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:24:31,297 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:24:31,299 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:24:31,299 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:24:31,304 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B386870D3A734D88AB32E1AE5C478179/ACBF9D44109E46DDBA0EAED1655471C7/.tez/application_1452795870858_0001
2016-01-14 18:24:31,305 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.476
2016-01-14 18:24:31,439 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-01-14 18:24:31,476 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:24:31,477 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:24:31,530 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 18:24:31,544 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-14 18:24:31,545 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:31,545 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:31,545 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:24:31,564 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-01-14 18:24:31,565 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-01-14 18:24:31,591 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 18:24:31,592 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 18:24:31,593 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-01-14 18:24:31,594 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 18:24:31,595 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 18:24:31,595 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 18:24:31,597 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...arAll/quoted/specchartrue
2016-01-14 18:24:31,597 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:24:31,616 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 18:24:31,620 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:31,621 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:24:31,621 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:24:31,630 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E/.tez/application_1452795871621_0001 doesn't exist and is created
2016-01-14 18:24:31,648 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:24:31,649 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:31,650 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E/.tez/application_1452795871621_0001
2016-01-14 18:24:31,653 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452795871621_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:31,666 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:24:31,668 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:24:31,670 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:24:31,670 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:24:31,671 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E/.tez/application_1452795871621_0001/localmode-log-dir
2016-01-14 18:24:31,671 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E/.tez/application_1452795871621_0001/localmode-log-dir/history.txt.appattempt_1452795871621_0001_000000, maxErrors=10
2016-01-14 18:24:31,671 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:24:31,672 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452795871621_0001_000000, appSubmitTime=1452795871651, launchTime=1452795871652
2016-01-14 18:24:31,675 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:24:31,677 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:24:31,678 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:24:31,678 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:24:31,682 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:58994
2016-01-14 18:24:31,684 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:24:31,686 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452795871621_0001_000000, startTime=1452795871686
2016-01-14 18:24:31,686 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:24:31,686 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:24:31,749 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:24:31,749 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:24:31,749 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452795871621_0001, dagName=[00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 18:24:31,776 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 18:24:31,778 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452795871621_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E/.tez/application_1452795871621_0001/localmode-log-dir/dag_1452795871621_0001_1.dot
2016-01-14 18:24:31,779 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E/.tez/application_1452795871621_0001/localmode-log-dir/dag_1452795871621_0001_1-tez-dag.pb.txt
2016-01-14 18:24:31,809 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795871621_0001_1
2016-01-14 18:24:31,809 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:31,809 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 18:24:31 Running Dag: dag_1452795871621_0001_1
2016-01-14 18:24:31,823 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452795871621_0001_1, submitTime=1452795871776
2016-01-14 18:24:31,823 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:24:31,823 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex DCFCCB6915B2469CBE0D672F615E080A
2016-01-14 18:24:31,823 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:24:31,824 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452795871621_0001_1, initTime=1452795871823
2016-01-14 18:24:31,824 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795871621_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:24:31,824 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:24:31,825 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:DAG_STARTED]: dagID=dag_1452795871621_0001_1, startTime=1452795871824
2016-01-14 18:24:31,825 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:24:31,825 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:24:31,826 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795871621_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:24:31,826 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452795871621_0001, dagName=[00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 18:24:31,826 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: DCFCCB6915B2469CBE0D672F615E080A : {873C0A0B492A44239711BA6427F14180={InputName=873C0A0B492A44239711BA6427F14180}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:24:31,826 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 873C0A0B492A44239711BA6427F14180, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:24:31,826 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,826 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,826 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,827 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]. Starting root input initializers: 1
2016-01-14 18:24:31,828 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:24:31,828 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 873C0A0B492A44239711BA6427F14180 on vertex vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,831 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:24:31,832 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 873C0A0B492A44239711BA6427F14180 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:24:31,833 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:24:31,833 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:24:31,836 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-01-14 18:24:31,837 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 873C0A0B492A44239711BA6427F14180 on vertex vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,837 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:31,837 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {873C0A0B492A44239711BA6427F14180=forAllWorkUnits=true, update=[1]}
2016-01-14 18:24:31,838 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A] parallelism set to 1
2016-01-14 18:24:31,838 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:31,839 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452795871621_0001_1_00, eventCount=1
2016-01-14 18:24:31,839 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,839 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=17A3CFF249D74F3E93209184E668F4F5, vertexId=vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:24:31,839 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=17A3CFF249D74F3E93209184E668F4F5, vertexId=vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,843 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=17A3CFF249D74F3E93209184E668F4F5, vertexName=DCFCCB6915B2469CBE0D672F615E080A, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:24:31,843 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=17A3CFF249D74F3E93209184E668F4F5, vertexId=vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,844 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:24:31,844 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:VERTEX_INITIALIZED]: vertexName=DCFCCB6915B2469CBE0D672F615E080A, vertexId=vertex_1452795871621_0001_1_00, initRequestedTime=1452795871826, initedTime=1452795871844, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:24:31,847 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A] with distanceFromRoot: 0
2016-01-14 18:24:31,847 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:24:31,848 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in DCFCCB6915B2469CBE0D672F615E080A
2016-01-14 18:24:31,848 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,848 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:24:31,848 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452795871621_0001_1_00, startRequestedTime=1452795871848, startedTime=1452795871848
2016-01-14 18:24:31,849 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:24:31,851 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:24:31,852 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:TASK_STARTED]: vertexName=DCFCCB6915B2469CBE0D672F615E080A, taskId=task_1452795871621_0001_1_00_000000, scheduledTime=1452795871851, launchTime=1452795871851
2016-01-14 18:24:31,852 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795871621_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:24:31,852 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,853 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: DCFCCB6915B2469CBE0D672F615E080A, VertexParallelism: 1, TaskAttemptID:attempt_1452795871621_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=873C0A0B492A44239711BA6427F14180, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=17A3CFF249D74F3E93209184E668F4F5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:31,854 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795871621_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:24:31,854 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:24:31,855 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452795871621_0001, with dag id: dag_1452795871621_0001_1
2016-01-14 18:24:31,855 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:24:31,857 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:24:31,858 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:24:31,859 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452795871621_0001_00_000001
2016-01-14 18:24:31,859 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795871621_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:24:31,863 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452795871621_0001_00_000001
2016-01-14 18:24:31,863 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:24:31,865 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795871621_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:24:31,865 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:24:31,865 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452795871621_0001_00_000001, launchTime=1452795871865
2016-01-14 18:24:31,866 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795871621_0001_00_000001
2016-01-14 18:24:31,867 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452795871621_0001_1_00_000000_0] to container: [container_1452795871621_0001_00_000001]
2016-01-14 18:24:31,867 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795871621_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:24:31,868 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452795871621_0001_00_000001 given task: attempt_1452795871621_0001_1_00_000000_0
2016-01-14 18:24:31,868 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795871621_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452795871621_0001_1_00_000000_0
2016-01-14 18:24:31,868 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452795871621_0001_1_00_000000_0] started. Is using containerId: [container_1452795871621_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:24:31 Starting to run new task attempt: attempt_1452795871621_0001_1_00_000000_0
2016-01-14 18:24:31,870 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452795871621_0001_1_00_000000_0
2016-01-14 18:24:31,871 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:31,871 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:24:31,872 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:24:31,872 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:24:31,872 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:24:31,872 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:24:31,872 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: DCFCCB6915B2469CBE0D672F615E080A, VertexParallelism: 1, TaskAttemptID:attempt_1452795871621_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=873C0A0B492A44239711BA6427F14180, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=17A3CFF249D74F3E93209184E668F4F5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:31,873 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:24:31,870 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=DCFCCB6915B2469CBE0D672F615E080A, taskAttemptId=attempt_1452795871621_0001_1_00_000000_0, startTime=1452795871868, containerId=container_1452795871621_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452795871621_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:24:31,873 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452795871621_0001_1_00_000000_0
2016-01-14 18:24:31,873 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:24:31,874 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:31,870 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:24:31,873 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795871621_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:24:31,875 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:31,875 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795871621_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:24:31,876 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=17A3CFF249D74F3E93209184E668F4F5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:24:31,876 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:24:31,877 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 17A3CFF249D74F3E93209184E668F4F5
2016-01-14 18:24:31,877 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:24:31,877 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 17A3CFF249D74F3E93209184E668F4F5
2016-01-14 18:24:31,878 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:24:31,881 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452795871621_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:24:31,881 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=873C0A0B492A44239711BA6427F14180, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:24:31,883 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:24:31,883 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 873C0A0B492A44239711BA6427F14180
2016-01-14 18:24:31,883 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 873C0A0B492A44239711BA6427F14180
2016-01-14 18:24:31,892 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:24:31,892 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 873C0A0B492A44239711BA6427F14180
2016-01-14 18:24:31,893 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 873C0A0B492A44239711BA6427F14180
2016-01-14 18:24:31,895 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:24:31,896 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 17A3CFF249D74F3E93209184E668F4F5
2016-01-14 18:24:31,899 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: DCFCCB6915B2469CBE0D672F615E080A, ordinal: 0
2016-01-14 18:24:31,900 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DCFCCB6915B2469CBE0D672F615E080A, mem on start (mb), free: 245, total: 397, max: 672
2016-01-14 18:24:31,900 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:31,900 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:24:31,900 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:24:31,900 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:24:31,900 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:24:31,901 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:24:31,901 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:31,901 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:24:31,901 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:31,901 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:24:31,902 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:24:31,902 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 17A3CFF249D74F3E93209184E668F4F5, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:24:31,902 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 873C0A0B492A44239711BA6427F14180, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:24:31,902 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:24:31,903 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 873C0A0B492A44239711BA6427F14180 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:24:31,903 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 873C0A0B492A44239711BA6427F14180
2016-01-14 18:24:31,903 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:31,903 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 873C0A0B492A44239711BA6427F14180
2016-01-14 18:24:31,903 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:24:31,904 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:24:31,904 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:24:31,905 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452795871621_0001_1_00_000000_0
2016-01-14 18:24:31,907 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:24:31,908 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1d2d29b9
2016-01-14 18:24:31,909 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 18:24:31,910 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: 873C0A0B492A44239711BA6427F14180
2016-01-14 18:24:31,910 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"], id: 17A3CFF249D74F3E93209184E668F4F5
2016-01-14 18:24:31,910 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-01-14 18:24:31,910 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1d2d29b9
2016-01-14 18:24:31,911 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:24:31,911 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:24:31,910 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 18:24:31,911 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:31,912 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: DCFCCB6915B2469CBE0D672F615E080A, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:24:31,915 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:24:31,915 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:24:31,916 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452795871621_0001_1_00_000000_0
2016-01-14 18:24:31,916 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452795871621_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:24:31,918 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452795871621_0001_1_00_000000_0
2016-01-14 18:24:31,918 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DCFCCB6915B2469CBE0D672F615E080A, mem on close (mb), free: 243, total: 397, max: 672
2016-01-14 18:24:31 Completed running task attempt: attempt_1452795871621_0001_1_00_000000_0
2016-01-14 18:24:31,920 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452795871621_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:24:31,921 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452795871912, Process_Duration=5, Process_End_Time=1452795871917, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 18:24:31,921 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:24:31,921 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:31,922 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:24:31,923 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795871621_0001_00_000001
2016-01-14 18:24:31,923 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=DCFCCB6915B2469CBE0D672F615E080A, taskAttemptId=attempt_1452795871621_0001_1_00_000000_0, startTime=1452795871868, finishTime=1452795871921, timeTaken=53, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795871912, Process_Duration=5, Process_End_Time=1452795871917, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:31,923 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795871621_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:24:31,924 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452795871621_0001_1_00_000000_0
2016-01-14 18:24:31,924 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:24:31,924 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:24:31,925 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:TASK_FINISHED]: vertexName=DCFCCB6915B2469CBE0D672F615E080A, taskId=task_1452795871621_0001_1_00_000000, startTime=1452795871868, finishTime=1452795871924, timeTaken=56, status=SUCCEEDED, successfulAttemptID=attempt_1452795871621_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795871912, Process_Duration=5, Process_End_Time=1452795871917, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:31,926 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795871621_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:24:31,926 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A] : 1
2016-01-14 18:24:31,926 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,928 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:24:31,929 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:VERTEX_FINISHED]: vertexName=DCFCCB6915B2469CBE0D672F615E080A, vertexId=vertex_1452795871621_0001_1_00, initRequestedTime=1452795871826, initedTime=1452795871844, startRequestedTime=1452795871848, startedTime=1452795871848, finishTime=1452795871926, timeTaken=78, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795871912, Process_Duration=5, Process_End_Time=1452795871917, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452795871868, firstTasksToStart=[ task_1452795871621_0001_1_00_000000 ], lastTaskFinishTime=1452795871921, lastTasksToFinish=[ task_1452795871621_0001_1_00_000000 ], minTaskDuration=53, maxTaskDuration=53, avgTaskDuration=53.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452795871621_0001_1_00_000000 ], longestDurationTasks=[ task_1452795871621_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:24:31,929 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:24:31,929 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795871621_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:24:31,930 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:24:31,930 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452795871621_0001_00_000001, stoppedTime=1452795871930, exitStatus=0
2016-01-14 18:24:31,931 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795871621_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:24:31,931 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:24:31,932 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452795871621_0001_1
2016-01-14 18:24:31,933 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452795871621_0001_1
2016-01-14 18:24:31,933 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 17A3CFF249D74F3E93209184E668F4F5 for vertex: vertex_1452795871621_0001_1_00 [DCFCCB6915B2469CBE0D672F615E080A]
2016-01-14 18:24:31,933 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452795871621_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:24:31,934 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795871621_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:24:31,937 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452795871621_0001_00_000001, Exiting
2016-01-14 18:24:31,937 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452795871621_0001_00_000001
2016-01-14 18:24:31,937 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452795871621_0001_00_000001
2016-01-14 18:24:31,940 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452795871621_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:24:31,940 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452795871621_0001_00_000001 completed successfully
2016-01-14 18:24:31,950 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452795871621_0001_1, queueSize=0
2016-01-14 18:24:31,951 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:24:31,951 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795871621_0001_1][Event:DAG_FINISHED]: dagId=dag_1452795871621_0001_1, startTime=1452795871824, finishTime=1452795871949, timeTaken=125, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=708, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795871912, Process_Duration=5, Process_End_Time=1452795871917, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:31,951 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452795871621_0001_1 finished with state: SUCCEEDED
2016-01-14 18:24:31,951 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795871621_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:24:31,952 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452795871621_0001_00_000001
2016-01-14 18:24:31,952 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795871621_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:24:31 Completed Dag: dag_1452795871621_0001_1
2016-01-14 18:24:31,953 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452795871621_0001_1, dagState=SUCCEEDED
2016-01-14 18:24:31,953 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795871621_0001_1_post
2016-01-14 18:24:31,954 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:31,954 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:24:31,960 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452795871621_0001
2016-01-14 18:24:31,967 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:24:31,967 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:24:31,968 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:24:31,968 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:24:31,968 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:24:31,968 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:24:31,969 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:24:31,969 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:24:31,970 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:24:31,970 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:24:31,970 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:24:31,971 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:24:31,972 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:24:31,978 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/00F2FA0C22D9405DA77EDBF6D7146E17/BA6F7A198F4D4B4397E0BAF3F7C7F52E/.tez/application_1452795871621_0001
2016-01-14 18:24:31,979 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.388
2016-01-14 18:24:32,139 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-01-14 18:24:32,181 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:24:32,181 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:24:32,241 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 18:24:32,254 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-01-14 18:24:32,255 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:32,255 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:32,256 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:24:32,284 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 18:24:32,285 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-01-14 18:24:32,301 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 18:24:32,302 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:32,302 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-01-14 18:24:32,303 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 18:24:32,304 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 18:24:32,304 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 18:24:32,305 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...m/testHeaderAll/headerall
2016-01-14 18:24:32,305 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:24:32,334 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 18:24:32,340 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:32,340 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:24:32,341 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:24:32,351 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78/.tez/application_1452795872340_0001 doesn't exist and is created
2016-01-14 18:24:32,367 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:24:32,367 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:32,367 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78/.tez/application_1452795872340_0001
2016-01-14 18:24:32,369 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452795872340_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:32,387 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:24:32,388 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:24:32,390 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:24:32,390 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:24:32,391 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78/.tez/application_1452795872340_0001/localmode-log-dir
2016-01-14 18:24:32,391 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78/.tez/application_1452795872340_0001/localmode-log-dir/history.txt.appattempt_1452795872340_0001_000000, maxErrors=10
2016-01-14 18:24:32,391 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:24:32,391 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452795872340_0001_000000, appSubmitTime=1452795872369, launchTime=1452795872369
2016-01-14 18:24:32,401 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:24:32,403 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:24:32,404 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:24:32,404 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:24:32,407 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:43451
2016-01-14 18:24:32,409 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:24:32,411 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:24:32,411 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452795872340_0001_000000, startTime=1452795872411
2016-01-14 18:24:32,411 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:24:32,467 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:24:32,467 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:24:32,467 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452795872340_0001, dagName=[51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 18:24:32,498 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 18:24:32,500 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452795872340_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78/.tez/application_1452795872340_0001/localmode-log-dir/dag_1452795872340_0001_1.dot
2016-01-14 18:24:32,501 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78/.tez/application_1452795872340_0001/localmode-log-dir/dag_1452795872340_0001_1-tez-dag.pb.txt
2016-01-14 18:24:32,534 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795872340_0001_1
2016-01-14 18:24:32,534 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:32,534 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 18:24:32 Running Dag: dag_1452795872340_0001_1
2016-01-14 18:24:32,546 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:24:32,547 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452795872340_0001_1, submitTime=1452795872498
2016-01-14 18:24:32,547 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex DDEB2E73C1C646AC88D6C16CA524894D
2016-01-14 18:24:32,548 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:24:32,548 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:24:32,548 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452795872340_0001_1, initTime=1452795872547
2016-01-14 18:24:32,549 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795872340_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:24:32,549 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:24:32,549 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:DAG_STARTED]: dagID=dag_1452795872340_0001_1, startTime=1452795872549
2016-01-14 18:24:32,550 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:24:32,550 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795872340_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:24:32,550 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: DDEB2E73C1C646AC88D6C16CA524894D : {6556CB244AEC41798CA255F344914CEA={InputName=6556CB244AEC41798CA255F344914CEA}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:24:32,550 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 6556CB244AEC41798CA255F344914CEA, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:24:32,551 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,551 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452795872340_0001, dagName=[51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 18:24:32,551 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,551 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,551 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]. Starting root input initializers: 1
2016-01-14 18:24:32,552 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:24:32,553 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 6556CB244AEC41798CA255F344914CEA on vertex vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,556 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:24:32,556 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 6556CB244AEC41798CA255F344914CEA asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:24:32,558 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:24:32,558 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:24:32,562 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 18:24:32,563 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 6556CB244AEC41798CA255F344914CEA on vertex vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,563 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:32,563 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {6556CB244AEC41798CA255F344914CEA=forAllWorkUnits=true, update=[1]}
2016-01-14 18:24:32,564 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D] parallelism set to 1
2016-01-14 18:24:32,564 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:32,564 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452795872340_0001_1_00, eventCount=1
2016-01-14 18:24:32,564 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,564 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=90273D63E3894819A9A29D907AA4462A, vertexId=vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:24:32,565 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=90273D63E3894819A9A29D907AA4462A, vertexId=vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,568 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=90273D63E3894819A9A29D907AA4462A, vertexName=DDEB2E73C1C646AC88D6C16CA524894D, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:24:32,568 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=90273D63E3894819A9A29D907AA4462A, vertexId=vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,570 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:24:32,570 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:VERTEX_INITIALIZED]: vertexName=DDEB2E73C1C646AC88D6C16CA524894D, vertexId=vertex_1452795872340_0001_1_00, initRequestedTime=1452795872550, initedTime=1452795872569, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:24:32,571 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D] with distanceFromRoot: 0
2016-01-14 18:24:32,572 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:24:32,572 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in DDEB2E73C1C646AC88D6C16CA524894D
2016-01-14 18:24:32,573 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,574 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:24:32,574 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452795872340_0001_1_00, startRequestedTime=1452795872572, startedTime=1452795872572
2016-01-14 18:24:32,574 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:24:32,575 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:24:32,575 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:TASK_STARTED]: vertexName=DDEB2E73C1C646AC88D6C16CA524894D, taskId=task_1452795872340_0001_1_00_000000, scheduledTime=1452795872575, launchTime=1452795872575
2016-01-14 18:24:32,576 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795872340_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:24:32,577 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,577 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: DDEB2E73C1C646AC88D6C16CA524894D, VertexParallelism: 1, TaskAttemptID:attempt_1452795872340_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6556CB244AEC41798CA255F344914CEA, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=90273D63E3894819A9A29D907AA4462A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:32,578 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795872340_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:24:32,578 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:24:32,579 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:24:32,580 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:24:32,580 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:24:32,581 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452795872340_0001_00_000001
2016-01-14 18:24:32,581 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872340_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:24:32,584 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452795872340_0001_00_000001
2016-01-14 18:24:32,584 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:24:32,585 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452795872340_0001, with dag id: dag_1452795872340_0001_1
2016-01-14 18:24:32,586 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872340_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:24:32,586 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:24:32,587 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452795872340_0001_00_000001, launchTime=1452795872586
2016-01-14 18:24:32,587 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795872340_0001_00_000001
2016-01-14 18:24:32,590 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452795872340_0001_1_00_000000_0] to container: [container_1452795872340_0001_00_000001]
2016-01-14 18:24:32,590 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872340_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:24:32,590 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452795872340_0001_00_000001 given task: attempt_1452795872340_0001_1_00_000000_0
2016-01-14 18:24:32,591 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795872340_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452795872340_0001_1_00_000000_0
2016-01-14 18:24:32 Starting to run new task attempt: attempt_1452795872340_0001_1_00_000000_0
2016-01-14 18:24:32,591 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452795872340_0001_1_00_000000_0] started. Is using containerId: [container_1452795872340_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:24:32,594 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452795872340_0001_1_00_000000_0
2016-01-14 18:24:32,594 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:32,595 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:24:32,595 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:24:32,595 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:24:32,595 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:24:32,595 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:24:32,595 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: DDEB2E73C1C646AC88D6C16CA524894D, VertexParallelism: 1, TaskAttemptID:attempt_1452795872340_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6556CB244AEC41798CA255F344914CEA, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=90273D63E3894819A9A29D907AA4462A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:32,596 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:24:32,596 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452795872340_0001_1_00_000000_0
2016-01-14 18:24:32,598 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:24:32,598 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:32,598 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=DDEB2E73C1C646AC88D6C16CA524894D, taskAttemptId=attempt_1452795872340_0001_1_00_000000_0, startTime=1452795872590, containerId=container_1452795872340_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452795872340_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:24:32,598 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:24:32,600 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=6556CB244AEC41798CA255F344914CEA, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:24:32,626 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795872340_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:24:32,626 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:24:32,626 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 6556CB244AEC41798CA255F344914CEA
2016-01-14 18:24:32,626 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 6556CB244AEC41798CA255F344914CEA
2016-01-14 18:24:32,600 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=90273D63E3894819A9A29D907AA4462A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:24:32,628 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:24:32,628 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 90273D63E3894819A9A29D907AA4462A
2016-01-14 18:24:32,629 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:24:32,629 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 90273D63E3894819A9A29D907AA4462A
2016-01-14 18:24:32,599 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:32,599 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452795872340_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:24:32,630 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795872340_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:24:32,632 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:24:32,632 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 6556CB244AEC41798CA255F344914CEA
2016-01-14 18:24:32,632 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 6556CB244AEC41798CA255F344914CEA
2016-01-14 18:24:32,633 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:24:32,646 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:24:32,646 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 90273D63E3894819A9A29D907AA4462A
2016-01-14 18:24:32,646 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: DDEB2E73C1C646AC88D6C16CA524894D, ordinal: 0
2016-01-14 18:24:32,647 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DDEB2E73C1C646AC88D6C16CA524894D, mem on start (mb), free: 363, total: 397, max: 672
2016-01-14 18:24:32,647 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:32,647 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:24:32,647 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:24:32,648 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:24:32,648 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:24:32,648 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:24:32,649 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:32,649 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:24:32,649 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:32,650 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:24:32,650 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:24:32,650 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 6556CB244AEC41798CA255F344914CEA, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:24:32,651 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 90273D63E3894819A9A29D907AA4462A, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:24:32,651 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:24:32,651 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 6556CB244AEC41798CA255F344914CEA being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:24:32,651 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 6556CB244AEC41798CA255F344914CEA
2016-01-14 18:24:32,651 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:32,652 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 6556CB244AEC41798CA255F344914CEA
2016-01-14 18:24:32,652 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:24:32,652 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:24:32,652 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:24:32,653 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452795872340_0001_1_00_000000_0
2016-01-14 18:24:32,653 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:24:32,655 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@22f19b06
2016-01-14 18:24:32,656 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@22f19b06
2016-01-14 18:24:32,656 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:24:32,656 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:24:32,657 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:32,657 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 6556CB244AEC41798CA255F344914CEA
2016-01-14 18:24:32,658 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"], id: 90273D63E3894819A9A29D907AA4462A
2016-01-14 18:24:32,658 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-01-14 18:24:32,659 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:32,659 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:32,659 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: DDEB2E73C1C646AC88D6C16CA524894D, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:24:32,663 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:24:32,663 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:24:32,664 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452795872340_0001_1_00_000000_0
2016-01-14 18:24:32,664 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452795872340_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:24:32,665 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452795872340_0001_1_00_000000_0
2016-01-14 18:24:32,665 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DDEB2E73C1C646AC88D6C16CA524894D, mem on close (mb), free: 361, total: 397, max: 672
2016-01-14 18:24:32 Completed running task attempt: attempt_1452795872340_0001_1_00_000000_0
2016-01-14 18:24:32,666 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452795872340_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:24:32,668 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=726, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=26, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452795872660, Process_Duration=5, Process_End_Time=1452795872665, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-01-14 18:24:32,668 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=DDEB2E73C1C646AC88D6C16CA524894D, taskAttemptId=attempt_1452795872340_0001_1_00_000000_0, startTime=1452795872590, finishTime=1452795872668, timeTaken=78, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=726, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=26, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795872660, Process_Duration=5, Process_End_Time=1452795872665, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 18:24:32,668 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:24:32,669 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795872340_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:24:32,669 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:24:32,671 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:32,671 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452795872340_0001_1_00_000000_0
2016-01-14 18:24:32,671 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795872340_0001_00_000001
2016-01-14 18:24:32,672 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:TASK_FINISHED]: vertexName=DDEB2E73C1C646AC88D6C16CA524894D, taskId=task_1452795872340_0001_1_00_000000, startTime=1452795872590, finishTime=1452795872671, timeTaken=81, status=SUCCEEDED, successfulAttemptID=attempt_1452795872340_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=726, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=26, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795872660, Process_Duration=5, Process_End_Time=1452795872665, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 18:24:32,671 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:24:32,672 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795872340_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:24:32,672 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:24:32,674 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D] : 1
2016-01-14 18:24:32,674 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,676 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:24:32,677 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:VERTEX_FINISHED]: vertexName=DDEB2E73C1C646AC88D6C16CA524894D, vertexId=vertex_1452795872340_0001_1_00, initRequestedTime=1452795872550, initedTime=1452795872569, startRequestedTime=1452795872572, startedTime=1452795872572, finishTime=1452795872674, timeTaken=102, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=726, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=26, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795872660, Process_Duration=5, Process_End_Time=1452795872665, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1452795872590, firstTasksToStart=[ task_1452795872340_0001_1_00_000000 ], lastTaskFinishTime=1452795872668, lastTasksToFinish=[ task_1452795872340_0001_1_00_000000 ], minTaskDuration=78, maxTaskDuration=78, avgTaskDuration=78.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452795872340_0001_1_00_000000 ], longestDurationTasks=[ task_1452795872340_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:24:32,677 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:24:32,679 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872340_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:24:32,679 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:24:32,679 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452795872340_0001_00_000001, stoppedTime=1452795872679, exitStatus=0
2016-01-14 18:24:32,680 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872340_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:24:32,680 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:24:32,680 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452795872340_0001_1
2016-01-14 18:24:32,680 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452795872340_0001_1
2016-01-14 18:24:32,680 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 90273D63E3894819A9A29D907AA4462A for vertex: vertex_1452795872340_0001_1_00 [DDEB2E73C1C646AC88D6C16CA524894D]
2016-01-14 18:24:32,682 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452795872340_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:24:32,683 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795872340_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:24:32,683 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452795872340_0001_00_000001, Exiting
2016-01-14 18:24:32,683 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452795872340_0001_00_000001
2016-01-14 18:24:32,684 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452795872340_0001_00_000001
2016-01-14 18:24:32,687 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452795872340_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:24:32,687 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452795872340_0001_00_000001 completed successfully
2016-01-14 18:24:32,691 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452795872340_0001_1, queueSize=0
2016-01-14 18:24:32,691 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:24:32,693 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872340_0001_1][Event:DAG_FINISHED]: dagId=dag_1452795872340_0001_1, startTime=1452795872549, finishTime=1452795872687, timeTaken=138, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=726, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=26, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795872660, Process_Duration=5, Process_End_Time=1452795872665, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 18:24:32,693 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452795872340_0001_1 finished with state: SUCCEEDED
2016-01-14 18:24:32,695 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795872340_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:24:32,695 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452795872340_0001_00_000001
2016-01-14 18:24:32,697 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872340_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:24:32 Completed Dag: dag_1452795872340_0001_1
2016-01-14 18:24:32,698 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452795872340_0001_1, dagState=SUCCEEDED
2016-01-14 18:24:32,698 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795872340_0001_1_post
2016-01-14 18:24:32,698 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:32,698 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:24:32,703 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452795872340_0001
2016-01-14 18:24:32,705 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:24:32,705 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:24:32,705 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:24:32,705 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:24:32,706 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:24:32,707 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:24:32,708 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:24:32,708 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:24:32,708 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:24:32,709 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:24:32,709 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:24:32,710 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:24:32,710 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:24:32,716 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/51F7D880CBDC48BD9D07603529D5D3BE/C7210C48337944A3B7583FB34FDC4C78/.tez/application_1452795872340_0001
2016-01-14 18:24:32,716 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.415
2016-01-14 18:24:32,774 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-01-14 18:24:32,806 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:24:32,807 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:24:32,860 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 18:24:32,876 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.034
2016-01-14 18:24:32,876 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:32,877 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:32,877 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:24:32,894 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 18:24:32,895 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-01-14 18:24:32,907 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 18:24:32,907 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:32,907 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-01-14 18:24:32,907 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 18:24:32,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 18:24:32,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 18:24:32,908 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...Text/quoted/normcharfalse
2016-01-14 18:24:32,909 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:24:32,924 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 18:24:32,929 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:32,929 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:24:32,930 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:24:32,939 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B/.tez/application_1452795872929_0001 doesn't exist and is created
2016-01-14 18:24:32,953 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:24:32,953 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:32,954 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B/.tez/application_1452795872929_0001
2016-01-14 18:24:32,956 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452795872929_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:32,968 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:24:32,969 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:24:32,971 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:24:32,971 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:24:32,971 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B/.tez/application_1452795872929_0001/localmode-log-dir
2016-01-14 18:24:32,971 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B/.tez/application_1452795872929_0001/localmode-log-dir/history.txt.appattempt_1452795872929_0001_000000, maxErrors=10
2016-01-14 18:24:32,972 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:24:32,972 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452795872929_0001_000000, appSubmitTime=1452795872955, launchTime=1452795872955
2016-01-14 18:24:32,978 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:24:32,980 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:24:32,981 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:24:32,982 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:24:32,985 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:49588
2016-01-14 18:24:32,987 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:24:32,989 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452795872929_0001_000000, startTime=1452795872989
2016-01-14 18:24:32,989 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:24:32,989 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:24:33,053 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:24:33,053 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:24:33,053 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452795872929_0001, dagName=[528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 18:24:33,078 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 18:24:33,079 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452795872929_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B/.tez/application_1452795872929_0001/localmode-log-dir/dag_1452795872929_0001_1.dot
2016-01-14 18:24:33,080 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B/.tez/application_1452795872929_0001/localmode-log-dir/dag_1452795872929_0001_1-tez-dag.pb.txt
2016-01-14 18:24:33,104 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795872929_0001_1
2016-01-14 18:24:33,105 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:33,105 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 18:24:33 Running Dag: dag_1452795872929_0001_1
2016-01-14 18:24:33,120 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452795872929_0001_1, submitTime=1452795873078
2016-01-14 18:24:33,121 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:24:33,121 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex EAA35BAB2B884F12A0D69E903A6AD899
2016-01-14 18:24:33,121 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:24:33,122 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452795872929_0001_1, initTime=1452795873121
2016-01-14 18:24:33,122 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:24:33,122 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795872929_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:24:33,124 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:DAG_STARTED]: dagID=dag_1452795872929_0001_1, startTime=1452795873123
2016-01-14 18:24:33,124 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:24:33,124 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795872929_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:24:33,124 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: EAA35BAB2B884F12A0D69E903A6AD899 : {C401F9B5DBF54A39BF09D16BEC4C2EC5={InputName=C401F9B5DBF54A39BF09D16BEC4C2EC5}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:24:33,124 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: C401F9B5DBF54A39BF09D16BEC4C2EC5, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:24:33,124 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,125 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,125 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,125 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]. Starting root input initializers: 1
2016-01-14 18:24:33,125 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:24:33,126 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:24:33,127 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452795872929_0001, dagName=[528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 18:24:33,132 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: C401F9B5DBF54A39BF09D16BEC4C2EC5 on vertex vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,135 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:24:33,136 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input C401F9B5DBF54A39BF09D16BEC4C2EC5 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:24:33,137 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:24:33,138 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:24:33,142 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 18:24:33,145 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: C401F9B5DBF54A39BF09D16BEC4C2EC5 on vertex vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,146 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:33,146 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {C401F9B5DBF54A39BF09D16BEC4C2EC5=forAllWorkUnits=true, update=[1]}
2016-01-14 18:24:33,146 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899] parallelism set to 1
2016-01-14 18:24:33,146 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:33,147 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452795872929_0001_1_00, eventCount=1
2016-01-14 18:24:33,147 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,147 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=A26BDC89F9A2494D9D6EAF3ACEF33CDA, vertexId=vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:24:33,147 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=A26BDC89F9A2494D9D6EAF3ACEF33CDA, vertexId=vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,150 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=A26BDC89F9A2494D9D6EAF3ACEF33CDA, vertexName=EAA35BAB2B884F12A0D69E903A6AD899, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:24:33,150 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=A26BDC89F9A2494D9D6EAF3ACEF33CDA, vertexId=vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,152 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:24:33,154 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:VERTEX_INITIALIZED]: vertexName=EAA35BAB2B884F12A0D69E903A6AD899, vertexId=vertex_1452795872929_0001_1_00, initRequestedTime=1452795873124, initedTime=1452795873152, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:24:33,155 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899] with distanceFromRoot: 0
2016-01-14 18:24:33,156 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:24:33,156 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in EAA35BAB2B884F12A0D69E903A6AD899
2016-01-14 18:24:33,157 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,158 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:24:33,159 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452795872929_0001_1_00, startRequestedTime=1452795873156, startedTime=1452795873156
2016-01-14 18:24:33,159 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452795872929_0001, with dag id: dag_1452795872929_0001_1
2016-01-14 18:24:33,159 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:24:33,163 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:24:33,163 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:TASK_STARTED]: vertexName=EAA35BAB2B884F12A0D69E903A6AD899, taskId=task_1452795872929_0001_1_00_000000, scheduledTime=1452795873163, launchTime=1452795873163
2016-01-14 18:24:33,164 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795872929_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:24:33,164 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,164 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: EAA35BAB2B884F12A0D69E903A6AD899, VertexParallelism: 1, TaskAttemptID:attempt_1452795872929_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C401F9B5DBF54A39BF09D16BEC4C2EC5, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A26BDC89F9A2494D9D6EAF3ACEF33CDA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:33,164 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795872929_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:24:33,165 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:24:33,167 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:24:33,168 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:24:33,169 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:24:33,169 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452795872929_0001_00_000001
2016-01-14 18:24:33,170 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872929_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:24:33,171 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452795872929_0001_00_000001
2016-01-14 18:24:33,172 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:24:33,173 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872929_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:24:33,173 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:24:33,174 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452795872929_0001_00_000001, launchTime=1452795873173
2016-01-14 18:24:33,174 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795872929_0001_00_000001
2016-01-14 18:24:33,176 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452795872929_0001_1_00_000000_0] to container: [container_1452795872929_0001_00_000001]
2016-01-14 18:24:33,176 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872929_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:24:33,177 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452795872929_0001_00_000001 given task: attempt_1452795872929_0001_1_00_000000_0
2016-01-14 18:24:33,177 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452795872929_0001_1_00_000000_0] started. Is using containerId: [container_1452795872929_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:24:33,178 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:24:33,178 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=EAA35BAB2B884F12A0D69E903A6AD899, taskAttemptId=attempt_1452795872929_0001_1_00_000000_0, startTime=1452795873177, containerId=container_1452795872929_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452795872929_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:24:33,178 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795872929_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:24:33,178 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795872929_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452795872929_0001_1_00_000000_0
2016-01-14 18:24:33,178 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795872929_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:24:33 Starting to run new task attempt: attempt_1452795872929_0001_1_00_000000_0
2016-01-14 18:24:33,180 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452795872929_0001_1_00_000000_0
2016-01-14 18:24:33,180 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:33,180 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:24:33,181 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:24:33,181 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:24:33,181 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:24:33,181 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:24:33,181 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: EAA35BAB2B884F12A0D69E903A6AD899, VertexParallelism: 1, TaskAttemptID:attempt_1452795872929_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C401F9B5DBF54A39BF09D16BEC4C2EC5, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A26BDC89F9A2494D9D6EAF3ACEF33CDA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:33,181 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:24:33,183 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452795872929_0001_1_00_000000_0
2016-01-14 18:24:33,187 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:24:33,187 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:33,191 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452795872929_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:24:33,191 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:33,193 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=A26BDC89F9A2494D9D6EAF3ACEF33CDA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:24:33,193 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:24:33,194 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: A26BDC89F9A2494D9D6EAF3ACEF33CDA
2016-01-14 18:24:33,194 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:24:33,195 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: A26BDC89F9A2494D9D6EAF3ACEF33CDA
2016-01-14 18:24:33,195 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=C401F9B5DBF54A39BF09D16BEC4C2EC5, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:24:33,197 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:24:33,197 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: C401F9B5DBF54A39BF09D16BEC4C2EC5
2016-01-14 18:24:33,198 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: C401F9B5DBF54A39BF09D16BEC4C2EC5
2016-01-14 18:24:33,196 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:24:33,208 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:24:33,209 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: C401F9B5DBF54A39BF09D16BEC4C2EC5
2016-01-14 18:24:33,209 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: C401F9B5DBF54A39BF09D16BEC4C2EC5
2016-01-14 18:24:33,213 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:24:33,213 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: A26BDC89F9A2494D9D6EAF3ACEF33CDA
2016-01-14 18:24:33,218 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: EAA35BAB2B884F12A0D69E903A6AD899, ordinal: 0
2016-01-14 18:24:33,218 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EAA35BAB2B884F12A0D69E903A6AD899, mem on start (mb), free: 278, total: 397, max: 672
2016-01-14 18:24:33,219 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:33,220 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:24:33,220 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:24:33,220 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:24:33,221 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:24:33,222 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:24:33,222 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:33,223 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:24:33,223 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:33,224 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:24:33,225 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:24:33,225 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, A26BDC89F9A2494D9D6EAF3ACEF33CDA, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:24:33,226 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, C401F9B5DBF54A39BF09D16BEC4C2EC5, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:24:33,226 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:24:33,227 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: C401F9B5DBF54A39BF09D16BEC4C2EC5
2016-01-14 18:24:33,227 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:33,227 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: C401F9B5DBF54A39BF09D16BEC4C2EC5
2016-01-14 18:24:33,228 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: C401F9B5DBF54A39BF09D16BEC4C2EC5 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:24:33,228 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:24:33,228 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:24:33,228 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:24:33,229 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452795872929_0001_1_00_000000_0
2016-01-14 18:24:33,232 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:24:33,233 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@6be70c74
2016-01-14 18:24:33,233 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:33,234 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: C401F9B5DBF54A39BF09D16BEC4C2EC5
2016-01-14 18:24:33,234 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"], id: A26BDC89F9A2494D9D6EAF3ACEF33CDA
2016-01-14 18:24:33,235 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-01-14 18:24:33,235 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:33,236 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:33,237 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@6be70c74
2016-01-14 18:24:33,237 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:24:33,237 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:24:33,238 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: EAA35BAB2B884F12A0D69E903A6AD899, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:24:33,243 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:24:33,244 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:24:33,245 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452795872929_0001_1_00_000000_0
2016-01-14 18:24:33,246 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452795872929_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:24:33,247 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452795872929_0001_1_00_000000_0
2016-01-14 18:24:33,247 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EAA35BAB2B884F12A0D69E903A6AD899, mem on close (mb), free: 277, total: 397, max: 672
2016-01-14 18:24:33 Completed running task attempt: attempt_1452795872929_0001_1_00_000000_0
2016-01-14 18:24:33,249 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452795872929_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:24:33,251 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452795873238, Process_Duration=9, Process_End_Time=1452795873247, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 18:24:33,251 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:24:33,251 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:24:33,252 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=EAA35BAB2B884F12A0D69E903A6AD899, taskAttemptId=attempt_1452795872929_0001_1_00_000000_0, startTime=1452795873177, finishTime=1452795873251, timeTaken=74, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795873238, Process_Duration=9, Process_End_Time=1452795873247, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:33,252 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795872929_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:24:33,252 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452795872929_0001_1_00_000000_0
2016-01-14 18:24:33,252 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:33,252 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795872929_0001_00_000001
2016-01-14 18:24:33,253 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:24:33,254 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:24:33,254 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:TASK_FINISHED]: vertexName=EAA35BAB2B884F12A0D69E903A6AD899, taskId=task_1452795872929_0001_1_00_000000, startTime=1452795873177, finishTime=1452795873252, timeTaken=75, status=SUCCEEDED, successfulAttemptID=attempt_1452795872929_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795873238, Process_Duration=9, Process_End_Time=1452795873247, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:33,254 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795872929_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:24:33,255 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899] : 1
2016-01-14 18:24:33,255 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,257 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:VERTEX_FINISHED]: vertexName=EAA35BAB2B884F12A0D69E903A6AD899, vertexId=vertex_1452795872929_0001_1_00, initRequestedTime=1452795873124, initedTime=1452795873152, startRequestedTime=1452795873156, startedTime=1452795873156, finishTime=1452795873255, timeTaken=99, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795873238, Process_Duration=9, Process_End_Time=1452795873247, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452795873177, firstTasksToStart=[ task_1452795872929_0001_1_00_000000 ], lastTaskFinishTime=1452795873251, lastTasksToFinish=[ task_1452795872929_0001_1_00_000000 ], minTaskDuration=74, maxTaskDuration=74, avgTaskDuration=74.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452795872929_0001_1_00_000000 ], longestDurationTasks=[ task_1452795872929_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:24:33,257 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:24:33,257 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:24:33,258 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872929_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:24:33,259 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452795872929_0001_00_000001, stoppedTime=1452795873259, exitStatus=0
2016-01-14 18:24:33,259 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872929_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:24:33,259 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:24:33,259 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452795872929_0001_1
2016-01-14 18:24:33,259 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452795872929_0001_1
2016-01-14 18:24:33,260 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: A26BDC89F9A2494D9D6EAF3ACEF33CDA for vertex: vertex_1452795872929_0001_1_00 [EAA35BAB2B884F12A0D69E903A6AD899]
2016-01-14 18:24:33,260 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:24:33,264 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452795872929_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:24:33,264 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795872929_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:24:33,265 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452795872929_0001_00_000001, Exiting
2016-01-14 18:24:33,265 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452795872929_0001_00_000001
2016-01-14 18:24:33,265 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452795872929_0001_00_000001
2016-01-14 18:24:33,268 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452795872929_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:24:33,269 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452795872929_0001_00_000001 completed successfully
2016-01-14 18:24:33,271 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452795872929_0001_1, queueSize=0
2016-01-14 18:24:33,271 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:24:33,272 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795872929_0001_1][Event:DAG_FINISHED]: dagId=dag_1452795872929_0001_1, startTime=1452795873123, finishTime=1452795873269, timeTaken=146, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795873238, Process_Duration=9, Process_End_Time=1452795873247, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 18:24:33,272 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452795872929_0001_1 finished with state: SUCCEEDED
2016-01-14 18:24:33,273 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795872929_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:24:33,274 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452795872929_0001_00_000001
2016-01-14 18:24:33,275 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795872929_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:24:33 Completed Dag: dag_1452795872929_0001_1
2016-01-14 18:24:33,278 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452795872929_0001_1, dagState=SUCCEEDED
2016-01-14 18:24:33,278 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795872929_0001_1_post
2016-01-14 18:24:33,278 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:33,279 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:24:33,284 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452795872929_0001
2016-01-14 18:24:33,287 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:24:33,287 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:24:33,287 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:24:33,287 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:24:33,287 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:24:33,290 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:24:33,290 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:24:33,290 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:24:33,291 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:24:33,291 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:24:33,291 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:24:33,292 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:24:33,292 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:24:33,297 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/528E644B1D1D4C69A5CD47D72F809BAA/F0C71AC5193D473F99CE12BB1AAC240B/.tez/application_1452795872929_0001
2016-01-14 18:24:33,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.391
2016-01-14 18:24:33,455 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-01-14 18:24:33,652 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:24:33,653 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:24:33,713 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 18:24:33,730 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-14 18:24:33,730 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:33,731 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:33,731 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:24:33,747 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt
2016-01-14 18:24:33,748 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-01-14 18:24:33,773 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 18:24:33,773 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 18:24:33,773 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-01-14 18:24:33,773 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 18:24:33,774 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 18:24:33,774 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 18:24:33,774 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...oercion/testFieldCoercion
2016-01-14 18:24:33,775 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:24:33,790 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 18:24:33,794 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:33,795 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:24:33,795 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:24:33,804 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05/.tez/application_1452795873795_0001 doesn't exist and is created
2016-01-14 18:24:33,819 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:24:33,819 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:33,819 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05/.tez/application_1452795873795_0001
2016-01-14 18:24:33,821 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452795873795_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:33,835 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:24:33,836 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:24:33,839 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:24:33,840 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:24:33,840 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05/.tez/application_1452795873795_0001/localmode-log-dir
2016-01-14 18:24:33,841 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05/.tez/application_1452795873795_0001/localmode-log-dir/history.txt.appattempt_1452795873795_0001_000000, maxErrors=10
2016-01-14 18:24:33,841 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:24:33,841 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452795873795_0001_000000, appSubmitTime=1452795873821, launchTime=1452795873821
2016-01-14 18:24:33,845 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:24:33,846 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:24:33,847 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:24:33,848 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:24:33,852 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:35901
2016-01-14 18:24:33,853 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:24:33,856 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452795873795_0001_000000, startTime=1452795873856
2016-01-14 18:24:33,856 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:24:33,856 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:24:33,919 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:24:33,920 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:24:33,920 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452795873795_0001, dagName=[D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 18:24:33,941 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 18:24:33,943 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452795873795_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05/.tez/application_1452795873795_0001/localmode-log-dir/dag_1452795873795_0001_1.dot
2016-01-14 18:24:33,944 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05/.tez/application_1452795873795_0001/localmode-log-dir/dag_1452795873795_0001_1-tez-dag.pb.txt
2016-01-14 18:24:33,957 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795873795_0001_1
2016-01-14 18:24:33,958 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:33,958 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 18:24:33 Running Dag: dag_1452795873795_0001_1
2016-01-14 18:24:33,969 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:24:33,970 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452795873795_0001_1, submitTime=1452795873941
2016-01-14 18:24:33,970 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A1D4E6FC9F9B4D548516853A0B02E2E5
2016-01-14 18:24:33,971 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:24:33,971 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:24:33,972 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452795873795_0001_1, initTime=1452795873970
2016-01-14 18:24:33,972 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795873795_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:24:33,973 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:DAG_STARTED]: dagID=dag_1452795873795_0001_1, startTime=1452795873972
2016-01-14 18:24:33,973 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:24:33,973 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:24:33,973 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795873795_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:24:33,973 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A1D4E6FC9F9B4D548516853A0B02E2E5 : {78852AB3F7774C2C8FD8EEE4754BEFE7={InputName=78852AB3F7774C2C8FD8EEE4754BEFE7}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:24:33,974 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 78852AB3F7774C2C8FD8EEE4754BEFE7, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:24:33,974 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:33,974 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:33,974 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:33,973 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452795873795_0001, dagName=[D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 18:24:33,974 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]. Starting root input initializers: 1
2016-01-14 18:24:33,975 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:24:33,976 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 78852AB3F7774C2C8FD8EEE4754BEFE7 on vertex vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:33,979 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:24:33,980 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 78852AB3F7774C2C8FD8EEE4754BEFE7 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:24:33,981 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:24:33,981 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:24:33,985 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 420
2016-01-14 18:24:33,985 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 78852AB3F7774C2C8FD8EEE4754BEFE7 on vertex vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:33,986 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:33,986 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {78852AB3F7774C2C8FD8EEE4754BEFE7=forAllWorkUnits=true, update=[1]}
2016-01-14 18:24:33,986 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5] parallelism set to 1
2016-01-14 18:24:33,987 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:33,987 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452795873795_0001_1_00, eventCount=1
2016-01-14 18:24:33,987 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:33,987 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=882DF94003CE44B5836BE305CDD713D7, vertexId=vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:24:33,987 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=882DF94003CE44B5836BE305CDD713D7, vertexId=vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:33,990 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=882DF94003CE44B5836BE305CDD713D7, vertexName=A1D4E6FC9F9B4D548516853A0B02E2E5, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:24:33,991 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=882DF94003CE44B5836BE305CDD713D7, vertexId=vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:33,992 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:24:33,993 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A1D4E6FC9F9B4D548516853A0B02E2E5, vertexId=vertex_1452795873795_0001_1_00, initRequestedTime=1452795873973, initedTime=1452795873992, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:24:33,994 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5] with distanceFromRoot: 0
2016-01-14 18:24:33,996 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:24:33,997 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A1D4E6FC9F9B4D548516853A0B02E2E5
2016-01-14 18:24:33,997 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:33,998 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452795873795_0001, with dag id: dag_1452795873795_0001_1
2016-01-14 18:24:33,999 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452795873795_0001_1_00, startRequestedTime=1452795873997, startedTime=1452795873997
2016-01-14 18:24:33,999 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:24:34,000 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:24:34,000 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:24:34,001 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:TASK_STARTED]: vertexName=A1D4E6FC9F9B4D548516853A0B02E2E5, taskId=task_1452795873795_0001_1_00_000000, scheduledTime=1452795874000, launchTime=1452795874000
2016-01-14 18:24:34,002 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795873795_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:24:34,003 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:34,004 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: A1D4E6FC9F9B4D548516853A0B02E2E5, VertexParallelism: 1, TaskAttemptID:attempt_1452795873795_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=78852AB3F7774C2C8FD8EEE4754BEFE7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=882DF94003CE44B5836BE305CDD713D7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:34,004 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795873795_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:24:34,005 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:24:34,008 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:24:34,009 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:24:34,010 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:24:34,010 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452795873795_0001_00_000001
2016-01-14 18:24:34,010 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795873795_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:24:34,014 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452795873795_0001_00_000001
2016-01-14 18:24:34,014 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:24:34,014 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:24:34,015 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452795873795_0001_00_000001, launchTime=1452795874014
2016-01-14 18:24:34,016 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795873795_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:24:34,018 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795873795_0001_00_000001
2016-01-14 18:24:34,019 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452795873795_0001_1_00_000000_0] to container: [container_1452795873795_0001_00_000001]
2016-01-14 18:24:34,019 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795873795_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:24:34,020 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452795873795_0001_1_00_000000_0] started. Is using containerId: [container_1452795873795_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:24:34,020 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A1D4E6FC9F9B4D548516853A0B02E2E5, taskAttemptId=attempt_1452795873795_0001_1_00_000000_0, startTime=1452795874020, containerId=container_1452795873795_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452795873795_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:24:34,021 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795873795_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:24:34,021 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795873795_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:24:34,021 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:24:34,022 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452795873795_0001_00_000001 given task: attempt_1452795873795_0001_1_00_000000_0
2016-01-14 18:24:34,022 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795873795_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452795873795_0001_1_00_000000_0
2016-01-14 18:24:34 Starting to run new task attempt: attempt_1452795873795_0001_1_00_000000_0
2016-01-14 18:24:34,024 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452795873795_0001_1_00_000000_0
2016-01-14 18:24:34,025 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:34,025 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:24:34,026 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:24:34,026 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:24:34,026 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:24:34,027 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:24:34,027 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: A1D4E6FC9F9B4D548516853A0B02E2E5, VertexParallelism: 1, TaskAttemptID:attempt_1452795873795_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=78852AB3F7774C2C8FD8EEE4754BEFE7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=882DF94003CE44B5836BE305CDD713D7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:34,029 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:24:34,030 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452795873795_0001_1_00_000000_0
2016-01-14 18:24:34,032 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:24:34,032 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:34,033 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452795873795_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:24:34,034 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=78852AB3F7774C2C8FD8EEE4754BEFE7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:24:34,034 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:24:34,035 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 78852AB3F7774C2C8FD8EEE4754BEFE7
2016-01-14 18:24:34,035 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 78852AB3F7774C2C8FD8EEE4754BEFE7
2016-01-14 18:24:34,036 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:34,036 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=882DF94003CE44B5836BE305CDD713D7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:24:34,037 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:24:34,037 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 882DF94003CE44B5836BE305CDD713D7
2016-01-14 18:24:34,037 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:24:34,037 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 882DF94003CE44B5836BE305CDD713D7
2016-01-14 18:24:34,042 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:24:34,044 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:24:34,048 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 78852AB3F7774C2C8FD8EEE4754BEFE7
2016-01-14 18:24:34,048 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 78852AB3F7774C2C8FD8EEE4754BEFE7
2016-01-14 18:24:34,055 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:24:34,055 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 882DF94003CE44B5836BE305CDD713D7
2016-01-14 18:24:34,058 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A1D4E6FC9F9B4D548516853A0B02E2E5, ordinal: 0
2016-01-14 18:24:34,058 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A1D4E6FC9F9B4D548516853A0B02E2E5, mem on start (mb), free: 174, total: 397, max: 672
2016-01-14 18:24:34,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:34,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:24:34,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:24:34,060 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:24:34,060 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:24:34,061 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:24:34,061 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:34,061 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:24:34,062 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:34,062 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:24:34,062 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:24:34,063 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 78852AB3F7774C2C8FD8EEE4754BEFE7, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:24:34,063 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 882DF94003CE44B5836BE305CDD713D7, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:24:34,063 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:24:34,064 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 78852AB3F7774C2C8FD8EEE4754BEFE7 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:24:34,064 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:24:34,064 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:24:34,064 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 78852AB3F7774C2C8FD8EEE4754BEFE7
2016-01-14 18:24:34,065 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:34,065 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 78852AB3F7774C2C8FD8EEE4754BEFE7
2016-01-14 18:24:34,065 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:24:34,065 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452795873795_0001_1_00_000000_0
2016-01-14 18:24:34,068 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:24:34,068 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@37c4a072
2016-01-14 18:24:34,069 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 18:24:34,071 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@37c4a072
2016-01-14 18:24:34,071 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:24:34,071 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:24:34,078 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"] streamed: true, id: 78852AB3F7774C2C8FD8EEE4754BEFE7
2016-01-14 18:24:34,078 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"], id: 882DF94003CE44B5836BE305CDD713D7
2016-01-14 18:24:34,081 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-01-14 18:24:34,157 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 18:24:34,157 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:34,157 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A1D4E6FC9F9B4D548516853A0B02E2E5, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:24:34,163 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:24:34,164 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:24:34,165 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452795873795_0001_1_00_000000_0
2016-01-14 18:24:34,165 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452795873795_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:24:34,166 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452795873795_0001_1_00_000000_0
2016-01-14 18:24:34,166 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A1D4E6FC9F9B4D548516853A0B02E2E5, mem on close (mb), free: 168, total: 397, max: 672
2016-01-14 18:24:34 Completed running task attempt: attempt_1452795873795_0001_1_00_000000_0
2016-01-14 18:24:34,167 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452795873795_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:24:34,168 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10][cascading.flow.SliceCounters Process_Begin_Time=1452795874158, Process_Duration=8, Process_End_Time=1452795874166, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=9, Tuples_Written=9]]
2016-01-14 18:24:34,168 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A1D4E6FC9F9B4D548516853A0B02E2E5, taskAttemptId=attempt_1452795873795_0001_1_00_000000_0, startTime=1452795874020, finishTime=1452795874168, timeTaken=148, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452795874158, Process_Duration=8, Process_End_Time=1452795874166, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 18:24:34,168 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:24:34,169 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:24:34,171 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:34,171 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795873795_0001_00_000001
2016-01-14 18:24:34,170 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795873795_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:24:34,171 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452795873795_0001_1_00_000000_0
2016-01-14 18:24:34,171 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:24:34,173 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:24:34,173 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:TASK_FINISHED]: vertexName=A1D4E6FC9F9B4D548516853A0B02E2E5, taskId=task_1452795873795_0001_1_00_000000, startTime=1452795874020, finishTime=1452795874171, timeTaken=151, status=SUCCEEDED, successfulAttemptID=attempt_1452795873795_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452795874158, Process_Duration=8, Process_End_Time=1452795874166, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 18:24:34,174 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795873795_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:24:34,174 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5] : 1
2016-01-14 18:24:34,174 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:34,175 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:24:34,176 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:VERTEX_FINISHED]: vertexName=A1D4E6FC9F9B4D548516853A0B02E2E5, vertexId=vertex_1452795873795_0001_1_00, initRequestedTime=1452795873973, initedTime=1452795873992, startRequestedTime=1452795873997, startedTime=1452795873997, finishTime=1452795874174, timeTaken=177, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452795874158, Process_Duration=8, Process_End_Time=1452795874166, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9, vertexStats=firstTaskStartTime=1452795874020, firstTasksToStart=[ task_1452795873795_0001_1_00_000000 ], lastTaskFinishTime=1452795874168, lastTasksToFinish=[ task_1452795873795_0001_1_00_000000 ], minTaskDuration=148, maxTaskDuration=148, avgTaskDuration=148.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452795873795_0001_1_00_000000 ], longestDurationTasks=[ task_1452795873795_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:24:34,176 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:24:34,176 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795873795_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:24:34,176 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452795873795_0001_00_000001, stoppedTime=1452795874176, exitStatus=0
2016-01-14 18:24:34,176 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:24:34,177 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795873795_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:24:34,177 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:24:34,177 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452795873795_0001_1
2016-01-14 18:24:34,177 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452795873795_0001_1
2016-01-14 18:24:34,177 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 882DF94003CE44B5836BE305CDD713D7 for vertex: vertex_1452795873795_0001_1_00 [A1D4E6FC9F9B4D548516853A0B02E2E5]
2016-01-14 18:24:34,181 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452795873795_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:24:34,182 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795873795_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:24:34,182 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452795873795_0001_00_000001, Exiting
2016-01-14 18:24:34,182 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452795873795_0001_00_000001
2016-01-14 18:24:34,182 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452795873795_0001_00_000001
2016-01-14 18:24:34,184 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452795873795_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:24:34,185 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452795873795_0001_00_000001 completed successfully
2016-01-14 18:24:34,186 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452795873795_0001_1, queueSize=0
2016-01-14 18:24:34,187 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:24:34,187 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795873795_0001_1][Event:DAG_FINISHED]: dagId=dag_1452795873795_0001_1, startTime=1452795873972, finishTime=1452795874185, timeTaken=213, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452795874158, Process_Duration=8, Process_End_Time=1452795874166, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 18:24:34,187 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452795873795_0001_1 finished with state: SUCCEEDED
2016-01-14 18:24:34,187 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795873795_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:24:34,188 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795873795_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:24:34,188 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452795873795_0001_00_000001
2016-01-14 18:24:34 Completed Dag: dag_1452795873795_0001_1
2016-01-14 18:24:34,189 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452795873795_0001_1, dagState=SUCCEEDED
2016-01-14 18:24:34,190 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795873795_0001_1_post
2016-01-14 18:24:34,190 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:34,190 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:24:34,196 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452795873795_0001
2016-01-14 18:24:34,198 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:24:34,198 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:24:34,198 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:24:34,198 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:24:34,198 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:24:34,199 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:24:34,200 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:24:34,201 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:24:34,201 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:24:34,201 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:24:34,201 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:24:34,202 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:24:34,202 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:24:34,207 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D5B4A0C18C9E45DAA8FA0BAB754E7D8D/DCAA3AC426664CA88E00EC071BB96D05/.tez/application_1452795873795_0001
2016-01-14 18:24:34,208 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.435
2016-01-14 18:24:34,256 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-01-14 18:24:34,293 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:24:34,293 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:24:34,399 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 18:24:34,415 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-01-14 18:24:34,416 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:34,417 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:34,417 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:24:34,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-header.txt
2016-01-14 18:24:34,448 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: __multisink_placeholder_DFE52094E2D4460F9297CB23C0963D42
2016-01-14 18:24:34,460 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 18:24:34,460 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 18:24:34,461 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-01-14 18:24:34,461 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 18:24:34,461 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 18:24:34,461 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 18:24:34,462 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...4E2D4460F9297CB23C0963D42
2016-01-14 18:24:34,462 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:24:34,476 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 18:24:34,481 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:34,481 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:24:34,481 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:24:34,490 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1/.tez/application_1452795874481_0001 doesn't exist and is created
2016-01-14 18:24:34,504 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:24:34,505 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:34,505 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1/.tez/application_1452795874481_0001
2016-01-14 18:24:34,508 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452795874481_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:34,522 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:24:34,523 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:24:34,524 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:24:34,525 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:24:34,525 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1/.tez/application_1452795874481_0001/localmode-log-dir
2016-01-14 18:24:34,525 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1/.tez/application_1452795874481_0001/localmode-log-dir/history.txt.appattempt_1452795874481_0001_000000, maxErrors=10
2016-01-14 18:24:34,525 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:24:34,525 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452795874481_0001_000000, appSubmitTime=1452795874508, launchTime=1452795874508
2016-01-14 18:24:34,529 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:24:34,533 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:24:34,536 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:33180
2016-01-14 18:24:34,538 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:24:34,539 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:24:34,542 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:24:34,544 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452795874481_0001_000000, startTime=1452795874544
2016-01-14 18:24:34,544 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:24:34,544 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:24:34,605 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:24:34,605 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:24:34,605 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...4E2D4460F9297CB23C0963D42, applicationId=application_1452795874481_0001, dagName=[7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1] pipe/(1/1) ...4E2D4460F9297CB23C0963D42
2016-01-14 18:24:34,624 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1] pipe/(1/1) ...4E2D4460F9297CB23C0963D42
2016-01-14 18:24:34,625 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452795874481_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1/.tez/application_1452795874481_0001/localmode-log-dir/dag_1452795874481_0001_1.dot
2016-01-14 18:24:34,626 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1/.tez/application_1452795874481_0001/localmode-log-dir/dag_1452795874481_0001_1-tez-dag.pb.txt
2016-01-14 18:24:34,636 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795874481_0001_1
2016-01-14 18:24:34,637 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:34,637 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1] pipe/(1/1) ...4E2D4460F9297CB23C0963D42
2016-01-14 18:24:34 Running Dag: dag_1452795874481_0001_1
2016-01-14 18:24:34,647 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452795874481_0001_1, submitTime=1452795874624
2016-01-14 18:24:34,647 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:24:34,648 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A7B15FA943B3481EBE41723AE80EF18B
2016-01-14 18:24:34,648 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:24:34,648 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452795874481_0001_1, initTime=1452795874647
2016-01-14 18:24:34,649 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795874481_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:24:34,648 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:24:34,650 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:DAG_STARTED]: dagID=dag_1452795874481_0001_1, startTime=1452795874649
2016-01-14 18:24:34,650 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:24:34,650 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795874481_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:24:34,650 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A7B15FA943B3481EBE41723AE80EF18B : {FE299403589B4601BE711EEE3D1E319B={InputName=FE299403589B4601BE711EEE3D1E319B}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:24:34,650 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: FE299403589B4601BE711EEE3D1E319B, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:24:34,650 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,650 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,650 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,650 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:24:34,651 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]. Starting root input initializers: 1
2016-01-14 18:24:34,651 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:24:34,651 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: FE299403589B4601BE711EEE3D1E319B on vertex vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,653 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...4E2D4460F9297CB23C0963D42, applicationId=application_1452795874481_0001, dagName=[7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1] pipe/(1/1) ...4E2D4460F9297CB23C0963D42
2016-01-14 18:24:34,653 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:24:34,653 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input FE299403589B4601BE711EEE3D1E319B asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:24:34,654 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:24:34,654 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:24:34,655 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 422
2016-01-14 18:24:34,656 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: FE299403589B4601BE711EEE3D1E319B on vertex vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,656 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:34,656 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {FE299403589B4601BE711EEE3D1E319B=forAllWorkUnits=true, update=[1]}
2016-01-14 18:24:34,657 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B] parallelism set to 1
2016-01-14 18:24:34,657 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:34,657 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452795874481_0001_1_00, eventCount=1
2016-01-14 18:24:34,657 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,657 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=D48669D2C9744D20B016FF3B05D0E8B4, vertexId=vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:24:34,658 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=D48669D2C9744D20B016FF3B05D0E8B4, vertexId=vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,659 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(120)) - Using mapred newApiCommitter.
2016-01-14 18:24:34,660 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=D48669D2C9744D20B016FF3B05D0E8B4, vertexName=A7B15FA943B3481EBE41723AE80EF18B, outputCommitterClass=org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2016-01-14 18:24:34,660 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=D48669D2C9744D20B016FF3B05D0E8B4, vertexId=vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,661 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A7B15FA943B3481EBE41723AE80EF18B, vertexId=vertex_1452795874481_0001_1_00, initRequestedTime=1452795874650, initedTime=1452795874661, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:24:34,661 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:24:34,662 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B] with distanceFromRoot: 0
2016-01-14 18:24:34,663 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:24:34,663 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A7B15FA943B3481EBE41723AE80EF18B
2016-01-14 18:24:34,663 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,664 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452795874481_0001_1_00, startRequestedTime=1452795874663, startedTime=1452795874663
2016-01-14 18:24:34,664 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:24:34,664 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:24:34,665 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:24:34,665 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:TASK_STARTED]: vertexName=A7B15FA943B3481EBE41723AE80EF18B, taskId=task_1452795874481_0001_1_00_000000, scheduledTime=1452795874664, launchTime=1452795874664
2016-01-14 18:24:34,665 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795874481_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:24:34,665 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,666 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1] pipe/(1/1) ...4E2D4460F9297CB23C0963D42, VertexName: A7B15FA943B3481EBE41723AE80EF18B, VertexParallelism: 1, TaskAttemptID:attempt_1452795874481_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=FE299403589B4601BE711EEE3D1E319B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D48669D2C9744D20B016FF3B05D0E8B4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:34,666 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795874481_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:24:34,666 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:24:34,670 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:24:34,671 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:24:34,672 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:24:34,672 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452795874481_0001_00_000001
2016-01-14 18:24:34,673 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795874481_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:24:34,675 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452795874481_0001_00_000001
2016-01-14 18:24:34,675 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:24:34,676 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795874481_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:24:34,676 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:24:34,677 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452795874481_0001_00_000001, launchTime=1452795874676
2016-01-14 18:24:34,677 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452795874481_0001, with dag id: dag_1452795874481_0001_1
2016-01-14 18:24:34,677 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795874481_0001_00_000001
2016-01-14 18:24:34,680 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452795874481_0001_1_00_000000_0] to container: [container_1452795874481_0001_00_000001]
2016-01-14 18:24:34,680 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795874481_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:24:34,680 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452795874481_0001_00_000001 given task: attempt_1452795874481_0001_1_00_000000_0
2016-01-14 18:24:34,680 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795874481_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452795874481_0001_1_00_000000_0
2016-01-14 18:24:34,681 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452795874481_0001_1_00_000000_0] started. Is using containerId: [container_1452795874481_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:24:34 Starting to run new task attempt: attempt_1452795874481_0001_1_00_000000_0
2016-01-14 18:24:34,681 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452795874481_0001_1_00_000000_0
2016-01-14 18:24:34,681 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:34,682 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:24:34,682 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A7B15FA943B3481EBE41723AE80EF18B, taskAttemptId=attempt_1452795874481_0001_1_00_000000_0, startTime=1452795874681, containerId=container_1452795874481_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452795874481_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:24:34,682 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:24:34,683 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:24:34,683 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:24:34,683 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:24:34,683 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:24:34,684 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1] pipe/(1/1) ...4E2D4460F9297CB23C0963D42, VertexName: A7B15FA943B3481EBE41723AE80EF18B, VertexParallelism: 1, TaskAttemptID:attempt_1452795874481_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=FE299403589B4601BE711EEE3D1E319B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D48669D2C9744D20B016FF3B05D0E8B4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:34,684 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:24:34,683 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795874481_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:24:34,685 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795874481_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:24:34,686 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452795874481_0001_1_00_000000_0
2016-01-14 18:24:34,686 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:24:34,686 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:34,687 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=FE299403589B4601BE711EEE3D1E319B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:24:34,688 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452795874481_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:24:34,688 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:34,688 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:24:34,688 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: FE299403589B4601BE711EEE3D1E319B
2016-01-14 18:24:34,689 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: FE299403589B4601BE711EEE3D1E319B
2016-01-14 18:24:34,690 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=D48669D2C9744D20B016FF3B05D0E8B4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:24:34,691 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:24:34,691 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:24:34,692 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: FE299403589B4601BE711EEE3D1E319B
2016-01-14 18:24:34,692 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: FE299403589B4601BE711EEE3D1E319B
2016-01-14 18:24:34,692 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: D48669D2C9744D20B016FF3B05D0E8B4
2016-01-14 18:24:34,692 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:24:34,692 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:24:34,693 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: D48669D2C9744D20B016FF3B05D0E8B4
2016-01-14 18:24:34,702 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: true
2016-01-14 18:24:34,702 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: D48669D2C9744D20B016FF3B05D0E8B4
2016-01-14 18:24:34,705 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A7B15FA943B3481EBE41723AE80EF18B, ordinal: 0
2016-01-14 18:24:34,705 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A7B15FA943B3481EBE41723AE80EF18B, mem on start (mb), free: 279, total: 372, max: 672
2016-01-14 18:24:34,706 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:34,706 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:24:34,706 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:24:34,706 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:24:34,706 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:24:34,708 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:24:34,708 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:34,708 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:24:34,708 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:34,708 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:24:34,709 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:24:34,709 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, FE299403589B4601BE711EEE3D1E319B, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:24:34,709 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, D48669D2C9744D20B016FF3B05D0E8B4, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:24:34,709 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:24:34,710 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: FE299403589B4601BE711EEE3D1E319B
2016-01-14 18:24:34,710 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:34,710 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: FE299403589B4601BE711EEE3D1E319B
2016-01-14 18:24:34,710 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: FE299403589B4601BE711EEE3D1E319B being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:24:34,711 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:24:34,711 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:24:34,711 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:24:34,711 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452795874481_0001_1_00_000000_0
2016-01-14 18:24:34,711 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:24:34,712 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5a87a7f9
2016-01-14 18:24:34,714 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5a87a7f9
2016-01-14 18:24:34,714 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:24:34,714 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:24:34,715 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 18:24:34,716 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"] streamed: true, id: FE299403589B4601BE711EEE3D1E319B
2016-01-14 18:24:34,716 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]], id: D48669D2C9744D20B016FF3B05D0E8B4
2016-01-14 18:24:34,717 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-01-14 18:24:34,719 INFO tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"]
2016-01-14 18:24:34,726 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14527958744810_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14527958744810_0001_m_000000_0
2016-01-14 18:24:34,727 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 18:24:34,734 INFO tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]
2016-01-14 18:24:34,741 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14527958744810_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14527958744810_0001_m_000000_0
2016-01-14 18:24:34,741 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 18:24:34,745 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 18:24:34,745 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:34,745 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A7B15FA943B3481EBE41723AE80EF18B, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:24:34,749 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/part-00000
2016-01-14 18:24:34,749 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14527958744810_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14527958744810_0001_m_000000_0
2016-01-14 18:24:34,753 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14527958744810_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-01-14 18:24:34,753 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/part-00000
2016-01-14 18:24:34,754 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14527958744810_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14527958744810_0001_m_000000_0
2016-01-14 18:24:34,756 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14527958744810_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-01-14 18:24:34,757 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452795874481_0001_1_00_000000_0
2016-01-14 18:24:34,757 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452795874481_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:24:34,757 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:24:34,757 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:24:34,758 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452795874481_0001_1_00_000000_0
2016-01-14 18:24:34,758 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A7B15FA943B3481EBE41723AE80EF18B, mem on close (mb), free: 271, total: 372, max: 672
2016-01-14 18:24:34 Completed running task attempt: attempt_1452795874481_0001_1_00_000000_0
2016-01-14 18:24:34,759 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452795874481_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:24:34,760 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=984, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452795874746, Process_Duration=12, Process_End_Time=1452795874758, Read_Duration=0, Tuples_Read=13, Tuples_Written=13, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=13, Tuples_Written=13]]
2016-01-14 18:24:34,761 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:24:34,761 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:34,760 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:24:34,761 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A7B15FA943B3481EBE41723AE80EF18B, taskAttemptId=attempt_1452795874481_0001_1_00_000000_0, startTime=1452795874681, finishTime=1452795874760, timeTaken=79, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=984, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452795874746, Process_Duration=12, Process_End_Time=1452795874758, Read_Duration=0, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 18:24:34,762 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795874481_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:24:34,762 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795874481_0001_00_000001
2016-01-14 18:24:34,762 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452795874481_0001_1_00_000000_0
2016-01-14 18:24:34,762 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:24:34,763 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:24:34,763 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:TASK_FINISHED]: vertexName=A7B15FA943B3481EBE41723AE80EF18B, taskId=task_1452795874481_0001_1_00_000000, startTime=1452795874681, finishTime=1452795874762, timeTaken=81, status=SUCCEEDED, successfulAttemptID=attempt_1452795874481_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=984, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452795874746, Process_Duration=12, Process_End_Time=1452795874758, Read_Duration=0, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 18:24:34,763 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795874481_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:24:34,763 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B] : 1
2016-01-14 18:24:34,764 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,765 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:24:34,765 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:VERTEX_FINISHED]: vertexName=A7B15FA943B3481EBE41723AE80EF18B, vertexId=vertex_1452795874481_0001_1_00, initRequestedTime=1452795874650, initedTime=1452795874661, startRequestedTime=1452795874663, startedTime=1452795874663, finishTime=1452795874764, timeTaken=101, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=984, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452795874746, Process_Duration=12, Process_End_Time=1452795874758, Read_Duration=0, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13, vertexStats=firstTaskStartTime=1452795874681, firstTasksToStart=[ task_1452795874481_0001_1_00_000000 ], lastTaskFinishTime=1452795874760, lastTasksToFinish=[ task_1452795874481_0001_1_00_000000 ], minTaskDuration=79, maxTaskDuration=79, avgTaskDuration=79.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452795874481_0001_1_00_000000 ], longestDurationTasks=[ task_1452795874481_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:24:34,765 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:24:34,766 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795874481_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:24:34,766 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452795874481_0001_00_000001, stoppedTime=1452795874766, exitStatus=0
2016-01-14 18:24:34,766 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795874481_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:24:34,766 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:24:34,767 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:24:34,767 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452795874481_0001_1
2016-01-14 18:24:34,767 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452795874481_0001_1
2016-01-14 18:24:34,768 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: D48669D2C9744D20B016FF3B05D0E8B4 for vertex: vertex_1452795874481_0001_1_00 [A7B15FA943B3481EBE41723AE80EF18B]
2016-01-14 18:24:34,773 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452795874481_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:24:34,773 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795874481_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:24:34,773 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452795874481_0001_00_000001, Exiting
2016-01-14 18:24:34,773 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452795874481_0001_00_000001
2016-01-14 18:24:34,773 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452795874481_0001_00_000001
2016-01-14 18:24:34,777 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452795874481_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:24:34,777 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452795874481_0001_00_000001 completed successfully
2016-01-14 18:24:34,779 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452795874481_0001_1, queueSize=0
2016-01-14 18:24:34,779 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:24:34,780 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795874481_0001_1][Event:DAG_FINISHED]: dagId=dag_1452795874481_0001_1, startTime=1452795874649, finishTime=1452795874776, timeTaken=127, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=984, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452795874746, Process_Duration=12, Process_End_Time=1452795874758, Read_Duration=0, Tuples_Read=13, Tuples_Written=13, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 18:24:34,780 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452795874481_0001_1 finished with state: SUCCEEDED
2016-01-14 18:24:34,781 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795874481_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:24:34,781 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452795874481_0001_00_000001
2016-01-14 18:24:34,781 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795874481_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:24:34 Completed Dag: dag_1452795874481_0001_1
2016-01-14 18:24:34,782 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452795874481_0001_1, dagState=SUCCEEDED
2016-01-14 18:24:34,782 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795874481_0001_1_post
2016-01-14 18:24:34,783 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:34,783 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:24:34,788 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...4E2D4460F9297CB23C0963D42, applicationId=application_1452795874481_0001
2016-01-14 18:24:34,791 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:24:34,791 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:24:34,791 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:24:34,791 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:24:34,791 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:24:34,791 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:24:34,792 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:24:34,792 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:24:34,792 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:24:34,793 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:24:34,793 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:24:34,794 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:24:34,794 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:24:34,799 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/7B044949E8504428A6FEF7D15C3E2811/ACAB735EC0F04E8DA8FFD28C78559CA1/.tez/application_1452795874481_0001
2016-01-14 18:24:34,799 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.339
2016-01-14 18:24:34,931 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-01-14 18:24:34,932 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-01-14 18:24:34,958 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:24:34,958 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:24:34,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 18:24:35,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 18:24:35,009 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:35,009 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:35,010 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:24:35,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 18:24:35,028 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header
2016-01-14 18:24:35,038 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 18:24:35,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:35,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-01-14 18:24:35,041 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 18:24:35,041 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 18:24:35,042 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 18:24:35,042 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...latform/testHeader/header
2016-01-14 18:24:35,043 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:24:35,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 18:24:35,063 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:35,064 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:24:35,065 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:24:35,073 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751/.tez/application_1452795875064_0001 doesn't exist and is created
2016-01-14 18:24:35,087 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:24:35,088 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:35,088 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751/.tez/application_1452795875064_0001
2016-01-14 18:24:35,090 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452795875064_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:35,102 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:24:35,103 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:24:35,105 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:24:35,105 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:24:35,105 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751/.tez/application_1452795875064_0001/localmode-log-dir
2016-01-14 18:24:35,105 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751/.tez/application_1452795875064_0001/localmode-log-dir/history.txt.appattempt_1452795875064_0001_000000, maxErrors=10
2016-01-14 18:24:35,106 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:24:35,106 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452795875064_0001_000000, appSubmitTime=1452795875090, launchTime=1452795875090
2016-01-14 18:24:35,109 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:24:35,111 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:24:35,112 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:24:35,112 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:24:35,117 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:53255
2016-01-14 18:24:35,118 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:24:35,121 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452795875064_0001_000000, startTime=1452795875121
2016-01-14 18:24:35,121 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:24:35,121 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:24:35,188 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:24:35,188 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:24:35,188 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452795875064_0001, dagName=[06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751] pipe/(1/1) ...latform/testHeader/header
2016-01-14 18:24:35,209 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751] pipe/(1/1) ...latform/testHeader/header
2016-01-14 18:24:35,210 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452795875064_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751/.tez/application_1452795875064_0001/localmode-log-dir/dag_1452795875064_0001_1.dot
2016-01-14 18:24:35,211 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751/.tez/application_1452795875064_0001/localmode-log-dir/dag_1452795875064_0001_1-tez-dag.pb.txt
2016-01-14 18:24:35,223 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795875064_0001_1
2016-01-14 18:24:35,223 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:35,223 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751] pipe/(1/1) ...latform/testHeader/header
2016-01-14 18:24:35 Running Dag: dag_1452795875064_0001_1
2016-01-14 18:24:35,233 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452795875064_0001_1, submitTime=1452795875209
2016-01-14 18:24:35,233 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:24:35,234 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E302F0E0D19B4D43A595F6E191B698A9
2016-01-14 18:24:35,234 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:24:35,234 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452795875064_0001_1, initTime=1452795875233
2016-01-14 18:24:35,235 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795875064_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:24:35,234 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:24:35,237 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:DAG_STARTED]: dagID=dag_1452795875064_0001_1, startTime=1452795875236
2016-01-14 18:24:35,237 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:24:35,237 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:24:35,237 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795875064_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:24:35,237 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E302F0E0D19B4D43A595F6E191B698A9 : {CE7F33652A09400CB21FCB3D126CC713={InputName=CE7F33652A09400CB21FCB3D126CC713}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:24:35,237 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: CE7F33652A09400CB21FCB3D126CC713, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:24:35,238 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,238 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,238 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,238 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452795875064_0001, dagName=[06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751] pipe/(1/1) ...latform/testHeader/header
2016-01-14 18:24:35,238 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]. Starting root input initializers: 1
2016-01-14 18:24:35,239 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:24:35,239 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: CE7F33652A09400CB21FCB3D126CC713 on vertex vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,241 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:24:35,241 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input CE7F33652A09400CB21FCB3D126CC713 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:24:35,241 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:24:35,241 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:24:35,243 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 18:24:35,243 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: CE7F33652A09400CB21FCB3D126CC713 on vertex vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,244 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:35,244 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {CE7F33652A09400CB21FCB3D126CC713=forAllWorkUnits=true, update=[1]}
2016-01-14 18:24:35,244 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9] parallelism set to 1
2016-01-14 18:24:35,244 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:35,244 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452795875064_0001_1_00, eventCount=1
2016-01-14 18:24:35,245 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,245 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=CF85A999BECE48C7B426BCF90390738D, vertexId=vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:24:35,245 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=CF85A999BECE48C7B426BCF90390738D, vertexId=vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,247 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=CF85A999BECE48C7B426BCF90390738D, vertexName=E302F0E0D19B4D43A595F6E191B698A9, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:24:35,247 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=CF85A999BECE48C7B426BCF90390738D, vertexId=vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,249 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:24:35,249 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E302F0E0D19B4D43A595F6E191B698A9, vertexId=vertex_1452795875064_0001_1_00, initRequestedTime=1452795875237, initedTime=1452795875247, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:24:35,249 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9] with distanceFromRoot: 0
2016-01-14 18:24:35,250 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:24:35,250 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E302F0E0D19B4D43A595F6E191B698A9
2016-01-14 18:24:35,250 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,251 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:24:35,251 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452795875064_0001_1_00, startRequestedTime=1452795875250, startedTime=1452795875250
2016-01-14 18:24:35,251 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:24:35,252 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:24:35,252 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:TASK_STARTED]: vertexName=E302F0E0D19B4D43A595F6E191B698A9, taskId=task_1452795875064_0001_1_00_000000, scheduledTime=1452795875252, launchTime=1452795875252
2016-01-14 18:24:35,253 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795875064_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:24:35,253 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,253 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751] pipe/(1/1) ...latform/testHeader/header, VertexName: E302F0E0D19B4D43A595F6E191B698A9, VertexParallelism: 1, TaskAttemptID:attempt_1452795875064_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CE7F33652A09400CB21FCB3D126CC713, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CF85A999BECE48C7B426BCF90390738D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:35,254 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795875064_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:24:35,254 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:24:35,255 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:24:35,256 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:24:35,256 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:24:35,256 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452795875064_0001_00_000001
2016-01-14 18:24:35,257 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795875064_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:24:35,259 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452795875064_0001_00_000001
2016-01-14 18:24:35,259 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:24:35,260 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795875064_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:24:35,260 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:24:35,261 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452795875064_0001_00_000001, launchTime=1452795875260
2016-01-14 18:24:35,261 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795875064_0001_00_000001
2016-01-14 18:24:35,262 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452795875064_0001_1_00_000000_0] to container: [container_1452795875064_0001_00_000001]
2016-01-14 18:24:35,262 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795875064_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:24:35,263 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452795875064_0001_1_00_000000_0] started. Is using containerId: [container_1452795875064_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:24:35,263 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E302F0E0D19B4D43A595F6E191B698A9, taskAttemptId=attempt_1452795875064_0001_1_00_000000_0, startTime=1452795875263, containerId=container_1452795875064_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452795875064_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:24:35,263 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795875064_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:24:35,264 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795875064_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:24:35,264 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:24:35,264 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452795875064_0001_00_000001 given task: attempt_1452795875064_0001_1_00_000000_0
2016-01-14 18:24:35,264 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795875064_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452795875064_0001_1_00_000000_0
2016-01-14 18:24:35 Starting to run new task attempt: attempt_1452795875064_0001_1_00_000000_0
2016-01-14 18:24:35,265 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452795875064_0001_1_00_000000_0
2016-01-14 18:24:35,265 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452795875064_0001, with dag id: dag_1452795875064_0001_1
2016-01-14 18:24:35,265 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:35,266 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:24:35,266 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:24:35,266 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:24:35,266 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:24:35,266 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:24:35,266 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751] pipe/(1/1) ...latform/testHeader/header, VertexName: E302F0E0D19B4D43A595F6E191B698A9, VertexParallelism: 1, TaskAttemptID:attempt_1452795875064_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CE7F33652A09400CB21FCB3D126CC713, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CF85A999BECE48C7B426BCF90390738D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:35,267 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:24:35,270 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452795875064_0001_1_00_000000_0
2016-01-14 18:24:35,270 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:24:35,271 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:35,273 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=CE7F33652A09400CB21FCB3D126CC713, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:24:35,273 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=CF85A999BECE48C7B426BCF90390738D, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:24:35,274 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:24:35,273 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:35,274 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:24:35,274 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452795875064_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:24:35,275 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: CF85A999BECE48C7B426BCF90390738D
2016-01-14 18:24:35,276 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:24:35,276 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: CF85A999BECE48C7B426BCF90390738D
2016-01-14 18:24:35,276 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: CE7F33652A09400CB21FCB3D126CC713
2016-01-14 18:24:35,276 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: CE7F33652A09400CB21FCB3D126CC713
2016-01-14 18:24:35,282 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:24:35,284 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: CE7F33652A09400CB21FCB3D126CC713
2016-01-14 18:24:35,284 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: CE7F33652A09400CB21FCB3D126CC713
2016-01-14 18:24:35,286 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:24:35,291 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:24:35,291 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: CF85A999BECE48C7B426BCF90390738D
2016-01-14 18:24:35,296 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E302F0E0D19B4D43A595F6E191B698A9, ordinal: 0
2016-01-14 18:24:35,297 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E302F0E0D19B4D43A595F6E191B698A9, mem on start (mb), free: 176, total: 372, max: 672
2016-01-14 18:24:35,297 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:35,297 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:24:35,297 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:24:35,298 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:24:35,298 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:24:35,299 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:24:35,299 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:35,300 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:24:35,300 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:35,301 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:24:35,301 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:24:35,301 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, CF85A999BECE48C7B426BCF90390738D, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:24:35,301 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, CE7F33652A09400CB21FCB3D126CC713, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:24:35,302 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:24:35,302 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: CE7F33652A09400CB21FCB3D126CC713 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:24:35,302 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: CE7F33652A09400CB21FCB3D126CC713
2016-01-14 18:24:35,302 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:35,302 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: CE7F33652A09400CB21FCB3D126CC713
2016-01-14 18:24:35,302 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:24:35,303 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:24:35,303 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:24:35,304 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452795875064_0001_1_00_000000_0
2016-01-14 18:24:35,304 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:24:35,305 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1094d8ba
2016-01-14 18:24:35,306 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1094d8ba
2016-01-14 18:24:35,306 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:24:35,306 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:24:35,307 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:35,308 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: CE7F33652A09400CB21FCB3D126CC713
2016-01-14 18:24:35,308 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"], id: CF85A999BECE48C7B426BCF90390738D
2016-01-14 18:24:35,308 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-01-14 18:24:35,309 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 18:24:35,309 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:35,309 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E302F0E0D19B4D43A595F6E191B698A9, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:24:35,311 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:24:35,313 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:24:35,314 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452795875064_0001_1_00_000000_0
2016-01-14 18:24:35,314 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452795875064_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:24:35,315 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452795875064_0001_1_00_000000_0
2016-01-14 18:24:35,316 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E302F0E0D19B4D43A595F6E191B698A9, mem on close (mb), free: 174, total: 372, max: 672
2016-01-14 18:24:35 Completed running task attempt: attempt_1452795875064_0001_1_00_000000_0
2016-01-14 18:24:35,317 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452795875064_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:24:35,318 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E302F0E0D19B4D43A595F6E191B698A9, taskAttemptId=attempt_1452795875064_0001_1_00_000000_0, startTime=1452795875263, finishTime=1452795875318, timeTaken=55, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795875309, Process_Duration=6, Process_End_Time=1452795875315, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 18:24:35,319 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:24:35,319 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795875064_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:24:35,319 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452795875064_0001_1_00_000000_0
2016-01-14 18:24:35,319 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:24:35,320 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:24:35,320 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:TASK_FINISHED]: vertexName=E302F0E0D19B4D43A595F6E191B698A9, taskId=task_1452795875064_0001_1_00_000000, startTime=1452795875263, finishTime=1452795875319, timeTaken=56, status=SUCCEEDED, successfulAttemptID=attempt_1452795875064_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795875309, Process_Duration=6, Process_End_Time=1452795875315, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 18:24:35,320 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795875064_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:24:35,320 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9] : 1
2016-01-14 18:24:35,320 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,322 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:24:35,322 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:VERTEX_FINISHED]: vertexName=E302F0E0D19B4D43A595F6E191B698A9, vertexId=vertex_1452795875064_0001_1_00, initRequestedTime=1452795875237, initedTime=1452795875247, startRequestedTime=1452795875250, startedTime=1452795875250, finishTime=1452795875321, timeTaken=71, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795875309, Process_Duration=6, Process_End_Time=1452795875315, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1452795875263, firstTasksToStart=[ task_1452795875064_0001_1_00_000000 ], lastTaskFinishTime=1452795875318, lastTasksToFinish=[ task_1452795875064_0001_1_00_000000 ], minTaskDuration=55, maxTaskDuration=55, avgTaskDuration=55.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452795875064_0001_1_00_000000 ], longestDurationTasks=[ task_1452795875064_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:24:35,322 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:24:35,323 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795875064_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:24:35,323 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452795875064_0001_00_000001, stoppedTime=1452795875323, exitStatus=0
2016-01-14 18:24:35,323 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:24:35,323 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795875064_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:24:35,324 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:24:35,324 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452795875064_0001_1
2016-01-14 18:24:35,324 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452795875064_0001_1
2016-01-14 18:24:35,324 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452795875309, Process_Duration=6, Process_End_Time=1452795875315, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-01-14 18:24:35,324 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: CF85A999BECE48C7B426BCF90390738D for vertex: vertex_1452795875064_0001_1_00 [E302F0E0D19B4D43A595F6E191B698A9]
2016-01-14 18:24:35,325 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:24:35,326 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:35,327 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795875064_0001_00_000001
2016-01-14 18:24:35,327 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452795875064_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:24:35,328 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795875064_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:24:35,328 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452795875064_0001_00_000001, Exiting
2016-01-14 18:24:35,328 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452795875064_0001_00_000001
2016-01-14 18:24:35,328 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452795875064_0001_00_000001
2016-01-14 18:24:35,331 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452795875064_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:24:35,331 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452795875064_0001_00_000001 completed successfully
2016-01-14 18:24:35,336 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452795875064_0001_1, queueSize=0
2016-01-14 18:24:35,336 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:24:35,337 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875064_0001_1][Event:DAG_FINISHED]: dagId=dag_1452795875064_0001_1, startTime=1452795875236, finishTime=1452795875335, timeTaken=99, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=390594560, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452795875309, Process_Duration=6, Process_End_Time=1452795875315, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 18:24:35,337 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452795875064_0001_1 finished with state: SUCCEEDED
2016-01-14 18:24:35,338 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795875064_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:24:35,338 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795875064_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:24:35,338 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452795875064_0001_00_000001
2016-01-14 18:24:35 Completed Dag: dag_1452795875064_0001_1
2016-01-14 18:24:35,339 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452795875064_0001_1, dagState=SUCCEEDED
2016-01-14 18:24:35,339 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795875064_0001_1_post
2016-01-14 18:24:35,340 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:35,340 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:24:35,345 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452795875064_0001
2016-01-14 18:24:35,348 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:24:35,348 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:24:35,348 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:24:35,348 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:24:35,348 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:24:35,348 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:24:35,349 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:24:35,349 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:24:35,349 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:24:35,350 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:24:35,350 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:24:35,350 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:24:35,350 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:24:35,354 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/06FA34BD75404638BC21124B3CF3F02D/DB07EB6D17744CDBA57F53C5B5F62751/.tez/application_1452795875064_0001
2016-01-14 18:24:35,355 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.316
2016-01-14 18:24:35,393 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeader/header
2016-01-14 18:24:35,425 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:24:35,426 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:24:35,468 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 18:24:35,471 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:24:35,471 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:24:35,476 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 18:24:35,477 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:35,477 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:24:35,477 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:24:35,495 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt
2016-01-14 18:24:35,495 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic
2016-01-14 18:24:35,505 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 18:24:35,505 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 18:24:35,506 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-01-14 18:24:35,506 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 18:24:35,506 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 18:24:35,507 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 18:24:35,508 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...t/strict-nondeterministic
2016-01-14 18:24:35,509 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:24:35,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 18:24:35,528 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:35,529 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:24:35,529 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:24:35,540 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8/.tez/application_1452795875529_0001 doesn't exist and is created
2016-01-14 18:24:35,556 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:24:35,557 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:24:35,558 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8/.tez/application_1452795875529_0001
2016-01-14 18:24:35,560 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452795875529_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:24:35,594 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:24:35,595 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:24:35,597 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:24:35,597 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:24:35,597 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8/.tez/application_1452795875529_0001/localmode-log-dir
2016-01-14 18:24:35,598 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8/.tez/application_1452795875529_0001/localmode-log-dir/history.txt.appattempt_1452795875529_0001_000000, maxErrors=10
2016-01-14 18:24:35,598 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:24:35,598 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452795875529_0001_000000, appSubmitTime=1452795875559, launchTime=1452795875559
2016-01-14 18:24:35,602 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:24:35,605 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:24:35,606 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:24:35,606 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:24:35,609 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:41669
2016-01-14 18:24:35,611 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:24:35,613 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452795875529_0001_000000, startTime=1452795875612
2016-01-14 18:24:35,613 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:24:35,613 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:24:35,657 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:24:35,657 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:24:35,657 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452795875529_0001, dagName=[364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 18:24:35,677 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 18:24:35,678 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452795875529_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8/.tez/application_1452795875529_0001/localmode-log-dir/dag_1452795875529_0001_1.dot
2016-01-14 18:24:35,679 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8/.tez/application_1452795875529_0001/localmode-log-dir/dag_1452795875529_0001_1-tez-dag.pb.txt
2016-01-14 18:24:35,685 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795875529_0001_1
2016-01-14 18:24:35,685 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:35,686 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 18:24:35 Running Dag: dag_1452795875529_0001_1
2016-01-14 18:24:35,695 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452795875529_0001_1, submitTime=1452795875677
2016-01-14 18:24:35,695 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:24:35,696 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F9CECEFEBC324BACAA5EE5BEC1F3E267
2016-01-14 18:24:35,696 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:24:35,697 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452795875529_0001_1, initTime=1452795875695
2016-01-14 18:24:35,697 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:24:35,697 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795875529_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:24:35,698 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:DAG_STARTED]: dagID=dag_1452795875529_0001_1, startTime=1452795875698
2016-01-14 18:24:35,698 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:24:35,698 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:24:35,699 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795875529_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:24:35,699 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F9CECEFEBC324BACAA5EE5BEC1F3E267 : {0396ED98AF7648E0BED86BC530C86FBC={InputName=0396ED98AF7648E0BED86BC530C86FBC}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:24:35,699 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 0396ED98AF7648E0BED86BC530C86FBC, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:24:35,699 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,699 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452795875529_0001, dagName=[364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 18:24:35,699 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,699 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,700 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]. Starting root input initializers: 1
2016-01-14 18:24:35,700 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:24:35,700 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 0396ED98AF7648E0BED86BC530C86FBC on vertex vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,702 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:24:35,702 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 0396ED98AF7648E0BED86BC530C86FBC asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:24:35,707 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:24:35,707 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:24:35,709 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 432
2016-01-14 18:24:35,710 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 0396ED98AF7648E0BED86BC530C86FBC on vertex vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,711 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:35,711 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {0396ED98AF7648E0BED86BC530C86FBC=forAllWorkUnits=true, update=[1]}
2016-01-14 18:24:35,711 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] parallelism set to 1
2016-01-14 18:24:35,711 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:24:35,712 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452795875529_0001_1_00, eventCount=1
2016-01-14 18:24:35,712 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,712 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6DED81EEC0E64CDFB46630F8096BAECC, vertexId=vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:24:35,712 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6DED81EEC0E64CDFB46630F8096BAECC, vertexId=vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,714 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6DED81EEC0E64CDFB46630F8096BAECC, vertexName=F9CECEFEBC324BACAA5EE5BEC1F3E267, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:24:35,714 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6DED81EEC0E64CDFB46630F8096BAECC, vertexId=vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,718 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:24:35,718 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F9CECEFEBC324BACAA5EE5BEC1F3E267, vertexId=vertex_1452795875529_0001_1_00, initRequestedTime=1452795875699, initedTime=1452795875717, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:24:35,719 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] with distanceFromRoot: 0
2016-01-14 18:24:35,719 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:24:35,720 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F9CECEFEBC324BACAA5EE5BEC1F3E267
2016-01-14 18:24:35,720 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,721 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:24:35,721 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452795875529_0001_1_00, startRequestedTime=1452795875720, startedTime=1452795875720
2016-01-14 18:24:35,722 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:24:35,722 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:TASK_STARTED]: vertexName=F9CECEFEBC324BACAA5EE5BEC1F3E267, taskId=task_1452795875529_0001_1_00_000000, scheduledTime=1452795875722, launchTime=1452795875722
2016-01-14 18:24:35,722 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:24:35,722 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795875529_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:24:35,722 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,723 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8] pipe/(1/1) ...t/strict-nondeterministic, VertexName: F9CECEFEBC324BACAA5EE5BEC1F3E267, VertexParallelism: 1, TaskAttemptID:attempt_1452795875529_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0396ED98AF7648E0BED86BC530C86FBC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6DED81EEC0E64CDFB46630F8096BAECC, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:35,723 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795875529_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:24:35,723 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:24:35,724 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:24:35,724 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:24:35,724 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:24:35,725 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452795875529_0001_00_000001
2016-01-14 18:24:35,725 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795875529_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:24:35,725 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452795875529_0001, with dag id: dag_1452795875529_0001_1
2016-01-14 18:24:35,730 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452795875529_0001_00_000001
2016-01-14 18:24:35,730 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:24:35,731 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795875529_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:24:35,731 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:24:35,732 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452795875529_0001_00_000001, launchTime=1452795875731
2016-01-14 18:24:35,733 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452795875529_0001_00_000001
2016-01-14 18:24:35,733 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452795875529_0001_1_00_000000_0] to container: [container_1452795875529_0001_00_000001]
2016-01-14 18:24:35,734 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795875529_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:24:35,734 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452795875529_0001_00_000001 given task: attempt_1452795875529_0001_1_00_000000_0
2016-01-14 18:24:35,734 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452795875529_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452795875529_0001_1_00_000000_0
2016-01-14 18:24:35,734 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452795875529_0001_1_00_000000_0] started. Is using containerId: [container_1452795875529_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:24:35,735 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:24:35 Starting to run new task attempt: attempt_1452795875529_0001_1_00_000000_0
2016-01-14 18:24:35,735 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F9CECEFEBC324BACAA5EE5BEC1F3E267, taskAttemptId=attempt_1452795875529_0001_1_00_000000_0, startTime=1452795875734, containerId=container_1452795875529_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452795875529_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:24:35,736 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452795875529_0001_1_00_000000_0
2016-01-14 18:24:35,736 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:35,736 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:24:35,736 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:24:35,736 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:24:35,736 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:24:35,737 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:24:35,737 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8] pipe/(1/1) ...t/strict-nondeterministic, VertexName: F9CECEFEBC324BACAA5EE5BEC1F3E267, VertexParallelism: 1, TaskAttemptID:attempt_1452795875529_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0396ED98AF7648E0BED86BC530C86FBC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6DED81EEC0E64CDFB46630F8096BAECC, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:24:35,737 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:24:35,737 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795875529_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:24:35,738 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795875529_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:24:35,738 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452795875529_0001_1_00_000000_0
2016-01-14 18:24:35,739 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:24:35,740 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:35,740 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452795875529_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:24:35,740 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=0396ED98AF7648E0BED86BC530C86FBC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:24:35,741 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:35,741 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:24:35,741 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 0396ED98AF7648E0BED86BC530C86FBC
2016-01-14 18:24:35,741 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 0396ED98AF7648E0BED86BC530C86FBC
2016-01-14 18:24:35,743 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6DED81EEC0E64CDFB46630F8096BAECC, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:24:35,743 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:24:35,744 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6DED81EEC0E64CDFB46630F8096BAECC
2016-01-14 18:24:35,744 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:24:35,745 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6DED81EEC0E64CDFB46630F8096BAECC
2016-01-14 18:24:35,745 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:24:35,745 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:24:35,746 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 0396ED98AF7648E0BED86BC530C86FBC
2016-01-14 18:24:35,746 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 0396ED98AF7648E0BED86BC530C86FBC
2016-01-14 18:24:35,752 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F9CECEFEBC324BACAA5EE5BEC1F3E267, ordinal: 0
2016-01-14 18:24:35,752 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F9CECEFEBC324BACAA5EE5BEC1F3E267, mem on start (mb), free: 310, total: 385, max: 672
2016-01-14 18:24:35,752 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:24:35,752 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:24:35,753 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:24:35,754 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:24:35,754 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6DED81EEC0E64CDFB46630F8096BAECC
2016-01-14 18:24:35,754 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:24:35,754 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:24:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:24:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:24:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:24:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:24:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:24:35,756 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 0396ED98AF7648E0BED86BC530C86FBC, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:24:35,756 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6DED81EEC0E64CDFB46630F8096BAECC, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:24:35,756 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:24:35,756 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 0396ED98AF7648E0BED86BC530C86FBC
2016-01-14 18:24:35,756 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:35,756 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 0396ED98AF7648E0BED86BC530C86FBC
2016-01-14 18:24:35,757 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 0396ED98AF7648E0BED86BC530C86FBC being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:24:35,757 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:24:35,757 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:24:35,758 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:24:35,758 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452795875529_0001_1_00_000000_0
2016-01-14 18:24:35,758 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:24:35,759 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@69910ee1
2016-01-14 18:24:35,760 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@69910ee1
2016-01-14 18:24:35,760 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:24:35,760 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:24:35,761 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 18:24:35,762 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"] streamed: true, id: 0396ED98AF7648E0BED86BC530C86FBC
2016-01-14 18:24:35,762 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"], id: 6DED81EEC0E64CDFB46630F8096BAECC
2016-01-14 18:24:35,763 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-01-14 18:24:35,764 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 18:24:35,764 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:24:35,764 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F9CECEFEBC324BACAA5EE5BEC1F3E267, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:24:35,767 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
2016-01-14 18:24:35,772 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
2016-01-14 18:24:35,775 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:24:35,776 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:24:35,777 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452795875529_0001_1_00_000000_0
2016-01-14 18:24:35,777 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452795875529_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:24:35,778 INFO task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452795875529_0001_1_00_000000_0
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
2016-01-14 18:24:35,787 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=135, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6][cascading.flow.SliceCounters Process_Begin_Time=1452795875765, Process_Duration=13, Process_End_Time=1452795875778, Read_Duration=1, Tuples_Read=6, Tuples_Written=6, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=6, Tuples_Written=6]]
2016-01-14 18:24:35,787 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F9CECEFEBC324BACAA5EE5BEC1F3E267, taskAttemptId=attempt_1452795875529_0001_1_00_000000_0, startTime=1452795875734, finishTime=1452795875785, timeTaken=51, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=135, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6, cascading.flow.SliceCounters, Process_Begin_Time=1452795875765, Process_Duration=13, Process_End_Time=1452795875778, Read_Duration=1, Tuples_Read=6, Tuples_Written=6, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=6, Tuples_Written=6
2016-01-14 18:24:35,788 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:24:35,788 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795875529_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 18:24:35,790 INFO impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452795875529_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 18:24:35,790 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F9CECEFEBC324BACAA5EE5BEC1F3E267, mem on close (mb), free: 307, total: 385, max: 672
2016-01-14 18:24:35,790 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=F9CECEFEBC324BACAA5EE5BEC1F3E267, index=0
2016-01-14 18:24:35,790 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:24:35,791 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=F9CECEFEBC324BACAA5EE5BEC1F3E267, sourceVertex=0396ED98AF7648E0BED86BC530C86FBC
2016-01-14 18:24:35,791 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=F9CECEFEBC324BACAA5EE5BEC1F3E267, sourceVertex=6DED81EEC0E64CDFB46630F8096BAECC
2016-01-14 18:24:35,790 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:TASK_FINISHED]: vertexName=F9CECEFEBC324BACAA5EE5BEC1F3E267, taskId=task_1452795875529_0001_1_00_000000, startTime=1452795875734, finishTime=1452795875790, timeTaken=56, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
], counters=Counters: 0
2016-01-14 18:24:35,792 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452795875529_0001_00_000001
2016-01-14 18:24:35,793 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452795875529_0001_00_000001
2016-01-14 18:24:35,793 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452795875529_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 18:24:35,794 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:24:35,797 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] : 1
2016-01-14 18:24:35,798 INFO impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] because task failed: task_1452795875529_0001_1_00_000000
2016-01-14 18:24:35,799 INFO impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] due to trigger: OWN_TASK_FAILURE
2016-01-14 18:24:35,800 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 18:24:35,800 INFO impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,801 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452795875529_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 18:24:35,801 INFO impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=6DED81EEC0E64CDFB46630F8096BAECC, vertexId=vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,801 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452795875529_0001_00_000001 completed but with errors
2016-01-14 18:24:35,806 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:24:35,807 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:VERTEX_FINISHED]: vertexName=F9CECEFEBC324BACAA5EE5BEC1F3E267, vertexId=vertex_1452795875529_0001_1_00, initRequestedTime=1452795875699, initedTime=1452795875717, startRequestedTime=1452795875720, startedTime=1452795875720, finishTime=1452795875806, timeTaken=86, status=FAILED, diagnostics=Task failed, taskId=task_1452795875529_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452795875734, firstTasksToStart=[ task_1452795875529_0001_1_00_000000 ], lastTaskFinishTime=1452795875785, lastTasksToFinish=[ task_1452795875529_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[ ], longestDurationTasks=[ ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 18:24:35,812 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 18:24:35,813 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452795875529_0001_00_000001, stoppedTime=1452795875813, exitStatus=0
2016-01-14 18:24:35,813 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:24:35,813 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795875529_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:24:35,814 INFO node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452795875529_0001_1_00_000000_0 failed: true container: container_1452795875529_0001_00_000001 numFailedTAs: 0
2016-01-14 18:24:35,815 INFO container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452795875529_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 18:24:35,815 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452795875529_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:24:35,816 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 18:24:35,817 INFO impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 18:24:35,817 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452795875529_0001_1
2016-01-14 18:24:35,817 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 6DED81EEC0E64CDFB46630F8096BAECC for vertex: vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267]
2016-01-14 18:24:35,819 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452795875529_0001_1, queueSize=0
2016-01-14 18:24:35,819 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:24:35,819 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452795875529_0001_1][Event:DAG_FINISHED]: dagId=dag_1452795875529_0001_1, startTime=1452795875698, finishTime=1452795875818, timeTaken=120, status=FAILED, diagnostics=Vertex failed, vertexName=F9CECEFEBC324BACAA5EE5BEC1F3E267, vertexId=vertex_1452795875529_0001_1_00, diagnostics=[Task failed, taskId=task_1452795875529_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452795875529_0001_1_00 [F9CECEFEBC324BACAA5EE5BEC1F3E267] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 18:24:35,825 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452795875529_0001_1 finished with state: FAILED
2016-01-14 18:24:35,825 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452795875529_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:24:35,825 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452795875529_0001_00_000001
2016-01-14 18:24:35,826 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452795875529_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 18:24:35 Completed Dag: dag_1452795875529_0001_1
2016-01-14 18:24:35,827 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452795875529_0001_1, dagState=FAILED
2016-01-14 18:24:35,827 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452795875529_0001_1_post
2016-01-14 18:24:35,827 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:24:35,828 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:24:35,831 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452795875529_0001
2016-01-14 18:24:35,835 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:24:35,835 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:24:35,835 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:24:35,835 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:24:35,835 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:24:35,836 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:24:35,836 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:24:35,837 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:24:35,837 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:24:35,837 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:24:35,837 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:24:35,838 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:24:35,838 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:24:35,842 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/364DDA4030FD4681AEA66BEFC684D6C7/CF8B79EE036C4F5EB723A69F46BBE1B8/.tez/application_1452795875529_0001
2016-01-14 18:24:35,842 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopping all jobs
2016-01-14 18:24:35,842 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopping: (1/1) ...t/strict-nondeterministic
2016-01-14 18:24:35,843 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopped all jobs
2016-01-14 18:24:35,844 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.338
2016-01-14 18:24:35,844 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic