2016-01-14 16:01:27,537 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 16:01:27,560 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.scheme.TextDelimitedPlatformTest, with platform: hadoop2-tez
2016-01-14 16:01:27,587 INFO tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-01-14 16:01:27,920 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 16:01:28,247 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 16:01:28,450 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:28,452 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:28,570 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 2C999E6AD284418A84E3E0EFE14396D4
2016-01-14 16:01:28,741 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.069
2016-01-14 16:01:28,752 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.080
2016-01-14 16:01:28,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:28,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:28,754 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:28,899 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-01-14 16:01:28,902 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-01-14 16:01:29,100 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 16:01:29,102 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:29,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:29,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-01-14 16:01:29,104 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 16:01:29,104 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 16:01:29,105 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 16:01:29,106 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...Char/quoted/speccharfalse
2016-01-14 16:01:29,106 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:29,130 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:29,307 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:29,313 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:29,313 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:29,357 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001 doesn't exist and is created
2016-01-14 16:01:29,422 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:29,423 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:29,423 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001
2016-01-14 16:01:29,452 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787289312_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:29,500 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:29,516 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:29,523 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-01-14 16:01:29,523 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-01-14 16:01:29,523 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:29,542 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:29,547 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:29,551 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001/localmode-log-dir
2016-01-14 16:01:29,551 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001/localmode-log-dir/history.txt.appattempt_1452787289312_0001_000000, maxErrors=10
2016-01-14 16:01:29,551 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:29,554 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787289312_0001_000000, appSubmitTime=1452787289438, launchTime=1452787289451
2016-01-14 16:01:29,559 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:29,559 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:29,562 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:29,562 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:29,621 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:35813
2016-01-14 16:01:29,624 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 16:01:29,624 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 16:01:29,624 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:29,664 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:29,724 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 16:01:29,724 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 16:01:29,725 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:29,733 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:29,733 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787289312_0001_000000, startTime=1452787289732
2016-01-14 16:01:29,734 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:29,825 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:29,842 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:29,842 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452787289312_0001, dagName=[1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 16:01:30,055 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 16:01:30,162 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787289312_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001/localmode-log-dir/dag_1452787289312_0001_1.dot
2016-01-14 16:01:30,166 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001/localmode-log-dir/dag_1452787289312_0001_1-tez-dag.pb.txt
2016-01-14 16:01:30,261 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787289312_0001_1
2016-01-14 16:01:30,261 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:30,262 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 16:01:30 Running Dag: dag_1452787289312_0001_1
2016-01-14 16:01:30,298 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:30,298 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787289312_0001_1, submitTime=1452787290055
2016-01-14 16:01:30,331 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C5B1EAB75B2B49B9851C6399884EB336
2016-01-14 16:01:30,333 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:30,337 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:30,337 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787289312_0001_1, initTime=1452787290299
2016-01-14 16:01:30,337 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787289312_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:30,339 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:30,339 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:DAG_STARTED]: dagID=dag_1452787289312_0001_1, startTime=1452787290338
2016-01-14 16:01:30,340 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:30,342 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787289312_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:30,342 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C5B1EAB75B2B49B9851C6399884EB336 : {2F95DBEAC2D5438C941DE29F4FAC5817={InputName=2F95DBEAC2D5438C941DE29F4FAC5817}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:30,342 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 2F95DBEAC2D5438C941DE29F4FAC5817, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:30,343 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,353 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,353 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,356 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]. Starting root input initializers: 1
2016-01-14 16:01:30,357 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452787289312_0001, dagName=[1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 16:01:30,373 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 2F95DBEAC2D5438C941DE29F4FAC5817 on vertex vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,384 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:30,400 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:30,402 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787289312_0001, with dag id: dag_1452787289312_0001_1
2016-01-14 16:01:30,404 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 2F95DBEAC2D5438C941DE29F4FAC5817 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:30,405 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:30,406 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:30,469 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-01-14 16:01:30,471 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 2F95DBEAC2D5438C941DE29F4FAC5817 on vertex vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,472 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:30,472 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {2F95DBEAC2D5438C941DE29F4FAC5817=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:30,488 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] parallelism set to 1
2016-01-14 16:01:30,489 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:30,498 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787289312_0001_1_00, eventCount=1
2016-01-14 16:01:30,500 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,500 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=48A9E83A3C11483A9EEA048208DD7069, vertexId=vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:30,504 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=48A9E83A3C11483A9EEA048208DD7069, vertexId=vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,525 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=48A9E83A3C11483A9EEA048208DD7069, vertexName=C5B1EAB75B2B49B9851C6399884EB336, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:30,534 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=48A9E83A3C11483A9EEA048208DD7069, vertexId=vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,537 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:30,537 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, vertexId=vertex_1452787289312_0001_1_00, initRequestedTime=1452787290342, initedTime=1452787290536, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:30,538 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] with distanceFromRoot: 0
2016-01-14 16:01:30,538 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:30,540 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C5B1EAB75B2B49B9851C6399884EB336
2016-01-14 16:01:30,541 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,542 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:30,542 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787289312_0001_1_00, startRequestedTime=1452787290539, startedTime=1452787290539
2016-01-14 16:01:30,543 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:30,568 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:30,568 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:TASK_STARTED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, taskId=task_1452787289312_0001_1_00_000000, scheduledTime=1452787290567, launchTime=1452787290567
2016-01-14 16:01:30,569 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787289312_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:30,571 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,574 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: C5B1EAB75B2B49B9851C6399884EB336, VertexParallelism: 1, TaskAttemptID:attempt_1452787289312_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2F95DBEAC2D5438C941DE29F4FAC5817, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=48A9E83A3C11483A9EEA048208DD7069, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:30,577 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787289312_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:30,577 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:30,626 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:30,630 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:30,630 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:30,634 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787289312_0001_00_000001
2016-01-14 16:01:30,634 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:30,653 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452787289312_0001_00_000001
2016-01-14 16:01:30,653 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:30,659 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:30,659 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:30,659 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787289312_0001_00_000001, launchTime=1452787290659
2016-01-14 16:01:30,663 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787289312_0001_00_000001
2016-01-14 16:01:30,666 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787289312_0001_1_00_000000_0] to container: [container_1452787289312_0001_00_000001]
2016-01-14 16:01:30,666 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:30,667 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787289312_0001_00_000001 given task: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,668 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787289312_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30 Starting to run new task attempt: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,669 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,670 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:30,670 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787289312_0001_1_00_000000_0] started. Is using containerId: [container_1452787289312_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:30,672 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:30,672 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0, startTime=1452787290668, containerId=container_1452787289312_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787289312_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:30,673 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787289312_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:30,673 INFO counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-01-14 16:01:30,674 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:30,674 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:30,676 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:30,677 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787289312_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:30,678 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:30,701 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:30,701 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: C5B1EAB75B2B49B9851C6399884EB336, VertexParallelism: 1, TaskAttemptID:attempt_1452787289312_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2F95DBEAC2D5438C941DE29F4FAC5817, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=48A9E83A3C11483A9EEA048208DD7069, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:30,704 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:30,708 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,710 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:30,710 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:30,714 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787289312_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:30,717 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=2F95DBEAC2D5438C941DE29F4FAC5817, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:30,719 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:30,719 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=48A9E83A3C11483A9EEA048208DD7069, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:30,720 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:30,721 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:30,721 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,721 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 48A9E83A3C11483A9EEA048208DD7069
2016-01-14 16:01:30,722 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:30,726 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,726 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 48A9E83A3C11483A9EEA048208DD7069
2016-01-14 16:01:30,741 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:30,755 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:30,756 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,756 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,758 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C5B1EAB75B2B49B9851C6399884EB336, ordinal: 0
2016-01-14 16:01:30,759 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C5B1EAB75B2B49B9851C6399884EB336, mem on start (mb), free: 162, total: 281, max: 672
2016-01-14 16:01:30,759 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:30,759 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:30,760 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:30,767 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:30,767 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 48A9E83A3C11483A9EEA048208DD7069
2016-01-14 16:01:30,768 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:30,769 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:30,777 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:30,778 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:30,778 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:30,779 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:30,779 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:30,780 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:30,780 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 2F95DBEAC2D5438C941DE29F4FAC5817, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:30,780 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 48A9E83A3C11483A9EEA048208DD7069, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:30,781 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:30,783 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 2F95DBEAC2D5438C941DE29F4FAC5817 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:30,783 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,783 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:30,783 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,784 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:30,785 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:30,785 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:30,786 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,788 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:30,796 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1951d32e
2016-01-14 16:01:30,810 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1951d32e
2016-01-14 16:01:30,810 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:30,811 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:30,828 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:30,831 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,832 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"], id: 48A9E83A3C11483A9EEA048208DD7069
2016-01-14 16:01:30,832 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-01-14 16:01:30,836 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:30,836 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:30,839 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C5B1EAB75B2B49B9851C6399884EB336, all 1 inputs ready in: 00:00:00.002
2016-01-14 16:01:30,854 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:30,854 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:30,855 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,856 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787289312_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:30,857 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,858 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C5B1EAB75B2B49B9851C6399884EB336, mem on close (mb), free: 155, total: 281, max: 672
2016-01-14 16:01:30 Completed running task attempt: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,864 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:30,868 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787290839, Process_Duration=18, Process_End_Time=1452787290857, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 16:01:30,869 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:30,870 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 16:01:30,870 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:30,904 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787289312_0001_00_000001
2016-01-14 16:01:30,905 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0, startTime=1452787290668, finishTime=1452787290865, timeTaken=197, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787290839, Process_Duration=18, Process_End_Time=1452787290857, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:30,910 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787289312_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:30,910 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:30,912 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,916 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:30,920 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:TASK_FINISHED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, taskId=task_1452787289312_0001_1_00_000000, startTime=1452787290668, finishTime=1452787290913, timeTaken=245, status=SUCCEEDED, successfulAttemptID=attempt_1452787289312_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787290839, Process_Duration=18, Process_End_Time=1452787290857, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:30,923 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787289312_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:30,927 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:30,928 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] : 1
2016-01-14 16:01:30,929 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,938 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:30,941 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:VERTEX_FINISHED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, vertexId=vertex_1452787289312_0001_1_00, initRequestedTime=1452787290342, initedTime=1452787290536, startRequestedTime=1452787290539, startedTime=1452787290539, finishTime=1452787290930, timeTaken=391, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787290839, Process_Duration=18, Process_End_Time=1452787290857, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452787290668, firstTasksToStart=[ task_1452787289312_0001_1_00_000000 ], lastTaskFinishTime=1452787290865, lastTasksToFinish=[ task_1452787289312_0001_1_00_000000 ], minTaskDuration=197, maxTaskDuration=197, avgTaskDuration=197.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787289312_0001_1_00_000000 ], longestDurationTasks=[ task_1452787289312_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:30,942 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:30,943 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787289312_0001_00_000001, stoppedTime=1452787290943, exitStatus=0
2016-01-14 16:01:30,943 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:30,944 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:30,944 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:30,947 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787289312_0001_1
2016-01-14 16:01:30,948 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787289312_0001_1
2016-01-14 16:01:30,948 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 48A9E83A3C11483A9EEA048208DD7069 for vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,967 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787289312_0001_1, queueSize=0
2016-01-14 16:01:30,968 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:30,969 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787289312_0001_1, startTime=1452787290338, finishTime=1452787290962, timeTaken=624, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787290839, Process_Duration=18, Process_End_Time=1452787290857, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:30,971 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787289312_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:30,971 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787289312_0001_00_000001: 62 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:30,971 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787289312_0001_00_000001, Exiting
2016-01-14 16:01:30,973 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787289312_0001_00_000001
2016-01-14 16:01:30,973 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787289312_0001_00_000001
2016-01-14 16:01:30,973 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787289312_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:30,973 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787289312_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:30,977 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787289312_0001_00_000001
2016-01-14 16:01:30 Completed Dag: dag_1452787289312_0001_1
2016-01-14 16:01:30,976 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787289312_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:30,978 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787289312_0001_00_000001 completed successfully
2016-01-14 16:01:30,978 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787289312_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:30,979 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787289312_0001_1_post
2016-01-14 16:01:30,980 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:30,980 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:30,981 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:01:30,981 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:01:30,989 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452787289312_0001
2016-01-14 16:01:30,993 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:30,993 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:30,993 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:30,993 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:30,994 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:30,995 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:30,997 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:30,997 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:30,998 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:30,998 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:30,998 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:30,999 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:30,999 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:31,004 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001
2016-01-14 16:01:31,005 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:01.902
2016-01-14 16:01:31,172 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-01-14 16:01:31,215 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:31,216 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:31,277 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 16:01:31,293 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.039
2016-01-14 16:01:31,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:31,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:31,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:31,315 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 16:01:31,316 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-01-14 16:01:31,341 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:31,341 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:31,342 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-01-14 16:01:31,343 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 16:01:31,343 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 16:01:31,343 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 16:01:31,343 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...xtAll/quoted/normchartrue
2016-01-14 16:01:31,344 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:31,360 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:31,366 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:31,366 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:31,366 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:31,377 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001 doesn't exist and is created
2016-01-14 16:01:31,402 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:31,403 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:31,404 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001
2016-01-14 16:01:31,409 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787291366_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:31,424 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:31,425 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:31,428 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:31,428 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:31,428 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001/localmode-log-dir
2016-01-14 16:01:31,429 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001/localmode-log-dir/history.txt.appattempt_1452787291366_0001_000000, maxErrors=10
2016-01-14 16:01:31,429 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:31,429 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787291366_0001_000000, appSubmitTime=1452787291408, launchTime=1452787291408
2016-01-14 16:01:31,435 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:31,438 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:31,440 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:31,440 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:31,443 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:37524
2016-01-14 16:01:31,445 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:31,447 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:31,447 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787291366_0001_000000, startTime=1452787291447
2016-01-14 16:01:31,447 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:31,504 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:31,504 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:31,504 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452787291366_0001, dagName=[6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 16:01:31,538 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 16:01:31,542 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787291366_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001/localmode-log-dir/dag_1452787291366_0001_1.dot
2016-01-14 16:01:31,543 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001/localmode-log-dir/dag_1452787291366_0001_1-tez-dag.pb.txt
2016-01-14 16:01:31,568 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787291366_0001_1
2016-01-14 16:01:31,568 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:31,568 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 16:01:31 Running Dag: dag_1452787291366_0001_1
2016-01-14 16:01:31,588 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:31,589 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787291366_0001_1, submitTime=1452787291539
2016-01-14 16:01:31,590 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex FBCA3F00C9B84AFF90E6F6DA50110E58
2016-01-14 16:01:31,590 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:31,591 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:31,591 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787291366_0001_1, initTime=1452787291589
2016-01-14 16:01:31,592 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787291366_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:31,593 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:DAG_STARTED]: dagID=dag_1452787291366_0001_1, startTime=1452787291592
2016-01-14 16:01:31,593 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:31,593 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:31,593 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787291366_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:31,593 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452787291366_0001, dagName=[6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 16:01:31,593 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: FBCA3F00C9B84AFF90E6F6DA50110E58 : {68E1CBBC43FE46CEB7BFF1767DEDD67D={InputName=68E1CBBC43FE46CEB7BFF1767DEDD67D}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:31,594 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 68E1CBBC43FE46CEB7BFF1767DEDD67D, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:31,594 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,594 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,594 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,595 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]. Starting root input initializers: 1
2016-01-14 16:01:31,597 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:31,598 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 68E1CBBC43FE46CEB7BFF1767DEDD67D on vertex vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,603 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:31,604 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 68E1CBBC43FE46CEB7BFF1767DEDD67D asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:31,605 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:31,606 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:31,609 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 16:01:31,610 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 68E1CBBC43FE46CEB7BFF1767DEDD67D on vertex vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,610 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:31,610 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {68E1CBBC43FE46CEB7BFF1767DEDD67D=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:31,612 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] parallelism set to 1
2016-01-14 16:01:31,612 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:31,612 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787291366_0001_1_00, eventCount=1
2016-01-14 16:01:31,613 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,613 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6D26A1497A434785B91A8FE2645CD1CE, vertexId=vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:31,613 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6D26A1497A434785B91A8FE2645CD1CE, vertexId=vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,622 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6D26A1497A434785B91A8FE2645CD1CE, vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:31,622 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6D26A1497A434785B91A8FE2645CD1CE, vertexId=vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,622 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787291366_0001, with dag id: dag_1452787291366_0001_1
2016-01-14 16:01:31,630 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:31,630 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, vertexId=vertex_1452787291366_0001_1_00, initRequestedTime=1452787291593, initedTime=1452787291629, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:31,630 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] with distanceFromRoot: 0
2016-01-14 16:01:31,630 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:31,632 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in FBCA3F00C9B84AFF90E6F6DA50110E58
2016-01-14 16:01:31,634 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,634 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:31,634 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787291366_0001_1_00, startRequestedTime=1452787291632, startedTime=1452787291632
2016-01-14 16:01:31,635 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:31,636 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:31,636 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:TASK_STARTED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, taskId=task_1452787291366_0001_1_00_000000, scheduledTime=1452787291636, launchTime=1452787291636
2016-01-14 16:01:31,636 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787291366_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:31,637 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,637 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: FBCA3F00C9B84AFF90E6F6DA50110E58, VertexParallelism: 1, TaskAttemptID:attempt_1452787291366_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=68E1CBBC43FE46CEB7BFF1767DEDD67D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6D26A1497A434785B91A8FE2645CD1CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:31,638 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787291366_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:31,638 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:31,639 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:31,641 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:31,641 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:31,642 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787291366_0001_00_000001
2016-01-14 16:01:31,643 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:31,648 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452787291366_0001_00_000001
2016-01-14 16:01:31,648 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:31,650 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:31,650 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:31,651 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787291366_0001_00_000001, launchTime=1452787291650
2016-01-14 16:01:31,651 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787291366_0001_00_000001
2016-01-14 16:01:31,652 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787291366_0001_1_00_000000_0] to container: [container_1452787291366_0001_00_000001]
2016-01-14 16:01:31,653 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:31,653 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787291366_0001_00_000001 given task: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,654 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787291366_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,654 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787291366_0001_1_00_000000_0] started. Is using containerId: [container_1452787291366_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:31 Starting to run new task attempt: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,655 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0, startTime=1452787291654, containerId=container_1452787291366_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787291366_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:31,656 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:31,656 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,657 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:31,656 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787291366_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:31,658 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:31,658 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787291366_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:31,659 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:31,659 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:31,660 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:31,660 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:31,661 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: FBCA3F00C9B84AFF90E6F6DA50110E58, VertexParallelism: 1, TaskAttemptID:attempt_1452787291366_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=68E1CBBC43FE46CEB7BFF1767DEDD67D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6D26A1497A434785B91A8FE2645CD1CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:31,661 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:31,663 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,666 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:31,667 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:31,668 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787291366_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:31,669 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=68E1CBBC43FE46CEB7BFF1767DEDD67D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:31,670 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:31,670 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,671 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,672 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:31,677 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:31,678 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,678 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,679 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:31,682 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6D26A1497A434785B91A8FE2645CD1CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:31,685 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:31,686 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6D26A1497A434785B91A8FE2645CD1CE
2016-01-14 16:01:31,686 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:31,687 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6D26A1497A434785B91A8FE2645CD1CE
2016-01-14 16:01:31,694 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FBCA3F00C9B84AFF90E6F6DA50110E58, ordinal: 0
2016-01-14 16:01:31,694 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FBCA3F00C9B84AFF90E6F6DA50110E58, mem on start (mb), free: 170, total: 281, max: 672
2016-01-14 16:01:31,695 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:31,695 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:31,695 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:31,701 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:31,701 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6D26A1497A434785B91A8FE2645CD1CE
2016-01-14 16:01:31,702 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:31,702 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:31,702 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:31,703 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:31,703 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:31,703 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:31,703 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:31,704 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:31,704 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 68E1CBBC43FE46CEB7BFF1767DEDD67D, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:31,704 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6D26A1497A434785B91A8FE2645CD1CE, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:31,704 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:31,704 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 68E1CBBC43FE46CEB7BFF1767DEDD67D being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:31,704 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,704 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:31,705 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,704 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:31,707 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:31,707 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:31,708 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,708 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:31,714 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2a19e907
2016-01-14 16:01:31,718 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2a19e907
2016-01-14 16:01:31,718 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:31,719 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:31,720 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:31,720 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,721 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"], id: 6D26A1497A434785B91A8FE2645CD1CE
2016-01-14 16:01:31,721 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-01-14 16:01:31,722 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:31,723 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:31,723 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FBCA3F00C9B84AFF90E6F6DA50110E58, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:31,727 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:31,728 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:31,728 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,729 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787291366_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:31,730 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,730 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FBCA3F00C9B84AFF90E6F6DA50110E58, mem on close (mb), free: 167, total: 281, max: 672
2016-01-14 16:01:31 Completed running task attempt: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,731 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:31,732 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:31,734 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787291723, Process_Duration=7, Process_End_Time=1452787291730, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 16:01:31,734 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0, startTime=1452787291654, finishTime=1452787291732, timeTaken=78, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787291723, Process_Duration=7, Process_End_Time=1452787291730, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:31,734 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787291366_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:31,735 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:31,735 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,737 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 16:01:31,737 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:31,738 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787291366_0001_00_000001
2016-01-14 16:01:31,738 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:TASK_FINISHED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, taskId=task_1452787291366_0001_1_00_000000, startTime=1452787291654, finishTime=1452787291737, timeTaken=83, status=SUCCEEDED, successfulAttemptID=attempt_1452787291366_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787291723, Process_Duration=7, Process_End_Time=1452787291730, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:31,739 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787291366_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:31,739 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:31,740 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] : 1
2016-01-14 16:01:31,740 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,743 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:31,746 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:VERTEX_FINISHED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, vertexId=vertex_1452787291366_0001_1_00, initRequestedTime=1452787291593, initedTime=1452787291629, startRequestedTime=1452787291632, startedTime=1452787291632, finishTime=1452787291741, timeTaken=109, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787291723, Process_Duration=7, Process_End_Time=1452787291730, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452787291654, firstTasksToStart=[ task_1452787291366_0001_1_00_000000 ], lastTaskFinishTime=1452787291732, lastTasksToFinish=[ task_1452787291366_0001_1_00_000000 ], minTaskDuration=78, maxTaskDuration=78, avgTaskDuration=78.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787291366_0001_1_00_000000 ], longestDurationTasks=[ task_1452787291366_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:31,746 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:31,746 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:31,747 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:31,747 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787291366_0001_00_000001, stoppedTime=1452787291747, exitStatus=0
2016-01-14 16:01:31,748 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:31,748 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:31,748 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787291366_0001_1
2016-01-14 16:01:31,749 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787291366_0001_1
2016-01-14 16:01:31,749 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 6D26A1497A434785B91A8FE2645CD1CE for vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,751 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787291366_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:31,751 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787291366_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:31,751 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787291366_0001_00_000001, Exiting
2016-01-14 16:01:31,752 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787291366_0001_00_000001
2016-01-14 16:01:31,752 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787291366_0001_00_000001
2016-01-14 16:01:31,754 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787291366_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:31,754 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787291366_0001_00_000001 completed successfully
2016-01-14 16:01:31,762 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787291366_0001_1, queueSize=0
2016-01-14 16:01:31,762 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:31,764 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787291366_0001_1, startTime=1452787291592, finishTime=1452787291761, timeTaken=169, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787291723, Process_Duration=7, Process_End_Time=1452787291730, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:31,765 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787291366_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:31,765 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787291366_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:31,765 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787291366_0001_00_000001
2016-01-14 16:01:31,765 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:31 Completed Dag: dag_1452787291366_0001_1
2016-01-14 16:01:31,767 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787291366_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:31,767 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787291366_0001_1_post
2016-01-14 16:01:31,767 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:31,767 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:31,773 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452787291366_0001
2016-01-14 16:01:31,776 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:31,776 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:31,776 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:31,776 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:31,776 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:31,778 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:31,778 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:31,779 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:31,779 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:31,779 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:31,780 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:31,780 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:31,780 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:31,786 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001
2016-01-14 16:01:31,788 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.446
2016-01-14 16:01:31,960 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-01-14 16:01:32,002 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:32,002 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:32,054 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:01:32,063 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 16:01:32,065 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:32,065 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:32,066 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:32,084 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-01-14 16:01:32,085 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-01-14 16:01:32,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:32,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:32,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-01-14 16:01:32,108 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 16:01:32,108 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 16:01:32,108 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 16:01:32,109 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...arAll/quoted/specchartrue
2016-01-14 16:01:32,109 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:32,126 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:32,131 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:32,131 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:32,131 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:32,142 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001 doesn't exist and is created
2016-01-14 16:01:32,165 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:32,165 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:32,166 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001
2016-01-14 16:01:32,171 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787292131_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:32,184 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:32,185 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:32,187 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:32,187 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:32,188 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001/localmode-log-dir
2016-01-14 16:01:32,188 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001/localmode-log-dir/history.txt.appattempt_1452787292131_0001_000000, maxErrors=10
2016-01-14 16:01:32,188 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:32,189 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787292131_0001_000000, appSubmitTime=1452787292170, launchTime=1452787292171
2016-01-14 16:01:32,196 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:32,198 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:32,199 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:32,199 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:32,201 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:53154
2016-01-14 16:01:32,203 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:32,205 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787292131_0001_000000, startTime=1452787292205
2016-01-14 16:01:32,205 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:32,205 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:32,265 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:32,266 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:32,266 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452787292131_0001, dagName=[A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 16:01:32,289 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 16:01:32,291 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787292131_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001/localmode-log-dir/dag_1452787292131_0001_1.dot
2016-01-14 16:01:32,293 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001/localmode-log-dir/dag_1452787292131_0001_1-tez-dag.pb.txt
2016-01-14 16:01:32,320 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787292131_0001_1
2016-01-14 16:01:32,320 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:32,320 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 16:01:32 Running Dag: dag_1452787292131_0001_1
2016-01-14 16:01:32,337 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787292131_0001_1, submitTime=1452787292289
2016-01-14 16:01:32,337 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:32,337 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D6599856A25E47B3833A456F4F84815F
2016-01-14 16:01:32,338 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:32,339 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:32,340 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787292131_0001_1, initTime=1452787292337
2016-01-14 16:01:32,340 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292131_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:32,342 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:32,342 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:DAG_STARTED]: dagID=dag_1452787292131_0001_1, startTime=1452787292342
2016-01-14 16:01:32,342 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:32,343 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292131_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:32,343 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D6599856A25E47B3833A456F4F84815F : {31EA6CF621A74D36AA699A75527BFF32={InputName=31EA6CF621A74D36AA699A75527BFF32}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:32,343 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 31EA6CF621A74D36AA699A75527BFF32, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:32,343 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,343 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,343 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452787292131_0001, dagName=[A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 16:01:32,343 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,344 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]. Starting root input initializers: 1
2016-01-14 16:01:32,346 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:32,347 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 31EA6CF621A74D36AA699A75527BFF32 on vertex vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,349 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:32,350 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 31EA6CF621A74D36AA699A75527BFF32 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:32,351 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:32,351 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:32,354 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-01-14 16:01:32,355 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 31EA6CF621A74D36AA699A75527BFF32 on vertex vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,356 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:32,356 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {31EA6CF621A74D36AA699A75527BFF32=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:32,356 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] parallelism set to 1
2016-01-14 16:01:32,356 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:32,357 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787292131_0001_1_00, eventCount=1
2016-01-14 16:01:32,357 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,358 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=302AE30733E54586A626BF484019B9D0, vertexId=vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:32,358 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=302AE30733E54586A626BF484019B9D0, vertexId=vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,360 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=302AE30733E54586A626BF484019B9D0, vertexName=D6599856A25E47B3833A456F4F84815F, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:32,361 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=302AE30733E54586A626BF484019B9D0, vertexId=vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,363 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:32,363 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D6599856A25E47B3833A456F4F84815F, vertexId=vertex_1452787292131_0001_1_00, initRequestedTime=1452787292343, initedTime=1452787292363, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:32,364 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] with distanceFromRoot: 0
2016-01-14 16:01:32,364 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:32,364 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D6599856A25E47B3833A456F4F84815F
2016-01-14 16:01:32,365 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,365 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:32,365 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787292131_0001_1_00, startRequestedTime=1452787292364, startedTime=1452787292364
2016-01-14 16:01:32,366 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:32,367 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:32,367 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:TASK_STARTED]: vertexName=D6599856A25E47B3833A456F4F84815F, taskId=task_1452787292131_0001_1_00_000000, scheduledTime=1452787292366, launchTime=1452787292366
2016-01-14 16:01:32,367 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292131_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:32,368 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,368 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: D6599856A25E47B3833A456F4F84815F, VertexParallelism: 1, TaskAttemptID:attempt_1452787292131_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=31EA6CF621A74D36AA699A75527BFF32, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=302AE30733E54586A626BF484019B9D0, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:32,369 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292131_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:32,369 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:32,370 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:32,371 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:32,371 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:32,373 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787292131_0001_00_000001
2016-01-14 16:01:32,373 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:32,375 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452787292131_0001_00_000001
2016-01-14 16:01:32,376 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:32,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787292131_0001, with dag id: dag_1452787292131_0001_1
2016-01-14 16:01:32,377 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:32,378 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:32,379 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787292131_0001_00_000001, launchTime=1452787292378
2016-01-14 16:01:32,380 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787292131_0001_00_000001
2016-01-14 16:01:32,381 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787292131_0001_1_00_000000_0] to container: [container_1452787292131_0001_00_000001]
2016-01-14 16:01:32,381 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:32,384 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787292131_0001_1_00_000000_0] started. Is using containerId: [container_1452787292131_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:32,384 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:32,384 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D6599856A25E47B3833A456F4F84815F, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0, startTime=1452787292383, containerId=container_1452787292131_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787292131_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:32,384 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292131_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:32,385 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292131_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:32,386 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787292131_0001_00_000001 given task: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,386 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787292131_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32 Starting to run new task attempt: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,387 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,387 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:32,387 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:32,387 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:32,387 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:32,387 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:32,387 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:32,387 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: D6599856A25E47B3833A456F4F84815F, VertexParallelism: 1, TaskAttemptID:attempt_1452787292131_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=31EA6CF621A74D36AA699A75527BFF32, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=302AE30733E54586A626BF484019B9D0, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:32,388 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:32,389 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,389 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787292131_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:32,390 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:32,390 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:32,391 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=31EA6CF621A74D36AA699A75527BFF32, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:32,391 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=302AE30733E54586A626BF484019B9D0, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:32,391 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:32,392 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:32,393 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,393 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,394 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:32,395 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 302AE30733E54586A626BF484019B9D0
2016-01-14 16:01:32,395 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:32,395 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:32,396 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 302AE30733E54586A626BF484019B9D0
2016-01-14 16:01:32,403 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:32,403 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,406 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,421 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D6599856A25E47B3833A456F4F84815F, ordinal: 0
2016-01-14 16:01:32,421 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D6599856A25E47B3833A456F4F84815F, mem on start (mb), free: 307, total: 397, max: 672
2016-01-14 16:01:32,421 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:32,422 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:32,422 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:32,427 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:32,427 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 302AE30733E54586A626BF484019B9D0
2016-01-14 16:01:32,427 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:32,427 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:32,428 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:32,428 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:32,428 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:32,428 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:32,428 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:32,428 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:32,429 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 31EA6CF621A74D36AA699A75527BFF32, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:32,429 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 302AE30733E54586A626BF484019B9D0, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:32,429 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:32,429 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 31EA6CF621A74D36AA699A75527BFF32 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:32,429 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,429 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:32,429 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,429 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:32,433 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:32,433 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:32,434 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,437 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:32,437 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:32,438 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,438 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"], id: 302AE30733E54586A626BF484019B9D0
2016-01-14 16:01:32,439 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-01-14 16:01:32,439 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5e460b57
2016-01-14 16:01:32,439 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:32,440 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:32,442 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5e460b57
2016-01-14 16:01:32,442 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:32,443 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:32,443 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D6599856A25E47B3833A456F4F84815F, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:32,447 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:32,447 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:32,448 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,448 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787292131_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:32,450 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,450 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D6599856A25E47B3833A456F4F84815F, mem on close (mb), free: 306, total: 397, max: 672
2016-01-14 16:01:32 Completed running task attempt: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,456 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:32,457 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:32,459 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D6599856A25E47B3833A456F4F84815F, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0, startTime=1452787292383, finishTime=1452787292457, timeTaken=74, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787292443, Process_Duration=7, Process_End_Time=1452787292450, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:32,459 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292131_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:32,459 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,460 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:32,460 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:TASK_FINISHED]: vertexName=D6599856A25E47B3833A456F4F84815F, taskId=task_1452787292131_0001_1_00_000000, startTime=1452787292383, finishTime=1452787292459, timeTaken=76, status=SUCCEEDED, successfulAttemptID=attempt_1452787292131_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787292443, Process_Duration=7, Process_End_Time=1452787292450, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:32,460 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:32,460 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292131_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:32,463 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] : 1
2016-01-14 16:01:32,463 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,463 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787292443, Process_Duration=7, Process_End_Time=1452787292450, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 16:01:32,464 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 16:01:32,464 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:32,464 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787292131_0001_00_000001
2016-01-14 16:01:32,465 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:32,467 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:VERTEX_FINISHED]: vertexName=D6599856A25E47B3833A456F4F84815F, vertexId=vertex_1452787292131_0001_1_00, initRequestedTime=1452787292343, initedTime=1452787292363, startRequestedTime=1452787292364, startedTime=1452787292364, finishTime=1452787292463, timeTaken=99, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787292443, Process_Duration=7, Process_End_Time=1452787292450, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452787292383, firstTasksToStart=[ task_1452787292131_0001_1_00_000000 ], lastTaskFinishTime=1452787292457, lastTasksToFinish=[ task_1452787292131_0001_1_00_000000 ], minTaskDuration=74, maxTaskDuration=74, avgTaskDuration=74.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787292131_0001_1_00_000000 ], longestDurationTasks=[ task_1452787292131_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:32,467 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:32,467 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:32,467 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787292131_0001_00_000001, stoppedTime=1452787292467, exitStatus=0
2016-01-14 16:01:32,467 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:32,468 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:32,469 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:32,469 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787292131_0001_1
2016-01-14 16:01:32,469 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787292131_0001_1
2016-01-14 16:01:32,469 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 302AE30733E54586A626BF484019B9D0 for vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,475 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787292131_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:32,475 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787292131_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:32,476 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787292131_0001_00_000001, Exiting
2016-01-14 16:01:32,476 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787292131_0001_00_000001
2016-01-14 16:01:32,476 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787292131_0001_00_000001
2016-01-14 16:01:32,479 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787292131_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:32,480 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787292131_0001_00_000001 completed successfully
2016-01-14 16:01:32,483 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787292131_0001_1, queueSize=0
2016-01-14 16:01:32,483 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:32,483 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787292131_0001_1, startTime=1452787292342, finishTime=1452787292482, timeTaken=140, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787292443, Process_Duration=7, Process_End_Time=1452787292450, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:32,484 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787292131_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:32,485 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292131_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:32,485 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:32 Completed Dag: dag_1452787292131_0001_1
2016-01-14 16:01:32,485 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787292131_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:32,485 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787292131_0001_1_post
2016-01-14 16:01:32,486 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:32,486 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:32,486 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787292131_0001_00_000001
2016-01-14 16:01:32,493 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452787292131_0001
2016-01-14 16:01:32,497 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:32,497 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:32,497 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:32,498 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:32,498 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:32,499 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:32,499 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:32,500 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:32,500 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:32,500 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:32,501 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:32,502 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:32,502 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:32,509 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001
2016-01-14 16:01:32,510 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.402
2016-01-14 16:01:32,632 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-01-14 16:01:32,662 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:32,662 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:32,710 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:01:32,725 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-14 16:01:32,726 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:32,727 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:32,727 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:32,747 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 16:01:32,748 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-01-14 16:01:32,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:32,770 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:32,770 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-01-14 16:01:32,771 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 16:01:32,771 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 16:01:32,772 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 16:01:32,773 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...m/testHeaderAll/headerall
2016-01-14 16:01:32,774 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:32,796 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:32,801 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:32,802 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:32,802 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:32,812 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001 doesn't exist and is created
2016-01-14 16:01:32,830 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:32,830 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:32,831 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001
2016-01-14 16:01:32,836 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787292802_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:32,854 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:32,855 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:32,857 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:32,857 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:32,858 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001/localmode-log-dir
2016-01-14 16:01:32,858 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001/localmode-log-dir/history.txt.appattempt_1452787292802_0001_000000, maxErrors=10
2016-01-14 16:01:32,859 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:32,859 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787292802_0001_000000, appSubmitTime=1452787292836, launchTime=1452787292836
2016-01-14 16:01:32,864 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:32,868 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:32,869 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:60799
2016-01-14 16:01:32,873 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:32,874 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:32,876 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:32,879 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787292802_0001_000000, startTime=1452787292878
2016-01-14 16:01:32,879 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:32,879 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:32,930 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:32,931 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:32,931 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452787292802_0001, dagName=[E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 16:01:32,956 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 16:01:32,958 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787292802_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001/localmode-log-dir/dag_1452787292802_0001_1.dot
2016-01-14 16:01:32,959 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001/localmode-log-dir/dag_1452787292802_0001_1-tez-dag.pb.txt
2016-01-14 16:01:32,993 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787292802_0001_1
2016-01-14 16:01:32,994 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:32,994 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 16:01:32 Running Dag: dag_1452787292802_0001_1
2016-01-14 16:01:33,008 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:33,009 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787292802_0001_1, submitTime=1452787292956
2016-01-14 16:01:33,010 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D56F16D814E845199B025ECA40D85788
2016-01-14 16:01:33,010 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:33,010 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:33,012 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787292802_0001_1, initTime=1452787293009
2016-01-14 16:01:33,012 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292802_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:33,012 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:DAG_STARTED]: dagID=dag_1452787292802_0001_1, startTime=1452787293012
2016-01-14 16:01:33,013 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:33,013 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292802_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:33,013 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D56F16D814E845199B025ECA40D85788 : {763F0C685A6046DE8C3D32DD68870F6C={InputName=763F0C685A6046DE8C3D32DD68870F6C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:33,013 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 763F0C685A6046DE8C3D32DD68870F6C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:33,013 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:33,013 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,014 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,014 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,014 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]. Starting root input initializers: 1
2016-01-14 16:01:33,014 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:33,014 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452787292802_0001, dagName=[E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 16:01:33,015 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 763F0C685A6046DE8C3D32DD68870F6C on vertex vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,017 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:33,017 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 763F0C685A6046DE8C3D32DD68870F6C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:33,018 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:33,018 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:33,021 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 16:01:33,021 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 763F0C685A6046DE8C3D32DD68870F6C on vertex vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,022 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:33,022 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {763F0C685A6046DE8C3D32DD68870F6C=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:33,022 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] parallelism set to 1
2016-01-14 16:01:33,022 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:33,022 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787292802_0001_1_00, eventCount=1
2016-01-14 16:01:33,023 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,023 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=451AA0DFCD704EC680DFFE60AC1DC83F, vertexId=vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:33,024 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=451AA0DFCD704EC680DFFE60AC1DC83F, vertexId=vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,026 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=451AA0DFCD704EC680DFFE60AC1DC83F, vertexName=D56F16D814E845199B025ECA40D85788, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:33,026 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=451AA0DFCD704EC680DFFE60AC1DC83F, vertexId=vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,028 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:33,028 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D56F16D814E845199B025ECA40D85788, vertexId=vertex_1452787292802_0001_1_00, initRequestedTime=1452787293013, initedTime=1452787293027, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:33,028 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] with distanceFromRoot: 0
2016-01-14 16:01:33,028 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:33,028 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D56F16D814E845199B025ECA40D85788
2016-01-14 16:01:33,028 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,029 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:33,029 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787292802_0001_1_00, startRequestedTime=1452787293028, startedTime=1452787293028
2016-01-14 16:01:33,029 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:33,029 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:33,029 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:TASK_STARTED]: vertexName=D56F16D814E845199B025ECA40D85788, taskId=task_1452787292802_0001_1_00_000000, scheduledTime=1452787293029, launchTime=1452787293029
2016-01-14 16:01:33,030 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292802_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:33,030 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,030 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: D56F16D814E845199B025ECA40D85788, VertexParallelism: 1, TaskAttemptID:attempt_1452787292802_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=763F0C685A6046DE8C3D32DD68870F6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=451AA0DFCD704EC680DFFE60AC1DC83F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:33,030 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292802_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:33,031 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:33,032 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:33,032 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:33,032 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:33,033 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787292802_0001_00_000001
2016-01-14 16:01:33,033 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:33,036 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452787292802_0001_00_000001
2016-01-14 16:01:33,036 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:33,039 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:33,039 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:33,039 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787292802_0001_00_000001, launchTime=1452787293038
2016-01-14 16:01:33,041 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787292802_0001_00_000001
2016-01-14 16:01:33,042 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787292802_0001_1_00_000000_0] to container: [container_1452787292802_0001_00_000001]
2016-01-14 16:01:33,042 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:33,043 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787292802_0001_1_00_000000_0] started. Is using containerId: [container_1452787292802_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:33,043 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D56F16D814E845199B025ECA40D85788, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0, startTime=1452787293043, containerId=container_1452787292802_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787292802_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:33,044 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292802_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:33,044 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:33,044 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292802_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:33,044 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787292802_0001_00_000001 given task: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,044 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787292802_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33 Starting to run new task attempt: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,045 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,045 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,046 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:33,046 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:33,046 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:33,046 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:33,047 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:33,047 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: D56F16D814E845199B025ECA40D85788, VertexParallelism: 1, TaskAttemptID:attempt_1452787292802_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=763F0C685A6046DE8C3D32DD68870F6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=451AA0DFCD704EC680DFFE60AC1DC83F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:33,048 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:33,048 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,050 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:33,051 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,052 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787292802_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:33,053 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=763F0C685A6046DE8C3D32DD68870F6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:33,053 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,053 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=451AA0DFCD704EC680DFFE60AC1DC83F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:33,054 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:33,054 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 451AA0DFCD704EC680DFFE60AC1DC83F
2016-01-14 16:01:33,055 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:33,055 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 451AA0DFCD704EC680DFFE60AC1DC83F
2016-01-14 16:01:33,057 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:33,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787292802_0001, with dag id: dag_1452787292802_0001_1
2016-01-14 16:01:33,062 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:33,062 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,063 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,073 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:33,075 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,075 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,080 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D56F16D814E845199B025ECA40D85788, ordinal: 0
2016-01-14 16:01:33,080 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D56F16D814E845199B025ECA40D85788, mem on start (mb), free: 218, total: 397, max: 672
2016-01-14 16:01:33,080 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,080 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:33,080 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:33,082 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:33,082 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 451AA0DFCD704EC680DFFE60AC1DC83F
2016-01-14 16:01:33,082 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:33,082 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:33,082 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:33,082 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:33,082 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:33,083 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:33,083 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:33,083 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:33,083 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 451AA0DFCD704EC680DFFE60AC1DC83F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:33,083 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 763F0C685A6046DE8C3D32DD68870F6C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:33,083 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:33,083 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 763F0C685A6046DE8C3D32DD68870F6C being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:33,084 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,084 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:33,084 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,084 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:33,084 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:33,084 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:33,085 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,087 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:33,087 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@52009a96
2016-01-14 16:01:33,089 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@52009a96
2016-01-14 16:01:33,089 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:33,089 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:33,091 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:33,092 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,092 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"], id: 451AA0DFCD704EC680DFFE60AC1DC83F
2016-01-14 16:01:33,092 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-01-14 16:01:33,093 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:33,093 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:33,093 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D56F16D814E845199B025ECA40D85788, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:33,097 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:33,097 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:33,098 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,098 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787292802_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:33,099 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,099 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D56F16D814E845199B025ECA40D85788, mem on close (mb), free: 216, total: 397, max: 672
2016-01-14 16:01:33 Completed running task attempt: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,100 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:33,101 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787293093, Process_Duration=6, Process_End_Time=1452787293099, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-01-14 16:01:33,101 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 16:01:33,101 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,101 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:33,103 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D56F16D814E845199B025ECA40D85788, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0, startTime=1452787293043, finishTime=1452787293101, timeTaken=58, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293093, Process_Duration=6, Process_End_Time=1452787293099, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:33,103 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292802_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:33,103 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:33,101 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787292802_0001_00_000001
2016-01-14 16:01:33,103 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,106 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:33,106 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:TASK_FINISHED]: vertexName=D56F16D814E845199B025ECA40D85788, taskId=task_1452787292802_0001_1_00_000000, startTime=1452787293043, finishTime=1452787293106, timeTaken=63, status=SUCCEEDED, successfulAttemptID=attempt_1452787292802_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293093, Process_Duration=6, Process_End_Time=1452787293099, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:33,107 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292802_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:33,107 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] : 1
2016-01-14 16:01:33,108 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,109 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:33,110 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:VERTEX_FINISHED]: vertexName=D56F16D814E845199B025ECA40D85788, vertexId=vertex_1452787292802_0001_1_00, initRequestedTime=1452787293013, initedTime=1452787293027, startRequestedTime=1452787293028, startedTime=1452787293028, finishTime=1452787293108, timeTaken=80, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293093, Process_Duration=6, Process_End_Time=1452787293099, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1452787293043, firstTasksToStart=[ task_1452787292802_0001_1_00_000000 ], lastTaskFinishTime=1452787293101, lastTasksToFinish=[ task_1452787292802_0001_1_00_000000 ], minTaskDuration=58, maxTaskDuration=58, avgTaskDuration=58.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787292802_0001_1_00_000000 ], longestDurationTasks=[ task_1452787292802_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:33,111 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:33,111 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:33,111 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787292802_0001_00_000001, stoppedTime=1452787293111, exitStatus=0
2016-01-14 16:01:33,111 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:33,112 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:33,112 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:33,112 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787292802_0001_1
2016-01-14 16:01:33,112 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787292802_0001_1
2016-01-14 16:01:33,112 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 451AA0DFCD704EC680DFFE60AC1DC83F for vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,116 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787292802_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:33,116 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787292802_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:33,117 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787292802_0001_00_000001, Exiting
2016-01-14 16:01:33,117 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787292802_0001_00_000001
2016-01-14 16:01:33,117 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787292802_0001_00_000001
2016-01-14 16:01:33,122 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787292802_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:33,123 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787292802_0001_00_000001 completed successfully
2016-01-14 16:01:33,127 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787292802_0001_1, queueSize=0
2016-01-14 16:01:33,127 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:33,130 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787292802_0001_1, startTime=1452787293012, finishTime=1452787293125, timeTaken=113, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293093, Process_Duration=6, Process_End_Time=1452787293099, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:33,130 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787292802_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:33,131 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292802_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:33,131 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787292802_0001_00_000001
2016-01-14 16:01:33,132 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:33 Completed Dag: dag_1452787292802_0001_1
2016-01-14 16:01:33,132 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787292802_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:33,132 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787292802_0001_1_post
2016-01-14 16:01:33,133 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,133 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:33,141 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452787292802_0001
2016-01-14 16:01:33,144 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:33,145 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:33,145 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:33,145 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:33,145 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:33,146 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:33,148 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:33,149 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:33,149 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:33,150 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:33,150 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:33,151 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:33,151 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:33,157 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001
2016-01-14 16:01:33,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.388
2016-01-14 16:01:33,213 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-01-14 16:01:33,248 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:33,249 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:33,306 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:01:33,315 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-01-14 16:01:33,316 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:33,316 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:33,316 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:33,338 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 16:01:33,340 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-01-14 16:01:33,355 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:33,355 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:33,355 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-01-14 16:01:33,356 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 16:01:33,356 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 16:01:33,356 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 16:01:33,357 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...Text/quoted/normcharfalse
2016-01-14 16:01:33,357 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:33,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:33,381 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:33,381 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:33,382 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:33,391 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001 doesn't exist and is created
2016-01-14 16:01:33,409 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:33,409 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:33,410 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001
2016-01-14 16:01:33,414 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787293381_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:33,431 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:33,432 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:33,435 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:33,435 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:33,435 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001/localmode-log-dir
2016-01-14 16:01:33,435 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001/localmode-log-dir/history.txt.appattempt_1452787293381_0001_000000, maxErrors=10
2016-01-14 16:01:33,435 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:33,437 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787293381_0001_000000, appSubmitTime=1452787293413, launchTime=1452787293413
2016-01-14 16:01:33,446 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:33,447 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:33,449 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:33,449 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:33,454 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:41773
2016-01-14 16:01:33,456 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:33,458 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787293381_0001_000000, startTime=1452787293458
2016-01-14 16:01:33,458 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:33,458 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:33,509 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:33,510 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:33,510 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452787293381_0001, dagName=[22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 16:01:33,535 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 16:01:33,539 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787293381_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001/localmode-log-dir/dag_1452787293381_0001_1.dot
2016-01-14 16:01:33,540 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001/localmode-log-dir/dag_1452787293381_0001_1-tez-dag.pb.txt
2016-01-14 16:01:33,562 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787293381_0001_1
2016-01-14 16:01:33,562 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,562 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 16:01:33 Running Dag: dag_1452787293381_0001_1
2016-01-14 16:01:33,577 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:33,578 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787293381_0001_1, submitTime=1452787293536
2016-01-14 16:01:33,579 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E522F08488274EAC9732D62DC215CDF0
2016-01-14 16:01:33,579 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:33,580 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:33,582 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787293381_0001_1, initTime=1452787293579
2016-01-14 16:01:33,582 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787293381_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:33,583 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:DAG_STARTED]: dagID=dag_1452787293381_0001_1, startTime=1452787293582
2016-01-14 16:01:33,583 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:33,583 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787293381_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:33,583 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E522F08488274EAC9732D62DC215CDF0 : {27D780E469E1437BA8036C455D32FE30={InputName=27D780E469E1437BA8036C455D32FE30}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:33,583 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 27D780E469E1437BA8036C455D32FE30, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:33,583 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,583 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,583 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,584 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]. Starting root input initializers: 1
2016-01-14 16:01:33,583 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:33,584 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:33,584 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 27D780E469E1437BA8036C455D32FE30 on vertex vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,585 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452787293381_0001, dagName=[22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 16:01:33,587 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:33,587 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 27D780E469E1437BA8036C455D32FE30 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:33,588 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:33,588 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:33,592 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 16:01:33,592 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 27D780E469E1437BA8036C455D32FE30 on vertex vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,593 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:33,593 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {27D780E469E1437BA8036C455D32FE30=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:33,594 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] parallelism set to 1
2016-01-14 16:01:33,594 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:33,594 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787293381_0001_1_00, eventCount=1
2016-01-14 16:01:33,594 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,595 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=03D959FC05F84E03BD66C325924F38C6, vertexId=vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:33,595 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=03D959FC05F84E03BD66C325924F38C6, vertexId=vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,598 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=03D959FC05F84E03BD66C325924F38C6, vertexName=E522F08488274EAC9732D62DC215CDF0, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:33,599 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=03D959FC05F84E03BD66C325924F38C6, vertexId=vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,602 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E522F08488274EAC9732D62DC215CDF0, vertexId=vertex_1452787293381_0001_1_00, initRequestedTime=1452787293583, initedTime=1452787293602, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:33,602 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:33,603 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] with distanceFromRoot: 0
2016-01-14 16:01:33,603 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:33,604 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E522F08488274EAC9732D62DC215CDF0
2016-01-14 16:01:33,605 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,606 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:33,606 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787293381_0001_1_00, startRequestedTime=1452787293604, startedTime=1452787293604
2016-01-14 16:01:33,607 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:33,608 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:33,608 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:TASK_STARTED]: vertexName=E522F08488274EAC9732D62DC215CDF0, taskId=task_1452787293381_0001_1_00_000000, scheduledTime=1452787293607, launchTime=1452787293607
2016-01-14 16:01:33,609 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787293381_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:33,609 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,610 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: E522F08488274EAC9732D62DC215CDF0, VertexParallelism: 1, TaskAttemptID:attempt_1452787293381_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=27D780E469E1437BA8036C455D32FE30, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=03D959FC05F84E03BD66C325924F38C6, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:33,610 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787293381_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:33,611 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:33,613 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:33,614 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:33,614 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:33,616 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787293381_0001_00_000001
2016-01-14 16:01:33,616 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:33,619 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787293381_0001, with dag id: dag_1452787293381_0001_1
2016-01-14 16:01:33,621 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452787293381_0001_00_000001
2016-01-14 16:01:33,621 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:33,625 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:33,627 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:33,627 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787293381_0001_00_000001, launchTime=1452787293623
2016-01-14 16:01:33,628 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787293381_0001_00_000001
2016-01-14 16:01:33,632 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787293381_0001_1_00_000000_0] to container: [container_1452787293381_0001_00_000001]
2016-01-14 16:01:33,632 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:33,633 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787293381_0001_00_000001 given task: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,633 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787293381_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,633 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787293381_0001_1_00_000000_0] started. Is using containerId: [container_1452787293381_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:33 Starting to run new task attempt: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,635 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,636 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,636 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:33,637 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E522F08488274EAC9732D62DC215CDF0, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0, startTime=1452787293633, containerId=container_1452787293381_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787293381_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:33,636 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:33,637 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:33,638 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:33,638 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:33,639 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:33,639 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787293381_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:33,640 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787293381_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:33,639 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: E522F08488274EAC9732D62DC215CDF0, VertexParallelism: 1, TaskAttemptID:attempt_1452787293381_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=27D780E469E1437BA8036C455D32FE30, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=03D959FC05F84E03BD66C325924F38C6, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:33,640 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:33,641 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,642 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:33,643 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,642 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787293381_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:33,644 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=27D780E469E1437BA8036C455D32FE30, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:33,644 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,645 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:33,645 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=03D959FC05F84E03BD66C325924F38C6, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:33,645 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,646 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,647 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:33,647 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 03D959FC05F84E03BD66C325924F38C6
2016-01-14 16:01:33,647 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:33,647 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 03D959FC05F84E03BD66C325924F38C6
2016-01-14 16:01:33,650 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:33,650 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,650 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,653 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:33,664 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E522F08488274EAC9732D62DC215CDF0, ordinal: 0
2016-01-14 16:01:33,665 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E522F08488274EAC9732D62DC215CDF0, mem on start (mb), free: 142, total: 397, max: 672
2016-01-14 16:01:33,693 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,693 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:33,693 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:33,694 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:33,694 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 03D959FC05F84E03BD66C325924F38C6
2016-01-14 16:01:33,695 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:33,695 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:33,695 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:33,696 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:33,696 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:33,696 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:33,696 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:33,696 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:33,697 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 27D780E469E1437BA8036C455D32FE30, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:33,697 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 03D959FC05F84E03BD66C325924F38C6, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:33,697 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:33,697 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 27D780E469E1437BA8036C455D32FE30 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:33,697 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:33,697 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:33,698 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,698 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:33,698 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,698 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:33,699 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,700 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:33,701 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:33,702 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,702 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@480c26ba
2016-01-14 16:01:33,702 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"], id: 03D959FC05F84E03BD66C325924F38C6
2016-01-14 16:01:33,702 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-01-14 16:01:33,702 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:33,703 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:33,703 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@480c26ba
2016-01-14 16:01:33,703 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:33,703 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:33,703 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E522F08488274EAC9732D62DC215CDF0, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:33,706 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:33,707 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:33,707 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,707 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787293381_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:33,708 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,708 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E522F08488274EAC9732D62DC215CDF0, mem on close (mb), free: 361, total: 397, max: 672
2016-01-14 16:01:33 Completed running task attempt: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,709 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:33,710 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=712, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=28, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787293703, Process_Duration=5, Process_End_Time=1452787293708, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 16:01:33,711 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E522F08488274EAC9732D62DC215CDF0, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0, startTime=1452787293633, finishTime=1452787293710, timeTaken=77, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=712, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=28, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293703, Process_Duration=5, Process_End_Time=1452787293708, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:33,711 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787293381_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:33,711 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 16:01:33,712 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,712 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:33,713 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787293381_0001_00_000001
2016-01-14 16:01:33,711 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,711 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:33,714 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:TASK_FINISHED]: vertexName=E522F08488274EAC9732D62DC215CDF0, taskId=task_1452787293381_0001_1_00_000000, startTime=1452787293633, finishTime=1452787293713, timeTaken=80, status=SUCCEEDED, successfulAttemptID=attempt_1452787293381_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=712, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=28, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293703, Process_Duration=5, Process_End_Time=1452787293708, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:33,714 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787293381_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:33,714 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] : 1
2016-01-14 16:01:33,715 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,715 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:33,716 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:VERTEX_FINISHED]: vertexName=E522F08488274EAC9732D62DC215CDF0, vertexId=vertex_1452787293381_0001_1_00, initRequestedTime=1452787293583, initedTime=1452787293602, startRequestedTime=1452787293604, startedTime=1452787293604, finishTime=1452787293715, timeTaken=111, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=712, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=28, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293703, Process_Duration=5, Process_End_Time=1452787293708, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452787293633, firstTasksToStart=[ task_1452787293381_0001_1_00_000000 ], lastTaskFinishTime=1452787293710, lastTasksToFinish=[ task_1452787293381_0001_1_00_000000 ], minTaskDuration=77, maxTaskDuration=77, avgTaskDuration=77.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787293381_0001_1_00_000000 ], longestDurationTasks=[ task_1452787293381_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:33,717 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:33,717 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:33,717 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:33,717 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787293381_0001_00_000001, stoppedTime=1452787293717, exitStatus=0
2016-01-14 16:01:33,718 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:33,718 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:33,718 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787293381_0001_1
2016-01-14 16:01:33,718 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787293381_0001_1
2016-01-14 16:01:33,718 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 03D959FC05F84E03BD66C325924F38C6 for vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,718 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:33,724 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787293381_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:33,724 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787293381_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:33,724 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787293381_0001_00_000001, Exiting
2016-01-14 16:01:33,724 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787293381_0001_00_000001
2016-01-14 16:01:33,724 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787293381_0001_00_000001
2016-01-14 16:01:33,727 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787293381_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:33,727 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787293381_0001_00_000001 completed successfully
2016-01-14 16:01:33,729 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787293381_0001_1, queueSize=0
2016-01-14 16:01:33,730 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:33,730 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787293381_0001_1, startTime=1452787293582, finishTime=1452787293728, timeTaken=146, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=712, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=28, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293703, Process_Duration=5, Process_End_Time=1452787293708, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:33,730 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787293381_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:33,730 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787293381_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:33,730 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:33,730 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787293381_0001_00_000001
2016-01-14 16:01:33 Completed Dag: dag_1452787293381_0001_1
2016-01-14 16:01:33,731 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787293381_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:33,731 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787293381_0001_1_post
2016-01-14 16:01:33,732 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,732 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:33,740 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452787293381_0001
2016-01-14 16:01:33,745 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:33,745 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:33,745 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:33,745 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:33,745 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:33,746 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:33,746 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:33,746 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:33,747 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:33,747 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:33,747 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:33,748 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:33,748 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:33,752 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001
2016-01-14 16:01:33,752 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.397
2016-01-14 16:01:33,860 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-01-14 16:01:33,995 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:33,995 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:34,038 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 16:01:34,053 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 16:01:34,053 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:34,054 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:34,054 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:34,069 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt
2016-01-14 16:01:34,070 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-01-14 16:01:34,095 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:34,096 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 16:01:34,097 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-01-14 16:01:34,097 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 16:01:34,097 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 16:01:34,098 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 16:01:34,098 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...oercion/testFieldCoercion
2016-01-14 16:01:34,099 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:34,113 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:34,120 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:34,120 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:34,120 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:34,130 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001 doesn't exist and is created
2016-01-14 16:01:34,146 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:34,147 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:34,147 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001
2016-01-14 16:01:34,151 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787294120_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:34,163 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:34,164 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:34,166 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:34,167 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:34,167 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001/localmode-log-dir
2016-01-14 16:01:34,167 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001/localmode-log-dir/history.txt.appattempt_1452787294120_0001_000000, maxErrors=10
2016-01-14 16:01:34,168 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:34,169 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787294120_0001_000000, appSubmitTime=1452787294151, launchTime=1452787294151
2016-01-14 16:01:34,174 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:34,176 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:34,177 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:33972
2016-01-14 16:01:34,178 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:34,178 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:34,179 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:34,182 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787294120_0001_000000, startTime=1452787294182
2016-01-14 16:01:34,182 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:34,182 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:34,247 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:34,247 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:34,247 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452787294120_0001, dagName=[38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 16:01:34,266 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 16:01:34,268 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787294120_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001/localmode-log-dir/dag_1452787294120_0001_1.dot
2016-01-14 16:01:34,270 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001/localmode-log-dir/dag_1452787294120_0001_1-tez-dag.pb.txt
2016-01-14 16:01:34,296 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787294120_0001_1
2016-01-14 16:01:34,296 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:34,296 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 16:01:34 Running Dag: dag_1452787294120_0001_1
2016-01-14 16:01:34,313 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:34,314 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787294120_0001_1, submitTime=1452787294266
2016-01-14 16:01:34,315 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AC54CE9988EB4760A489FEC4505ABA88
2016-01-14 16:01:34,315 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:34,316 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:34,317 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787294120_0001_1, initTime=1452787294314
2016-01-14 16:01:34,317 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294120_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:34,318 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:DAG_STARTED]: dagID=dag_1452787294120_0001_1, startTime=1452787294318
2016-01-14 16:01:34,318 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:34,319 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294120_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:34,319 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AC54CE9988EB4760A489FEC4505ABA88 : {0A0354BC4E9D4CF8B472A3F2B2067E71={InputName=0A0354BC4E9D4CF8B472A3F2B2067E71}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:34,319 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 0A0354BC4E9D4CF8B472A3F2B2067E71, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:34,319 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,319 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,319 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,320 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]. Starting root input initializers: 1
2016-01-14 16:01:34,320 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:34,321 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:34,322 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 0A0354BC4E9D4CF8B472A3F2B2067E71 on vertex vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,324 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:34,325 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452787294120_0001, dagName=[38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 16:01:34,325 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 0A0354BC4E9D4CF8B472A3F2B2067E71 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:34,326 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:34,327 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:34,330 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 420
2016-01-14 16:01:34,330 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 0A0354BC4E9D4CF8B472A3F2B2067E71 on vertex vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,331 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:34,331 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {0A0354BC4E9D4CF8B472A3F2B2067E71=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:34,332 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] parallelism set to 1
2016-01-14 16:01:34,332 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:34,332 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787294120_0001_1_00, eventCount=1
2016-01-14 16:01:34,332 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,333 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=47107B05F64F4C789DE8138798EB3138, vertexId=vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:34,333 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=47107B05F64F4C789DE8138798EB3138, vertexId=vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,336 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=47107B05F64F4C789DE8138798EB3138, vertexName=AC54CE9988EB4760A489FEC4505ABA88, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:34,336 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=47107B05F64F4C789DE8138798EB3138, vertexId=vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,340 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:34,340 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, vertexId=vertex_1452787294120_0001_1_00, initRequestedTime=1452787294319, initedTime=1452787294339, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:34,340 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] with distanceFromRoot: 0
2016-01-14 16:01:34,341 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:34,341 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AC54CE9988EB4760A489FEC4505ABA88
2016-01-14 16:01:34,342 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,342 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:34,343 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787294120_0001_1_00, startRequestedTime=1452787294341, startedTime=1452787294341
2016-01-14 16:01:34,343 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:34,344 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:34,345 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:TASK_STARTED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, taskId=task_1452787294120_0001_1_00_000000, scheduledTime=1452787294344, launchTime=1452787294344
2016-01-14 16:01:34,345 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294120_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:34,345 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,346 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: AC54CE9988EB4760A489FEC4505ABA88, VertexParallelism: 1, TaskAttemptID:attempt_1452787294120_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0A0354BC4E9D4CF8B472A3F2B2067E71, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=47107B05F64F4C789DE8138798EB3138, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:34,347 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294120_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:34,347 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:34,348 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:34,349 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:34,349 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:34,350 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787294120_0001_00_000001
2016-01-14 16:01:34,350 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:34,352 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787294120_0001, with dag id: dag_1452787294120_0001_1
2016-01-14 16:01:34,353 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452787294120_0001_00_000001
2016-01-14 16:01:34,353 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:34,354 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:34,354 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787294120_0001_00_000001, launchTime=1452787294354
2016-01-14 16:01:34,355 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:34,355 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787294120_0001_00_000001
2016-01-14 16:01:34,357 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787294120_0001_1_00_000000_0] to container: [container_1452787294120_0001_00_000001]
2016-01-14 16:01:34,358 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:34,358 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787294120_0001_1_00_000000_0] started. Is using containerId: [container_1452787294120_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:34,358 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0, startTime=1452787294358, containerId=container_1452787294120_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787294120_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:34,359 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294120_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:34,359 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:34,359 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294120_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:34,359 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787294120_0001_00_000001 given task: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,360 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787294120_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34 Starting to run new task attempt: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,362 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,362 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:34,362 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:34,362 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:34,362 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:34,362 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:34,363 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:34,363 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: AC54CE9988EB4760A489FEC4505ABA88, VertexParallelism: 1, TaskAttemptID:attempt_1452787294120_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0A0354BC4E9D4CF8B472A3F2B2067E71, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=47107B05F64F4C789DE8138798EB3138, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:34,363 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:34,363 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,364 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:34,364 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:34,365 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=0A0354BC4E9D4CF8B472A3F2B2067E71, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:34,365 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:34,365 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,366 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,367 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:34,367 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=47107B05F64F4C789DE8138798EB3138, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:34,368 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:34,368 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 47107B05F64F4C789DE8138798EB3138
2016-01-14 16:01:34,368 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:34,369 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 47107B05F64F4C789DE8138798EB3138
2016-01-14 16:01:34,376 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787294120_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:34,377 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:34,380 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:34,386 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,387 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,393 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:34,393 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 47107B05F64F4C789DE8138798EB3138
2016-01-14 16:01:34,396 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AC54CE9988EB4760A489FEC4505ABA88, ordinal: 0
2016-01-14 16:01:34,396 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AC54CE9988EB4760A489FEC4505ABA88, mem on start (mb), free: 268, total: 397, max: 672
2016-01-14 16:01:34,396 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:34,396 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:34,396 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:34,396 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:34,397 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:34,397 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:34,397 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:34,398 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:34,398 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:34,398 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:34,399 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:34,399 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 0A0354BC4E9D4CF8B472A3F2B2067E71, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:34,399 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 47107B05F64F4C789DE8138798EB3138, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:34,399 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:34,400 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,400 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:34,400 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,400 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 0A0354BC4E9D4CF8B472A3F2B2067E71 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:34,401 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:34,401 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:34,401 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:34,402 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,405 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 16:01:34,406 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:34,408 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7afd1f50
2016-01-14 16:01:34,411 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7afd1f50
2016-01-14 16:01:34,411 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:34,411 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:34,415 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"] streamed: true, id: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,416 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"], id: 47107B05F64F4C789DE8138798EB3138
2016-01-14 16:01:34,417 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-01-14 16:01:34,510 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 16:01:34,510 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:34,510 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AC54CE9988EB4760A489FEC4505ABA88, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:34,517 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:34,517 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:34,518 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,518 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787294120_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:34,519 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,520 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AC54CE9988EB4760A489FEC4505ABA88, mem on close (mb), free: 263, total: 397, max: 672
2016-01-14 16:01:34 Completed running task attempt: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,521 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:34,522 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10][cascading.flow.SliceCounters Process_Begin_Time=1452787294510, Process_Duration=9, Process_End_Time=1452787294519, Read_Duration=2, Tuples_Read=9, Tuples_Written=9, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=9, Tuples_Written=9]]
2016-01-14 16:01:34,523 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 16:01:34,523 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:34,523 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0, startTime=1452787294358, finishTime=1452787294522, timeTaken=164, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452787294510, Process_Duration=9, Process_End_Time=1452787294519, Read_Duration=2, Tuples_Read=9, Tuples_Written=9, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 16:01:34,524 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294120_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:34,524 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:34,524 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787294120_0001_00_000001
2016-01-14 16:01:34,526 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,527 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:34,527 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:TASK_FINISHED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, taskId=task_1452787294120_0001_1_00_000000, startTime=1452787294358, finishTime=1452787294526, timeTaken=168, status=SUCCEEDED, successfulAttemptID=attempt_1452787294120_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452787294510, Process_Duration=9, Process_End_Time=1452787294519, Read_Duration=2, Tuples_Read=9, Tuples_Written=9, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 16:01:34,527 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294120_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:34,527 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:34,528 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] : 1
2016-01-14 16:01:34,529 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,530 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:34,530 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:VERTEX_FINISHED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, vertexId=vertex_1452787294120_0001_1_00, initRequestedTime=1452787294319, initedTime=1452787294339, startRequestedTime=1452787294341, startedTime=1452787294341, finishTime=1452787294529, timeTaken=188, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452787294510, Process_Duration=9, Process_End_Time=1452787294519, Read_Duration=2, Tuples_Read=9, Tuples_Written=9, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9, vertexStats=firstTaskStartTime=1452787294358, firstTasksToStart=[ task_1452787294120_0001_1_00_000000 ], lastTaskFinishTime=1452787294522, lastTasksToFinish=[ task_1452787294120_0001_1_00_000000 ], minTaskDuration=164, maxTaskDuration=164, avgTaskDuration=164.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787294120_0001_1_00_000000 ], longestDurationTasks=[ task_1452787294120_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:34,531 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:34,531 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:34,531 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787294120_0001_00_000001, stoppedTime=1452787294531, exitStatus=0
2016-01-14 16:01:34,531 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:34,532 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:34,532 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:34,533 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787294120_0001_1
2016-01-14 16:01:34,533 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787294120_0001_1
2016-01-14 16:01:34,533 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 47107B05F64F4C789DE8138798EB3138 for vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,536 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787294120_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:34,537 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787294120_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:34,537 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787294120_0001_00_000001, Exiting
2016-01-14 16:01:34,537 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787294120_0001_00_000001
2016-01-14 16:01:34,537 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787294120_0001_00_000001
2016-01-14 16:01:34,542 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787294120_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:34,542 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787294120_0001_00_000001 completed successfully
2016-01-14 16:01:34,547 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787294120_0001_1, queueSize=0
2016-01-14 16:01:34,547 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:34,548 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787294120_0001_1, startTime=1452787294318, finishTime=1452787294546, timeTaken=228, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452787294510, Process_Duration=9, Process_End_Time=1452787294519, Read_Duration=2, Tuples_Read=9, Tuples_Written=9, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 16:01:34,548 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787294120_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:34,548 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294120_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:34,548 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:34,548 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787294120_0001_00_000001
2016-01-14 16:01:34 Completed Dag: dag_1452787294120_0001_1
2016-01-14 16:01:34,549 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787294120_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:34,549 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787294120_0001_1_post
2016-01-14 16:01:34,549 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:34,549 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:34,557 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452787294120_0001
2016-01-14 16:01:34,560 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:34,561 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:34,561 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:34,561 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:34,561 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:34,562 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:34,563 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:34,563 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:34,563 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:34,564 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:34,564 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:34,565 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:34,565 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:34,573 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001
2016-01-14 16:01:34,574 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.479
2016-01-14 16:01:34,615 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-01-14 16:01:34,644 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:34,645 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:34,718 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:01:34,727 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 16:01:34,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:34,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:34,728 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:34,746 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-header.txt
2016-01-14 16:01:34,752 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: __multisink_placeholder_56CBF38D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34,769 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:34,770 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 16:01:34,772 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-01-14 16:01:34,772 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 16:01:34,773 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 16:01:34,774 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 16:01:34,774 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34,775 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:34,790 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:34,796 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:34,797 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:34,797 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:34,810 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001 doesn't exist and is created
2016-01-14 16:01:34,829 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:34,829 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:34,830 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001
2016-01-14 16:01:34,835 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787294796_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:34,853 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:34,855 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:34,857 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:34,857 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:34,858 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001/localmode-log-dir
2016-01-14 16:01:34,859 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001/localmode-log-dir/history.txt.appattempt_1452787294796_0001_000000, maxErrors=10
2016-01-14 16:01:34,859 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:34,859 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787294796_0001_000000, appSubmitTime=1452787294835, launchTime=1452787294835
2016-01-14 16:01:34,864 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:34,866 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:34,875 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:34,875 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:34,877 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:54950
2016-01-14 16:01:34,880 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:34,883 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787294796_0001_000000, startTime=1452787294883
2016-01-14 16:01:34,883 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:34,883 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:34,930 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:34,930 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:34,930 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...D13CE4164BA4B9AC92A9D3984, applicationId=application_1452787294796_0001, dagName=[4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34,951 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34,953 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787294796_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001/localmode-log-dir/dag_1452787294796_0001_1.dot
2016-01-14 16:01:34,954 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001/localmode-log-dir/dag_1452787294796_0001_1-tez-dag.pb.txt
2016-01-14 16:01:34,965 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787294796_0001_1
2016-01-14 16:01:34,965 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:34,965 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34 Running Dag: dag_1452787294796_0001_1
2016-01-14 16:01:34,979 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787294796_0001_1, submitTime=1452787294951
2016-01-14 16:01:34,979 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:34,980 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B2250535EEB5466886B28F80EF4DDA04
2016-01-14 16:01:34,981 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:34,981 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787294796_0001_1, initTime=1452787294980
2016-01-14 16:01:34,982 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294796_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:34,981 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:34,983 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:DAG_STARTED]: dagID=dag_1452787294796_0001_1, startTime=1452787294983
2016-01-14 16:01:34,984 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:34,984 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294796_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:34,984 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B2250535EEB5466886B28F80EF4DDA04 : {AA53B2D6B93140E2A7BB64386AFEF37F={InputName=AA53B2D6B93140E2A7BB64386AFEF37F}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:34,984 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: AA53B2D6B93140E2A7BB64386AFEF37F, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:34,984 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:34,984 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:34,985 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:34,985 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:34,987 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...D13CE4164BA4B9AC92A9D3984, applicationId=application_1452787294796_0001, dagName=[4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34,988 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]. Starting root input initializers: 1
2016-01-14 16:01:34,989 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:34,989 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: AA53B2D6B93140E2A7BB64386AFEF37F on vertex vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:34,991 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:34,991 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input AA53B2D6B93140E2A7BB64386AFEF37F asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:34,992 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:34,992 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:34,995 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 422
2016-01-14 16:01:34,997 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: AA53B2D6B93140E2A7BB64386AFEF37F on vertex vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,001 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:35,001 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {AA53B2D6B93140E2A7BB64386AFEF37F=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:35,001 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] parallelism set to 1
2016-01-14 16:01:35,002 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:35,002 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787294796_0001_1_00, eventCount=1
2016-01-14 16:01:35,002 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,002 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=EDC008CB8A364CE9BD60B29A1895778C, vertexId=vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:35,003 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=EDC008CB8A364CE9BD60B29A1895778C, vertexId=vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,006 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(120)) - Using mapred newApiCommitter.
2016-01-14 16:01:35,008 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=EDC008CB8A364CE9BD60B29A1895778C, vertexName=B2250535EEB5466886B28F80EF4DDA04, outputCommitterClass=org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2016-01-14 16:01:35,008 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=EDC008CB8A364CE9BD60B29A1895778C, vertexId=vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,010 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:35,010 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, vertexId=vertex_1452787294796_0001_1_00, initRequestedTime=1452787294984, initedTime=1452787295010, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:35,011 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] with distanceFromRoot: 0
2016-01-14 16:01:35,011 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:35,011 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B2250535EEB5466886B28F80EF4DDA04
2016-01-14 16:01:35,012 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,012 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:35,013 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787294796_0001_1_00, startRequestedTime=1452787295011, startedTime=1452787295011
2016-01-14 16:01:35,013 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:35,014 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:35,014 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:TASK_STARTED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, taskId=task_1452787294796_0001_1_00_000000, scheduledTime=1452787295013, launchTime=1452787295013
2016-01-14 16:01:35,015 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294796_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:35,015 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,015 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984, VertexName: B2250535EEB5466886B28F80EF4DDA04, VertexParallelism: 1, TaskAttemptID:attempt_1452787294796_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=AA53B2D6B93140E2A7BB64386AFEF37F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=EDC008CB8A364CE9BD60B29A1895778C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:35,016 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294796_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:35,016 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:35,018 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:35,019 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:35,019 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:35,020 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787294796_0001_00_000001
2016-01-14 16:01:35,020 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:35,024 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452787294796_0001_00_000001
2016-01-14 16:01:35,024 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:35,026 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:35,026 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:35,027 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787294796_0001_00_000001, launchTime=1452787295026
2016-01-14 16:01:35,028 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787294796_0001_00_000001
2016-01-14 16:01:35,029 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787294796_0001, with dag id: dag_1452787294796_0001_1
2016-01-14 16:01:35,029 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787294796_0001_1_00_000000_0] to container: [container_1452787294796_0001_00_000001]
2016-01-14 16:01:35,035 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:35,036 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787294796_0001_00_000001 given task: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,036 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787294796_0001_1_00_000000_0] started. Is using containerId: [container_1452787294796_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:35,037 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0, startTime=1452787295036, containerId=container_1452787294796_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787294796_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:35,037 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294796_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:35,037 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294796_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:35,037 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:35,036 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787294796_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35 Starting to run new task attempt: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,040 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,040 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,041 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:35,041 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:35,041 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:35,041 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:35,041 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:35,041 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984, VertexName: B2250535EEB5466886B28F80EF4DDA04, VertexParallelism: 1, TaskAttemptID:attempt_1452787294796_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=AA53B2D6B93140E2A7BB64386AFEF37F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=EDC008CB8A364CE9BD60B29A1895778C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:35,042 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:35,046 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,046 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:35,046 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,047 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=AA53B2D6B93140E2A7BB64386AFEF37F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:35,048 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,051 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787294796_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:35,054 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:35,055 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=EDC008CB8A364CE9BD60B29A1895778C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:35,058 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:35,058 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: EDC008CB8A364CE9BD60B29A1895778C
2016-01-14 16:01:35,059 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:35,059 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: EDC008CB8A364CE9BD60B29A1895778C
2016-01-14 16:01:35,052 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:35,060 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,060 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,066 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:35,066 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,066 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,073 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B2250535EEB5466886B28F80EF4DDA04, ordinal: 0
2016-01-14 16:01:35,073 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B2250535EEB5466886B28F80EF4DDA04, mem on start (mb), free: 190, total: 397, max: 672
2016-01-14 16:01:35,074 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,074 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:35,074 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:35,078 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: true
2016-01-14 16:01:35,078 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: EDC008CB8A364CE9BD60B29A1895778C
2016-01-14 16:01:35,078 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:35,079 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:35,079 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:35,079 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:35,079 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:35,079 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:35,080 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:35,080 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:35,080 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, EDC008CB8A364CE9BD60B29A1895778C, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:35,080 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, AA53B2D6B93140E2A7BB64386AFEF37F, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:35,081 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:35,081 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,081 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:35,081 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,081 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: AA53B2D6B93140E2A7BB64386AFEF37F being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:35,082 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:35,082 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:35,082 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:35,083 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,086 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:35,087 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@752e57
2016-01-14 16:01:35,087 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 16:01:35,089 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"] streamed: true, id: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,091 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@752e57
2016-01-14 16:01:35,091 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]], id: EDC008CB8A364CE9BD60B29A1895778C
2016-01-14 16:01:35,091 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:35,092 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:35,093 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-01-14 16:01:35,096 INFO tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"]
2016-01-14 16:01:35,105 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14527872947960_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14527872947960_0001_m_000000_0
2016-01-14 16:01:35,105 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 16:01:35,115 INFO tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]
2016-01-14 16:01:35,126 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14527872947960_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14527872947960_0001_m_000000_0
2016-01-14 16:01:35,126 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 16:01:35,136 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 16:01:35,136 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:35,136 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B2250535EEB5466886B28F80EF4DDA04, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:35,141 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/part-00000
2016-01-14 16:01:35,142 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14527872947960_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14527872947960_0001_m_000000_0
2016-01-14 16:01:35,146 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14527872947960_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-01-14 16:01:35,146 INFO io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/part-00000
2016-01-14 16:01:35,147 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14527872947960_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14527872947960_0001_m_000000_0
2016-01-14 16:01:35,149 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14527872947960_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-01-14 16:01:35,149 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,150 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787294796_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:35,150 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:35,151 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:35,152 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,152 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B2250535EEB5466886B28F80EF4DDA04, mem on close (mb), free: 183, total: 397, max: 672
2016-01-14 16:01:35 Completed running task attempt: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,154 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:35,155 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787295136, Process_Duration=16, Process_End_Time=1452787295152, Read_Duration=2, Tuples_Read=13, Tuples_Written=13, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=13, Tuples_Written=13]]
2016-01-14 16:01:35,156 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:35,156 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 16:01:35,157 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,156 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0, startTime=1452787295036, finishTime=1452787295155, timeTaken=119, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787295136, Process_Duration=16, Process_End_Time=1452787295152, Read_Duration=2, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 16:01:35,157 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294796_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:35,157 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,157 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:35,159 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:35,160 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:TASK_FINISHED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, taskId=task_1452787294796_0001_1_00_000000, startTime=1452787295036, finishTime=1452787295157, timeTaken=121, status=SUCCEEDED, successfulAttemptID=attempt_1452787294796_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787295136, Process_Duration=16, Process_End_Time=1452787295152, Read_Duration=2, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 16:01:35,160 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294796_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:35,160 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] : 1
2016-01-14 16:01:35,160 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,163 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787294796_0001_00_000001
2016-01-14 16:01:35,164 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:35,164 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:VERTEX_FINISHED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, vertexId=vertex_1452787294796_0001_1_00, initRequestedTime=1452787294984, initedTime=1452787295010, startRequestedTime=1452787295011, startedTime=1452787295011, finishTime=1452787295160, timeTaken=149, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787295136, Process_Duration=16, Process_End_Time=1452787295152, Read_Duration=2, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13, vertexStats=firstTaskStartTime=1452787295036, firstTasksToStart=[ task_1452787294796_0001_1_00_000000 ], lastTaskFinishTime=1452787295155, lastTasksToFinish=[ task_1452787294796_0001_1_00_000000 ], minTaskDuration=119, maxTaskDuration=119, avgTaskDuration=119.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787294796_0001_1_00_000000 ], longestDurationTasks=[ task_1452787294796_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:35,164 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:35,165 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:35,165 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787294796_0001_00_000001, stoppedTime=1452787295165, exitStatus=0
2016-01-14 16:01:35,165 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:35,165 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:35,165 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787294796_0001_1
2016-01-14 16:01:35,165 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:35,166 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787294796_0001_1
2016-01-14 16:01:35,166 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: EDC008CB8A364CE9BD60B29A1895778C for vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,174 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787294796_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:35,174 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787294796_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:35,174 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787294796_0001_00_000001, Exiting
2016-01-14 16:01:35,175 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787294796_0001_00_000001
2016-01-14 16:01:35,175 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787294796_0001_00_000001
2016-01-14 16:01:35,177 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787294796_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:35,177 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787294796_0001_00_000001 completed successfully
2016-01-14 16:01:35,178 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787294796_0001_1, queueSize=0
2016-01-14 16:01:35,178 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787294796_0001_1, startTime=1452787294983, finishTime=1452787295175, timeTaken=192, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787295136, Process_Duration=16, Process_End_Time=1452787295152, Read_Duration=2, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 16:01:35,179 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787294796_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:35,179 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:35,179 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294796_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:35,179 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:35 Completed Dag: dag_1452787294796_0001_1
2016-01-14 16:01:35,180 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787294796_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:35,180 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787294796_0001_1_post
2016-01-14 16:01:35,180 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787294796_0001_00_000001
2016-01-14 16:01:35,180 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,180 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:35,187 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...D13CE4164BA4B9AC92A9D3984, applicationId=application_1452787294796_0001
2016-01-14 16:01:35,191 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:35,191 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:35,192 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:35,192 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:35,192 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:35,192 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:35,193 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:35,193 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:35,194 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:35,194 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:35,194 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:35,195 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:35,195 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:35,199 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001
2016-01-14 16:01:35,199 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.430
2016-01-14 16:01:35,359 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-01-14 16:01:35,359 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-01-14 16:01:35,388 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:35,389 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:35,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 16:01:35,434 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:01:35,434 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:35,435 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:35,435 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:35,451 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 16:01:35,452 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header
2016-01-14 16:01:35,465 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:35,465 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:35,465 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-01-14 16:01:35,465 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 16:01:35,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 16:01:35,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 16:01:35,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...latform/testHeader/header
2016-01-14 16:01:35,467 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:35,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:35,488 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:35,488 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:35,489 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:35,498 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001 doesn't exist and is created
2016-01-14 16:01:35,546 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:35,546 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:35,547 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001
2016-01-14 16:01:35,551 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787295488_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:35,565 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:35,567 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:35,569 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:35,569 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:35,570 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001/localmode-log-dir
2016-01-14 16:01:35,571 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001/localmode-log-dir/history.txt.appattempt_1452787295488_0001_000000, maxErrors=10
2016-01-14 16:01:35,571 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:35,572 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787295488_0001_000000, appSubmitTime=1452787295550, launchTime=1452787295550
2016-01-14 16:01:35,576 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:35,578 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:35,579 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:48717
2016-01-14 16:01:35,579 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:35,582 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:35,583 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:35,585 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787295488_0001_000000, startTime=1452787295585
2016-01-14 16:01:35,585 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:35,586 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:35,646 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:35,647 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:35,647 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452787295488_0001, dagName=[3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header
2016-01-14 16:01:35,663 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header
2016-01-14 16:01:35,665 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787295488_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001/localmode-log-dir/dag_1452787295488_0001_1.dot
2016-01-14 16:01:35,666 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001/localmode-log-dir/dag_1452787295488_0001_1-tez-dag.pb.txt
2016-01-14 16:01:35,677 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787295488_0001_1
2016-01-14 16:01:35,677 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,677 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header
2016-01-14 16:01:35 Running Dag: dag_1452787295488_0001_1
2016-01-14 16:01:35,690 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:35,690 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787295488_0001_1, submitTime=1452787295664
2016-01-14 16:01:35,691 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BC6EEA7A30804E9FAF321D16153ADA4E
2016-01-14 16:01:35,691 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:35,691 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:35,693 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787295488_0001_1, initTime=1452787295690
2016-01-14 16:01:35,693 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295488_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:35,694 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:DAG_STARTED]: dagID=dag_1452787295488_0001_1, startTime=1452787295693
2016-01-14 16:01:35,694 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:35,694 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:35,694 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295488_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:35,694 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452787295488_0001, dagName=[3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header
2016-01-14 16:01:35,694 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BC6EEA7A30804E9FAF321D16153ADA4E : {768425A581BD4874995DAC2A4D27682A={InputName=768425A581BD4874995DAC2A4D27682A}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:35,695 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 768425A581BD4874995DAC2A4D27682A, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:35,695 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,695 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,695 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,695 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]. Starting root input initializers: 1
2016-01-14 16:01:35,696 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:35,696 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 768425A581BD4874995DAC2A4D27682A on vertex vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,699 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:35,699 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 768425A581BD4874995DAC2A4D27682A asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:35,700 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:35,700 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:35,702 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 16:01:35,703 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 768425A581BD4874995DAC2A4D27682A on vertex vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,704 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:35,704 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {768425A581BD4874995DAC2A4D27682A=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:35,704 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] parallelism set to 1
2016-01-14 16:01:35,704 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:35,705 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787295488_0001_1_00, eventCount=1
2016-01-14 16:01:35,705 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,705 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=B808F545BFD54C3EA75C51A0BE472269, vertexId=vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:35,705 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=B808F545BFD54C3EA75C51A0BE472269, vertexId=vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,707 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=B808F545BFD54C3EA75C51A0BE472269, vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:35,707 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=B808F545BFD54C3EA75C51A0BE472269, vertexId=vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,709 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:35,709 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, vertexId=vertex_1452787295488_0001_1_00, initRequestedTime=1452787295694, initedTime=1452787295708, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:35,709 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] with distanceFromRoot: 0
2016-01-14 16:01:35,709 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:35,709 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BC6EEA7A30804E9FAF321D16153ADA4E
2016-01-14 16:01:35,710 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,710 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:35,711 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787295488_0001_1_00, startRequestedTime=1452787295709, startedTime=1452787295709
2016-01-14 16:01:35,711 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:35,711 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:35,712 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:TASK_STARTED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, taskId=task_1452787295488_0001_1_00_000000, scheduledTime=1452787295711, launchTime=1452787295711
2016-01-14 16:01:35,712 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295488_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:35,712 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,712 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header, VertexName: BC6EEA7A30804E9FAF321D16153ADA4E, VertexParallelism: 1, TaskAttemptID:attempt_1452787295488_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=768425A581BD4874995DAC2A4D27682A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B808F545BFD54C3EA75C51A0BE472269, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:35,713 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295488_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:35,713 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:35,715 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:35,716 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787295488_0001, with dag id: dag_1452787295488_0001_1
2016-01-14 16:01:35,718 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:35,720 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:35,721 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787295488_0001_00_000001
2016-01-14 16:01:35,721 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:35,722 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452787295488_0001_00_000001
2016-01-14 16:01:35,722 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:35,723 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:35,723 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787295488_0001_00_000001, launchTime=1452787295723
2016-01-14 16:01:35,723 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:35,724 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787295488_0001_00_000001
2016-01-14 16:01:35,725 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787295488_0001_1_00_000000_0] to container: [container_1452787295488_0001_00_000001]
2016-01-14 16:01:35,726 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:35,727 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787295488_0001_1_00_000000_0] started. Is using containerId: [container_1452787295488_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:35,727 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0, startTime=1452787295726, containerId=container_1452787295488_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787295488_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:35,727 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:35,727 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295488_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:35,727 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295488_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:35,728 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787295488_0001_00_000001 given task: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,728 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787295488_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35 Starting to run new task attempt: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,729 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,729 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,729 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:35,729 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:35,729 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:35,729 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:35,730 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:35,730 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header, VertexName: BC6EEA7A30804E9FAF321D16153ADA4E, VertexParallelism: 1, TaskAttemptID:attempt_1452787295488_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=768425A581BD4874995DAC2A4D27682A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B808F545BFD54C3EA75C51A0BE472269, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:35,730 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:35,731 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,734 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:35,735 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,735 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787295488_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:35,736 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=768425A581BD4874995DAC2A4D27682A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:35,737 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:35,737 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,738 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,736 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,736 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=B808F545BFD54C3EA75C51A0BE472269, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:35,739 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:35,740 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: B808F545BFD54C3EA75C51A0BE472269
2016-01-14 16:01:35,740 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:35,740 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: B808F545BFD54C3EA75C51A0BE472269
2016-01-14 16:01:35,742 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:35,748 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:35,748 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,748 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,752 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BC6EEA7A30804E9FAF321D16153ADA4E, ordinal: 0
2016-01-14 16:01:35,752 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BC6EEA7A30804E9FAF321D16153ADA4E, mem on start (mb), free: 299, total: 369, max: 672
2016-01-14 16:01:35,752 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,752 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:35,752 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:35,754 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:35,754 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: B808F545BFD54C3EA75C51A0BE472269
2016-01-14 16:01:35,754 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:35,754 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:35,755 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:35,755 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 768425A581BD4874995DAC2A4D27682A, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:35,756 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, B808F545BFD54C3EA75C51A0BE472269, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:35,756 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:35,756 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 768425A581BD4874995DAC2A4D27682A being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:35,756 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:35,756 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:35,757 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,757 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:35,757 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,757 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:35,757 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,758 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:35,760 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5c929b4a
2016-01-14 16:01:35,761 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:35,761 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,761 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"], id: B808F545BFD54C3EA75C51A0BE472269
2016-01-14 16:01:35,762 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-01-14 16:01:35,762 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:35,762 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:35,762 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5c929b4a
2016-01-14 16:01:35,763 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:35,763 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:35,763 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BC6EEA7A30804E9FAF321D16153ADA4E, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:35,766 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:35,766 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:35,767 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,767 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787295488_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:35,768 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,769 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BC6EEA7A30804E9FAF321D16153ADA4E, mem on close (mb), free: 297, total: 369, max: 672
2016-01-14 16:01:35 Completed running task attempt: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,770 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:35,771 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787295764, Process_Duration=4, Process_End_Time=1452787295768, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-01-14 16:01:35,772 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:35,771 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0, startTime=1452787295726, finishTime=1452787295771, timeTaken=45, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787295764, Process_Duration=4, Process_End_Time=1452787295768, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:35,772 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295488_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:35,772 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,773 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:35,773 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:TASK_FINISHED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, taskId=task_1452787295488_0001_1_00_000000, startTime=1452787295726, finishTime=1452787295773, timeTaken=47, status=SUCCEEDED, successfulAttemptID=attempt_1452787295488_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787295764, Process_Duration=4, Process_End_Time=1452787295768, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:35,773 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295488_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:35,774 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] : 1
2016-01-14 16:01:35,774 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,774 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 16:01:35,774 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,776 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:35,777 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787295488_0001_00_000001
2016-01-14 16:01:35,777 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:35,777 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:VERTEX_FINISHED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, vertexId=vertex_1452787295488_0001_1_00, initRequestedTime=1452787295694, initedTime=1452787295708, startRequestedTime=1452787295709, startedTime=1452787295709, finishTime=1452787295774, timeTaken=65, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787295764, Process_Duration=4, Process_End_Time=1452787295768, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1452787295726, firstTasksToStart=[ task_1452787295488_0001_1_00_000000 ], lastTaskFinishTime=1452787295771, lastTasksToFinish=[ task_1452787295488_0001_1_00_000000 ], minTaskDuration=45, maxTaskDuration=45, avgTaskDuration=45.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787295488_0001_1_00_000000 ], longestDurationTasks=[ task_1452787295488_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:35,778 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:35,778 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:35,778 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787295488_0001_00_000001, stoppedTime=1452787295778, exitStatus=0
2016-01-14 16:01:35,778 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:35,778 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:35,779 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787295488_0001_1
2016-01-14 16:01:35,779 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787295488_0001_1
2016-01-14 16:01:35,779 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: B808F545BFD54C3EA75C51A0BE472269 for vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,779 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:35,788 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787295488_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:35,788 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787295488_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:35,789 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787295488_0001_00_000001, Exiting
2016-01-14 16:01:35,789 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787295488_0001_00_000001
2016-01-14 16:01:35,789 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787295488_0001_00_000001
2016-01-14 16:01:35,791 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787295488_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:35,792 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787295488_0001_00_000001 completed successfully
2016-01-14 16:01:35,793 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787295488_0001_1, queueSize=0
2016-01-14 16:01:35,793 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:35,794 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787295488_0001_1, startTime=1452787295693, finishTime=1452787295789, timeTaken=96, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787295764, Process_Duration=4, Process_End_Time=1452787295768, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:35,795 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787295488_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:35,795 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295488_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:35,796 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787295488_0001_00_000001
2016-01-14 16:01:35,796 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:35 Completed Dag: dag_1452787295488_0001_1
2016-01-14 16:01:35,798 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787295488_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:35,798 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787295488_0001_1_post
2016-01-14 16:01:35,798 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,800 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:35,803 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452787295488_0001
2016-01-14 16:01:35,807 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:35,807 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:35,807 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:35,807 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:35,808 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:35,808 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:35,808 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:35,809 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:35,810 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:35,810 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:35,811 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:35,811 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:35,811 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:35,815 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001
2016-01-14 16:01:35,816 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.350
2016-01-14 16:01:35,853 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeader/header
2016-01-14 16:01:35,881 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:35,881 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:35,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 16:01:35,941 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 16:01:35,941 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:35,942 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:35,942 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:35,956 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt
2016-01-14 16:01:35,957 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic
2016-01-14 16:01:35,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:35,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 16:01:35,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-01-14 16:01:35,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] parallel execution of steps is enabled: false
2016-01-14 16:01:35,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executing total steps: 1
2016-01-14 16:01:35,967 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] allocating management threads: 1
2016-01-14 16:01:35,967 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...t/strict-nondeterministic
2016-01-14 16:01:35,968 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:35,979 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:35,984 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:35,985 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:35,985 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:35,994 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001 doesn't exist and is created
2016-01-14 16:01:35,995 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:01:35,995 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:01:36,013 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:36,013 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:36,013 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001
2016-01-14 16:01:36,017 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787295984_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:36,027 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:36,028 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:36,030 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:36,030 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:36,030 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001/localmode-log-dir
2016-01-14 16:01:36,030 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001/localmode-log-dir/history.txt.appattempt_1452787295984_0001_000000, maxErrors=10
2016-01-14 16:01:36,030 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:36,031 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787295984_0001_000000, appSubmitTime=1452787296016, launchTime=1452787296016
2016-01-14 16:01:36,036 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:36,036 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:36,037 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:55754
2016-01-14 16:01:36,039 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:36,039 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:36,040 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:36,043 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787295984_0001_000000, startTime=1452787296043
2016-01-14 16:01:36,043 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:36,043 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:36,113 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:36,113 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:36,114 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452787295984_0001, dagName=[24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 16:01:36,131 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 16:01:36,133 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787295984_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001/localmode-log-dir/dag_1452787295984_0001_1.dot
2016-01-14 16:01:36,133 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001/localmode-log-dir/dag_1452787295984_0001_1-tez-dag.pb.txt
2016-01-14 16:01:36,140 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787295984_0001_1
2016-01-14 16:01:36,141 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:36,141 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 16:01:36 Running Dag: dag_1452787295984_0001_1
2016-01-14 16:01:36,152 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:36,153 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787295984_0001_1, submitTime=1452787296131
2016-01-14 16:01:36,153 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D723D02604724632A33EC1CFB80A47C0
2016-01-14 16:01:36,154 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:36,154 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:36,154 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787295984_0001_1, initTime=1452787296153
2016-01-14 16:01:36,155 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295984_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:36,156 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:DAG_STARTED]: dagID=dag_1452787295984_0001_1, startTime=1452787296155
2016-01-14 16:01:36,156 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:36,156 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295984_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:36,156 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:36,156 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D723D02604724632A33EC1CFB80A47C0 : {1D80025A53DA49D3BE248FB829C50EE2={InputName=1D80025A53DA49D3BE248FB829C50EE2}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:36,156 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452787295984_0001, dagName=[24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 16:01:36,156 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 1D80025A53DA49D3BE248FB829C50EE2, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:36,157 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,157 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,157 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,157 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]. Starting root input initializers: 1
2016-01-14 16:01:36,158 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:36,158 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 1D80025A53DA49D3BE248FB829C50EE2 on vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,160 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:36,161 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 1D80025A53DA49D3BE248FB829C50EE2 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:36,161 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:36,162 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:36,164 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 432
2016-01-14 16:01:36,165 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 1D80025A53DA49D3BE248FB829C50EE2 on vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,165 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:36,165 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {1D80025A53DA49D3BE248FB829C50EE2=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:36,165 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] parallelism set to 1
2016-01-14 16:01:36,165 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:36,166 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787295984_0001_1_00, eventCount=1
2016-01-14 16:01:36,166 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,166 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=A7CBD319387F4BE08DBF72F111710C37, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:36,167 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=A7CBD319387F4BE08DBF72F111710C37, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,168 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=A7CBD319387F4BE08DBF72F111710C37, vertexName=D723D02604724632A33EC1CFB80A47C0, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:36,169 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=A7CBD319387F4BE08DBF72F111710C37, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,170 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D723D02604724632A33EC1CFB80A47C0, vertexId=vertex_1452787295984_0001_1_00, initRequestedTime=1452787296156, initedTime=1452787296170, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:36,171 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] with distanceFromRoot: 0
2016-01-14 16:01:36,171 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:36,170 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:36,171 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D723D02604724632A33EC1CFB80A47C0
2016-01-14 16:01:36,172 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,172 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787295984_0001_1_00, startRequestedTime=1452787296171, startedTime=1452787296171
2016-01-14 16:01:36,172 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:36,172 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:36,173 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:36,173 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:TASK_STARTED]: vertexName=D723D02604724632A33EC1CFB80A47C0, taskId=task_1452787295984_0001_1_00_000000, scheduledTime=1452787296173, launchTime=1452787296173
2016-01-14 16:01:36,173 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295984_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:36,174 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,174 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic, VertexName: D723D02604724632A33EC1CFB80A47C0, VertexParallelism: 1, TaskAttemptID:attempt_1452787295984_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1D80025A53DA49D3BE248FB829C50EE2, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A7CBD319387F4BE08DBF72F111710C37, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:36,174 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295984_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:36,175 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:36,175 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787295984_0001, with dag id: dag_1452787295984_0001_1
2016-01-14 16:01:36,175 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:36,177 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:36,177 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:36,177 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787295984_0001_00_000001
2016-01-14 16:01:36,178 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295984_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:36,181 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452787295984_0001_00_000001
2016-01-14 16:01:36,181 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:36,183 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:36,183 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787295984_0001_00_000001, launchTime=1452787296182
2016-01-14 16:01:36,183 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787295984_0001_00_000001
2016-01-14 16:01:36,184 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295984_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:36,186 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787295984_0001_1_00_000000_0] to container: [container_1452787295984_0001_00_000001]
2016-01-14 16:01:36,186 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295984_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:36,187 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787295984_0001_1_00_000000_0] started. Is using containerId: [container_1452787295984_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:36,187 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D723D02604724632A33EC1CFB80A47C0, taskAttemptId=attempt_1452787295984_0001_1_00_000000_0, startTime=1452787296187, containerId=container_1452787295984_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787295984_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:36,188 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:36,188 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295984_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:36,188 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295984_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:36,189 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787295984_0001_00_000001 given task: attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,189 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787295984_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36 Starting to run new task attempt: attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,190 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,190 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:36,190 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:36,190 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:36,190 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:36,190 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:36,190 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:36,191 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic, VertexName: D723D02604724632A33EC1CFB80A47C0, VertexParallelism: 1, TaskAttemptID:attempt_1452787295984_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1D80025A53DA49D3BE248FB829C50EE2, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A7CBD319387F4BE08DBF72F111710C37, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:36,191 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:36,192 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,192 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:36,193 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:36,193 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787295984_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:36,194 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=1D80025A53DA49D3BE248FB829C50EE2, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:36,194 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=A7CBD319387F4BE08DBF72F111710C37, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:36,195 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:36,194 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:36,195 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:36,196 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: A7CBD319387F4BE08DBF72F111710C37
2016-01-14 16:01:36,196 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:36,196 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: A7CBD319387F4BE08DBF72F111710C37
2016-01-14 16:01:36,198 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,198 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,199 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:36,205 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:36,205 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,205 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,209 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D723D02604724632A33EC1CFB80A47C0, ordinal: 0
2016-01-14 16:01:36,209 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D723D02604724632A33EC1CFB80A47C0, mem on start (mb), free: 231, total: 369, max: 672
2016-01-14 16:01:36,209 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:36,210 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:36,210 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:36,215 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:36,215 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: A7CBD319387F4BE08DBF72F111710C37
2016-01-14 16:01:36,216 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:36,216 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:36,216 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:36,216 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:36,216 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:36,216 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:36,217 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:36,217 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:36,217 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, A7CBD319387F4BE08DBF72F111710C37, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:36,217 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 1D80025A53DA49D3BE248FB829C50EE2, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:36,218 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:36,218 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 1D80025A53DA49D3BE248FB829C50EE2 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:36,218 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,218 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:36,218 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,218 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:36,219 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:36,219 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:36,219 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,220 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:36,220 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@363fb96b
2016-01-14 16:01:36,221 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@363fb96b
2016-01-14 16:01:36,222 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:36,222 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:36,222 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 16:01:36,223 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"] streamed: true, id: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,223 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"], id: A7CBD319387F4BE08DBF72F111710C37
2016-01-14 16:01:36,223 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-01-14 16:01:36,224 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 16:01:36,224 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:36,224 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D723D02604724632A33EC1CFB80A47C0, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:36,228 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
2016-01-14 16:01:36,230 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
2016-01-14 16:01:36,231 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:36,231 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:36,232 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,232 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787295984_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:36,233 INFO task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787295984_0001_1_00_000000_0
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
2016-01-14 16:01:36,240 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=135, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6][cascading.flow.SliceCounters Process_Begin_Time=1452787296224, Process_Duration=9, Process_End_Time=1452787296233, Read_Duration=0, Tuples_Read=6, Tuples_Written=6, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=6, Tuples_Written=6]]
2016-01-14 16:01:36,240 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D723D02604724632A33EC1CFB80A47C0, mem on close (mb), free: 229, total: 369, max: 672
2016-01-14 16:01:36,241 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=D723D02604724632A33EC1CFB80A47C0, index=0
2016-01-14 16:01:36,241 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:36,242 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D723D02604724632A33EC1CFB80A47C0, taskAttemptId=attempt_1452787295984_0001_1_00_000000_0, startTime=1452787296187, finishTime=1452787296239, timeTaken=52, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=135, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6, cascading.flow.SliceCounters, Process_Begin_Time=1452787296224, Process_Duration=9, Process_End_Time=1452787296233, Read_Duration=0, Tuples_Read=6, Tuples_Written=6, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=6, Tuples_Written=6
2016-01-14 16:01:36,242 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295984_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:01:36,243 INFO impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787295984_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:01:36,243 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:TASK_FINISHED]: vertexName=D723D02604724632A33EC1CFB80A47C0, taskId=task_1452787295984_0001_1_00_000000, startTime=1452787296187, finishTime=1452787296243, timeTaken=56, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
], counters=Counters: 0
2016-01-14 16:01:36,243 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=D723D02604724632A33EC1CFB80A47C0, sourceVertex=1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,243 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295984_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:01:36,243 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:36,244 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] : 1
2016-01-14 16:01:36,244 INFO impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] because task failed: task_1452787295984_0001_1_00_000000
2016-01-14 16:01:36,243 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=D723D02604724632A33EC1CFB80A47C0, sourceVertex=A7CBD319387F4BE08DBF72F111710C37
2016-01-14 16:01:36,243 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:36,246 INFO impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:01:36,246 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:01:36,246 INFO impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,247 INFO impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=A7CBD319387F4BE08DBF72F111710C37, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,247 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787295984_0001_00_000001
2016-01-14 16:01:36,250 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787295984_0001_00_000001
2016-01-14 16:01:36,255 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787295984_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:01:36,255 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787295984_0001_00_000001 completed but with errors
2016-01-14 16:01:36,257 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:36,257 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:VERTEX_FINISHED]: vertexName=D723D02604724632A33EC1CFB80A47C0, vertexId=vertex_1452787295984_0001_1_00, initRequestedTime=1452787296156, initedTime=1452787296170, startRequestedTime=1452787296171, startedTime=1452787296171, finishTime=1452787296256, timeTaken=85, status=FAILED, diagnostics=Task failed, taskId=task_1452787295984_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787296187, firstTasksToStart=[ task_1452787295984_0001_1_00_000000 ], lastTaskFinishTime=1452787296239, lastTasksToFinish=[ task_1452787295984_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[ ], longestDurationTasks=[ ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:01:36,258 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:01:36,261 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787295984_0001_00_000001, stoppedTime=1452787296261, exitStatus=0
2016-01-14 16:01:36,261 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:36,261 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295984_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:36,262 INFO node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787295984_0001_1_00_000000_0 failed: true container: container_1452787295984_0001_00_000001 numFailedTAs: 0
2016-01-14 16:01:36,264 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:01:36,264 INFO impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:01:36,264 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787295984_0001_1
2016-01-14 16:01:36,265 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: A7CBD319387F4BE08DBF72F111710C37 for vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,267 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787295984_0001_1, queueSize=0
2016-01-14 16:01:36,267 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:36,267 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787295984_0001_1, startTime=1452787296155, finishTime=1452787296266, timeTaken=111, status=FAILED, diagnostics=Vertex failed, vertexName=D723D02604724632A33EC1CFB80A47C0, vertexId=vertex_1452787295984_0001_1_00, diagnostics=[Task failed, taskId=task_1452787295984_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
... 16 more
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:01:36,273 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787295984_0001_1 finished with state: FAILED
2016-01-14 16:01:36,273 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295984_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:36,274 INFO container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452787295984_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:01:36,274 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295984_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:36,275 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787295984_0001_00_000001
2016-01-14 16:01:36 Completed Dag: dag_1452787295984_0001_1
2016-01-14 16:01:36,276 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787295984_0001_1, dagState=FAILED
2016-01-14 16:01:36,276 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787295984_0001_1_post
2016-01-14 16:01:36,276 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:36,277 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:36,277 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295984_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:01:36,279 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452787295984_0001
2016-01-14 16:01:36,281 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:36,282 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:36,282 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:36,282 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:36,282 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:36,283 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:36,283 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:36,283 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:36,283 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:36,283 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:36,284 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:36,284 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:36,284 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:36,290 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001
2016-01-14 16:01:36,291 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopping all jobs
2016-01-14 16:01:36,291 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopping: (1/1) ...t/strict-nondeterministic
2016-01-14 16:01:36,292 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopped all jobs
2016-01-14 16:01:36,293 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] completed in: 00:00.327
2016-01-14 16:01:36,293 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic