Class cascading.scheme.TextDelimitedPlatformTest

9

tests

0

failures

0

ignored

8.703s

duration

100%

successful

Tests

Test Duration Result
testFieldCoercion 0.754s passed
testHeader 0.493s passed
testHeaderAll 0.581s passed
testHeaderFieldsAll 0.743s passed
testQuotedText 0.647s passed
testQuotedTextAll 0.786s passed
testQuotedTextSpecChar 3.588s passed
testQuotedTextSpecCharAll 0.672s passed
testStrict 0.439s passed

Standard output

2016-01-14 16:01:27,537 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 16:01:27,560 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.scheme.TextDelimitedPlatformTest, with platform: hadoop2-tez
2016-01-14 16:01:27,587 INFO  tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-01-14 16:01:27,920 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 16:01:28,247 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-14 16:01:28,450 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:28,452 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:28,570 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 2C999E6AD284418A84E3E0EFE14396D4
2016-01-14 16:01:28,741 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.069
2016-01-14 16:01:28,752 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.080
2016-01-14 16:01:28,753 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:28,753 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:28,754 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:28,899 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-01-14 16:01:28,902 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-01-14 16:01:29,100 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 16:01:29,102 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:29,103 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:29,103 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-01-14 16:01:29,104 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 16:01:29,104 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 16:01:29,105 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 16:01:29,106 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...Char/quoted/speccharfalse
2016-01-14 16:01:29,106 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:29,130 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:29,307 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:29,313 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:29,313 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:29,357 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001 doesn't exist and is created
2016-01-14 16:01:29,422 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:29,423 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:29,423 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001
2016-01-14 16:01:29,452 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787289312_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:29,500 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:29,516 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:29,523 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-01-14 16:01:29,523 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-01-14 16:01:29,523 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:29,542 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:29,547 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:29,551 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001/localmode-log-dir
2016-01-14 16:01:29,551 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001/localmode-log-dir/history.txt.appattempt_1452787289312_0001_000000, maxErrors=10
2016-01-14 16:01:29,551 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:29,554 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787289312_0001_000000, appSubmitTime=1452787289438, launchTime=1452787289451
2016-01-14 16:01:29,559 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:29,559 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:29,562 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:29,562 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:29,621 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:35813
2016-01-14 16:01:29,624 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 16:01:29,624 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 16:01:29,624 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:29,664 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:29,724 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 16:01:29,724 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 16:01:29,725 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:29,733 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:29,733 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787289312_0001_000000, startTime=1452787289732
2016-01-14 16:01:29,734 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:29,825 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:29,842 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:29,842 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452787289312_0001, dagName=[1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 16:01:30,055 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 16:01:30,162 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787289312_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001/localmode-log-dir/dag_1452787289312_0001_1.dot
2016-01-14 16:01:30,166 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001/localmode-log-dir/dag_1452787289312_0001_1-tez-dag.pb.txt
2016-01-14 16:01:30,261 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787289312_0001_1
2016-01-14 16:01:30,261 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:30,262 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 16:01:30 Running Dag: dag_1452787289312_0001_1
2016-01-14 16:01:30,298 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:30,298 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787289312_0001_1, submitTime=1452787290055
2016-01-14 16:01:30,331 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C5B1EAB75B2B49B9851C6399884EB336
2016-01-14 16:01:30,333 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:30,337 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:30,337 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787289312_0001_1, initTime=1452787290299
2016-01-14 16:01:30,337 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787289312_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:30,339 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:30,339 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:DAG_STARTED]: dagID=dag_1452787289312_0001_1, startTime=1452787290338
2016-01-14 16:01:30,340 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:30,342 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787289312_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:30,342 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C5B1EAB75B2B49B9851C6399884EB336 : {2F95DBEAC2D5438C941DE29F4FAC5817={InputName=2F95DBEAC2D5438C941DE29F4FAC5817}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:30,342 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 2F95DBEAC2D5438C941DE29F4FAC5817, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:30,343 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,353 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,353 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,356 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]. Starting root input initializers: 1
2016-01-14 16:01:30,357 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452787289312_0001, dagName=[1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 16:01:30,373 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 2F95DBEAC2D5438C941DE29F4FAC5817 on vertex vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,384 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:30,400 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:30,402 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787289312_0001, with dag id: dag_1452787289312_0001_1
2016-01-14 16:01:30,404 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 2F95DBEAC2D5438C941DE29F4FAC5817 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:30,405 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:30,406 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:30,469 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-01-14 16:01:30,471 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 2F95DBEAC2D5438C941DE29F4FAC5817 on vertex vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,472 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:30,472 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {2F95DBEAC2D5438C941DE29F4FAC5817=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:30,488 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] parallelism set to 1
2016-01-14 16:01:30,489 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:30,498 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787289312_0001_1_00, eventCount=1
2016-01-14 16:01:30,500 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,500 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=48A9E83A3C11483A9EEA048208DD7069, vertexId=vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:30,504 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=48A9E83A3C11483A9EEA048208DD7069, vertexId=vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,525 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=48A9E83A3C11483A9EEA048208DD7069, vertexName=C5B1EAB75B2B49B9851C6399884EB336, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:30,534 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=48A9E83A3C11483A9EEA048208DD7069, vertexId=vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,537 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:30,537 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, vertexId=vertex_1452787289312_0001_1_00, initRequestedTime=1452787290342, initedTime=1452787290536, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:30,538 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] with distanceFromRoot: 0
2016-01-14 16:01:30,538 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:30,540 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C5B1EAB75B2B49B9851C6399884EB336
2016-01-14 16:01:30,541 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,542 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:30,542 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787289312_0001_1_00, startRequestedTime=1452787290539, startedTime=1452787290539
2016-01-14 16:01:30,543 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:30,568 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:30,568 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:TASK_STARTED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, taskId=task_1452787289312_0001_1_00_000000, scheduledTime=1452787290567, launchTime=1452787290567
2016-01-14 16:01:30,569 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787289312_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:30,571 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,574 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: C5B1EAB75B2B49B9851C6399884EB336, VertexParallelism: 1, TaskAttemptID:attempt_1452787289312_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2F95DBEAC2D5438C941DE29F4FAC5817, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=48A9E83A3C11483A9EEA048208DD7069, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:30,577 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787289312_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:30,577 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:30,626 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:30,630 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:30,630 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:30,634 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787289312_0001_00_000001
2016-01-14 16:01:30,634 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:30,653 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787289312_0001_00_000001
2016-01-14 16:01:30,653 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:30,659 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:30,659 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:30,659 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787289312_0001_00_000001, launchTime=1452787290659
2016-01-14 16:01:30,663 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787289312_0001_00_000001
2016-01-14 16:01:30,666 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787289312_0001_1_00_000000_0] to container: [container_1452787289312_0001_00_000001]
2016-01-14 16:01:30,666 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:30,667 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787289312_0001_00_000001 given task: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,668 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787289312_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30 Starting to run new task attempt: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,669 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,670 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:30,670 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787289312_0001_1_00_000000_0] started. Is using containerId: [container_1452787289312_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:30,672 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:30,672 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0, startTime=1452787290668, containerId=container_1452787289312_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787289312_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:30,673 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787289312_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:30,673 INFO  counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters:  GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-01-14 16:01:30,674 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:30,674 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:30,676 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:30,677 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787289312_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:30,678 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:30,701 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:30,701 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: C5B1EAB75B2B49B9851C6399884EB336, VertexParallelism: 1, TaskAttemptID:attempt_1452787289312_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2F95DBEAC2D5438C941DE29F4FAC5817, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=48A9E83A3C11483A9EEA048208DD7069, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:30,704 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:30,708 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,710 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:30,710 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:30,714 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787289312_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:30,717 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=2F95DBEAC2D5438C941DE29F4FAC5817, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:30,719 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:30,719 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=48A9E83A3C11483A9EEA048208DD7069, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:30,720 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:30,721 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:30,721 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,721 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 48A9E83A3C11483A9EEA048208DD7069
2016-01-14 16:01:30,722 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:30,726 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,726 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 48A9E83A3C11483A9EEA048208DD7069
2016-01-14 16:01:30,741 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:30,755 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:30,756 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,756 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,758 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C5B1EAB75B2B49B9851C6399884EB336, ordinal: 0
2016-01-14 16:01:30,759 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C5B1EAB75B2B49B9851C6399884EB336, mem on start (mb), free: 162, total: 281, max: 672
2016-01-14 16:01:30,759 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:30,759 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:30,760 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:30,767 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:30,767 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 48A9E83A3C11483A9EEA048208DD7069
2016-01-14 16:01:30,768 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:30,769 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:30,777 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:30,778 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:30,778 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:30,779 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:30,779 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:30,780 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:30,780 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 2F95DBEAC2D5438C941DE29F4FAC5817, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:30,780 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 48A9E83A3C11483A9EEA048208DD7069, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:30,781 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:30,783 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 2F95DBEAC2D5438C941DE29F4FAC5817 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:30,783 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,783 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:30,783 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,784 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:30,785 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:30,785 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:30,786 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,788 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:30,796 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1951d32e
2016-01-14 16:01:30,810 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1951d32e
2016-01-14 16:01:30,810 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:30,811 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:30,828 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:30,831 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: 2F95DBEAC2D5438C941DE29F4FAC5817
2016-01-14 16:01:30,832 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"], id: 48A9E83A3C11483A9EEA048208DD7069
2016-01-14 16:01:30,832 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-01-14 16:01:30,836 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:30,836 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:30,839 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C5B1EAB75B2B49B9851C6399884EB336, all 1 inputs ready in: 00:00:00.002
2016-01-14 16:01:30,854 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:30,854 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:30,855 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,856 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787289312_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:30,857 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,858 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C5B1EAB75B2B49B9851C6399884EB336, mem on close (mb), free: 155, total: 281, max: 672
2016-01-14 16:01:30 Completed running task attempt: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,864 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:30,868 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787290839, Process_Duration=18, Process_End_Time=1452787290857, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 16:01:30,869 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:30,870 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:01:30,870 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:30,904 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787289312_0001_00_000001
2016-01-14 16:01:30,905 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, taskAttemptId=attempt_1452787289312_0001_1_00_000000_0, startTime=1452787290668, finishTime=1452787290865, timeTaken=197, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787290839, Process_Duration=18, Process_End_Time=1452787290857, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:30,910 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787289312_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:30,910 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:30,912 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30,916 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:30,920 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:TASK_FINISHED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, taskId=task_1452787289312_0001_1_00_000000, startTime=1452787290668, finishTime=1452787290913, timeTaken=245, status=SUCCEEDED, successfulAttemptID=attempt_1452787289312_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787290839, Process_Duration=18, Process_End_Time=1452787290857, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:30,923 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787289312_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:30,927 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:30,928 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] : 1
2016-01-14 16:01:30,929 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,938 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:30,941 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:VERTEX_FINISHED]: vertexName=C5B1EAB75B2B49B9851C6399884EB336, vertexId=vertex_1452787289312_0001_1_00, initRequestedTime=1452787290342, initedTime=1452787290536, startRequestedTime=1452787290539, startedTime=1452787290539, finishTime=1452787290930, timeTaken=391, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787290839, Process_Duration=18, Process_End_Time=1452787290857, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452787290668, firstTasksToStart=[ task_1452787289312_0001_1_00_000000 ], lastTaskFinishTime=1452787290865, lastTasksToFinish=[ task_1452787289312_0001_1_00_000000 ], minTaskDuration=197, maxTaskDuration=197, avgTaskDuration=197.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787289312_0001_1_00_000000 ], longestDurationTasks=[ task_1452787289312_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:30,942 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:30,943 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787289312_0001_00_000001, stoppedTime=1452787290943, exitStatus=0
2016-01-14 16:01:30,943 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:30,944 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:30,944 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:30,947 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787289312_0001_1
2016-01-14 16:01:30,948 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787289312_0001_1
2016-01-14 16:01:30,948 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 48A9E83A3C11483A9EEA048208DD7069 for vertex: vertex_1452787289312_0001_1_00 [C5B1EAB75B2B49B9851C6399884EB336]
2016-01-14 16:01:30,967 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787289312_0001_1, queueSize=0
2016-01-14 16:01:30,968 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:30,969 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787289312_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787289312_0001_1, startTime=1452787290338, finishTime=1452787290962, timeTaken=624, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787290839, Process_Duration=18, Process_End_Time=1452787290857, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:30,971 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787289312_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:30,971 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787289312_0001_00_000001: 62 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:30,971 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787289312_0001_00_000001, Exiting
2016-01-14 16:01:30,973 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787289312_0001_00_000001
2016-01-14 16:01:30,973 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787289312_0001_00_000001
2016-01-14 16:01:30,973 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787289312_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:30,973 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787289312_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:30,977 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787289312_0001_00_000001
2016-01-14 16:01:30 Completed Dag: dag_1452787289312_0001_1
2016-01-14 16:01:30,976 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787289312_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:30,978 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787289312_0001_00_000001 completed successfully
2016-01-14 16:01:30,978 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787289312_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:30,979 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787289312_0001_1_post
2016-01-14 16:01:30,980 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:30,980 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:30,981 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:01:30,981 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787289312_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:01:30,989 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452787289312_0001
2016-01-14 16:01:30,993 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:30,993 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:30,993 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:30,993 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:30,994 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:30,995 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:30,997 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:30,997 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:30,998 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:30,998 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:30,998 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:30,999 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:30,999 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:31,004 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DA821CC87B9446B91E3897FBD4F75F5/A668A2A50733420FB5899950AD644D30/.tez/application_1452787289312_0001
2016-01-14 16:01:31,005 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:01.902
2016-01-14 16:01:31,172 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-01-14 16:01:31,215 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:31,216 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:31,277 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 16:01:31,293 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.039
2016-01-14 16:01:31,294 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:31,294 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:31,294 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:31,315 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 16:01:31,316 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-01-14 16:01:31,341 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:31,341 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:31,342 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-01-14 16:01:31,343 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 16:01:31,343 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 16:01:31,343 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 16:01:31,343 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...xtAll/quoted/normchartrue
2016-01-14 16:01:31,344 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:31,360 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:31,366 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:31,366 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:31,366 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:31,377 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001 doesn't exist and is created
2016-01-14 16:01:31,402 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:31,403 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:31,404 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001
2016-01-14 16:01:31,409 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787291366_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:31,424 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:31,425 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:31,428 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:31,428 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:31,428 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001/localmode-log-dir
2016-01-14 16:01:31,429 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001/localmode-log-dir/history.txt.appattempt_1452787291366_0001_000000, maxErrors=10
2016-01-14 16:01:31,429 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:31,429 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787291366_0001_000000, appSubmitTime=1452787291408, launchTime=1452787291408
2016-01-14 16:01:31,435 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:31,438 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:31,440 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:31,440 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:31,443 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:37524
2016-01-14 16:01:31,445 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:31,447 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:31,447 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787291366_0001_000000, startTime=1452787291447
2016-01-14 16:01:31,447 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:31,504 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:31,504 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:31,504 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452787291366_0001, dagName=[6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 16:01:31,538 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 16:01:31,542 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787291366_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001/localmode-log-dir/dag_1452787291366_0001_1.dot
2016-01-14 16:01:31,543 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001/localmode-log-dir/dag_1452787291366_0001_1-tez-dag.pb.txt
2016-01-14 16:01:31,568 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787291366_0001_1
2016-01-14 16:01:31,568 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:31,568 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 16:01:31 Running Dag: dag_1452787291366_0001_1
2016-01-14 16:01:31,588 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:31,589 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787291366_0001_1, submitTime=1452787291539
2016-01-14 16:01:31,590 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex FBCA3F00C9B84AFF90E6F6DA50110E58
2016-01-14 16:01:31,590 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:31,591 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:31,591 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787291366_0001_1, initTime=1452787291589
2016-01-14 16:01:31,592 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787291366_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:31,593 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:DAG_STARTED]: dagID=dag_1452787291366_0001_1, startTime=1452787291592
2016-01-14 16:01:31,593 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:31,593 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:31,593 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787291366_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:31,593 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452787291366_0001, dagName=[6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 16:01:31,593 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: FBCA3F00C9B84AFF90E6F6DA50110E58 : {68E1CBBC43FE46CEB7BFF1767DEDD67D={InputName=68E1CBBC43FE46CEB7BFF1767DEDD67D}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:31,594 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 68E1CBBC43FE46CEB7BFF1767DEDD67D, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:31,594 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,594 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,594 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,595 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]. Starting root input initializers: 1
2016-01-14 16:01:31,597 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:31,598 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 68E1CBBC43FE46CEB7BFF1767DEDD67D on vertex vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,603 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:31,604 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 68E1CBBC43FE46CEB7BFF1767DEDD67D asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:31,605 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:31,606 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:31,609 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 16:01:31,610 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 68E1CBBC43FE46CEB7BFF1767DEDD67D on vertex vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,610 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:31,610 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {68E1CBBC43FE46CEB7BFF1767DEDD67D=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:31,612 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] parallelism set to 1
2016-01-14 16:01:31,612 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:31,612 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787291366_0001_1_00, eventCount=1
2016-01-14 16:01:31,613 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,613 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6D26A1497A434785B91A8FE2645CD1CE, vertexId=vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:31,613 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6D26A1497A434785B91A8FE2645CD1CE, vertexId=vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,622 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6D26A1497A434785B91A8FE2645CD1CE, vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:31,622 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6D26A1497A434785B91A8FE2645CD1CE, vertexId=vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,622 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787291366_0001, with dag id: dag_1452787291366_0001_1
2016-01-14 16:01:31,630 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:31,630 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, vertexId=vertex_1452787291366_0001_1_00, initRequestedTime=1452787291593, initedTime=1452787291629, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:31,630 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] with distanceFromRoot: 0
2016-01-14 16:01:31,630 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:31,632 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in FBCA3F00C9B84AFF90E6F6DA50110E58
2016-01-14 16:01:31,634 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,634 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:31,634 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787291366_0001_1_00, startRequestedTime=1452787291632, startedTime=1452787291632
2016-01-14 16:01:31,635 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:31,636 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:31,636 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:TASK_STARTED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, taskId=task_1452787291366_0001_1_00_000000, scheduledTime=1452787291636, launchTime=1452787291636
2016-01-14 16:01:31,636 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787291366_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:31,637 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,637 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: FBCA3F00C9B84AFF90E6F6DA50110E58, VertexParallelism: 1, TaskAttemptID:attempt_1452787291366_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=68E1CBBC43FE46CEB7BFF1767DEDD67D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6D26A1497A434785B91A8FE2645CD1CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:31,638 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787291366_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:31,638 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:31,639 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:31,641 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:31,641 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:31,642 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787291366_0001_00_000001
2016-01-14 16:01:31,643 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:31,648 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787291366_0001_00_000001
2016-01-14 16:01:31,648 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:31,650 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:31,650 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:31,651 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787291366_0001_00_000001, launchTime=1452787291650
2016-01-14 16:01:31,651 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787291366_0001_00_000001
2016-01-14 16:01:31,652 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787291366_0001_1_00_000000_0] to container: [container_1452787291366_0001_00_000001]
2016-01-14 16:01:31,653 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:31,653 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787291366_0001_00_000001 given task: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,654 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787291366_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,654 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787291366_0001_1_00_000000_0] started. Is using containerId: [container_1452787291366_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:31 Starting to run new task attempt: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,655 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0, startTime=1452787291654, containerId=container_1452787291366_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787291366_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:31,656 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:31,656 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,657 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:31,656 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787291366_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:31,658 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:31,658 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787291366_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:31,659 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:31,659 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:31,660 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:31,660 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:31,661 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: FBCA3F00C9B84AFF90E6F6DA50110E58, VertexParallelism: 1, TaskAttemptID:attempt_1452787291366_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=68E1CBBC43FE46CEB7BFF1767DEDD67D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6D26A1497A434785B91A8FE2645CD1CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:31,661 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:31,663 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,666 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:31,667 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:31,668 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787291366_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:31,669 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=68E1CBBC43FE46CEB7BFF1767DEDD67D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:31,670 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:31,670 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,671 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,672 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:31,677 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:31,678 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,678 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,679 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:31,682 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6D26A1497A434785B91A8FE2645CD1CE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:31,685 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:31,686 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6D26A1497A434785B91A8FE2645CD1CE
2016-01-14 16:01:31,686 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:31,687 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6D26A1497A434785B91A8FE2645CD1CE
2016-01-14 16:01:31,694 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FBCA3F00C9B84AFF90E6F6DA50110E58, ordinal: 0
2016-01-14 16:01:31,694 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FBCA3F00C9B84AFF90E6F6DA50110E58, mem on start (mb), free: 170, total: 281, max: 672
2016-01-14 16:01:31,695 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:31,695 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:31,695 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:31,701 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:31,701 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6D26A1497A434785B91A8FE2645CD1CE
2016-01-14 16:01:31,702 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:31,702 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:31,702 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:31,703 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:31,703 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:31,703 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:31,703 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:31,704 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:31,704 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 68E1CBBC43FE46CEB7BFF1767DEDD67D, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:31,704 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6D26A1497A434785B91A8FE2645CD1CE, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:31,704 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:31,704 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 68E1CBBC43FE46CEB7BFF1767DEDD67D being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:31,704 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,704 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:31,705 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,704 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:31,707 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:31,707 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:31,708 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,708 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:31,714 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2a19e907
2016-01-14 16:01:31,718 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2a19e907
2016-01-14 16:01:31,718 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:31,719 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:31,720 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:31,720 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 68E1CBBC43FE46CEB7BFF1767DEDD67D
2016-01-14 16:01:31,721 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"], id: 6D26A1497A434785B91A8FE2645CD1CE
2016-01-14 16:01:31,721 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-01-14 16:01:31,722 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:31,723 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:31,723 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FBCA3F00C9B84AFF90E6F6DA50110E58, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:31,727 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:31,728 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:31,728 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,729 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787291366_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:31,730 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,730 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FBCA3F00C9B84AFF90E6F6DA50110E58, mem on close (mb), free: 167, total: 281, max: 672
2016-01-14 16:01:31 Completed running task attempt: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,731 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:31,732 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:31,734 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787291723, Process_Duration=7, Process_End_Time=1452787291730, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 16:01:31,734 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, taskAttemptId=attempt_1452787291366_0001_1_00_000000_0, startTime=1452787291654, finishTime=1452787291732, timeTaken=78, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787291723, Process_Duration=7, Process_End_Time=1452787291730, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:31,734 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787291366_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:31,735 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:31,735 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31,737 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:01:31,737 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:31,738 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787291366_0001_00_000001
2016-01-14 16:01:31,738 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:TASK_FINISHED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, taskId=task_1452787291366_0001_1_00_000000, startTime=1452787291654, finishTime=1452787291737, timeTaken=83, status=SUCCEEDED, successfulAttemptID=attempt_1452787291366_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787291723, Process_Duration=7, Process_End_Time=1452787291730, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:31,739 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787291366_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:31,739 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:31,740 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] : 1
2016-01-14 16:01:31,740 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,743 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:31,746 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:VERTEX_FINISHED]: vertexName=FBCA3F00C9B84AFF90E6F6DA50110E58, vertexId=vertex_1452787291366_0001_1_00, initRequestedTime=1452787291593, initedTime=1452787291629, startRequestedTime=1452787291632, startedTime=1452787291632, finishTime=1452787291741, timeTaken=109, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787291723, Process_Duration=7, Process_End_Time=1452787291730, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452787291654, firstTasksToStart=[ task_1452787291366_0001_1_00_000000 ], lastTaskFinishTime=1452787291732, lastTasksToFinish=[ task_1452787291366_0001_1_00_000000 ], minTaskDuration=78, maxTaskDuration=78, avgTaskDuration=78.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787291366_0001_1_00_000000 ], longestDurationTasks=[ task_1452787291366_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:31,746 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:31,746 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:31,747 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:31,747 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787291366_0001_00_000001, stoppedTime=1452787291747, exitStatus=0
2016-01-14 16:01:31,748 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:31,748 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:31,748 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787291366_0001_1
2016-01-14 16:01:31,749 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787291366_0001_1
2016-01-14 16:01:31,749 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 6D26A1497A434785B91A8FE2645CD1CE for vertex: vertex_1452787291366_0001_1_00 [FBCA3F00C9B84AFF90E6F6DA50110E58]
2016-01-14 16:01:31,751 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787291366_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:31,751 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787291366_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:31,751 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787291366_0001_00_000001, Exiting
2016-01-14 16:01:31,752 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787291366_0001_00_000001
2016-01-14 16:01:31,752 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787291366_0001_00_000001
2016-01-14 16:01:31,754 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787291366_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:31,754 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787291366_0001_00_000001 completed successfully
2016-01-14 16:01:31,762 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787291366_0001_1, queueSize=0
2016-01-14 16:01:31,762 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:31,764 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787291366_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787291366_0001_1, startTime=1452787291592, finishTime=1452787291761, timeTaken=169, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787291723, Process_Duration=7, Process_End_Time=1452787291730, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:31,765 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787291366_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:31,765 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787291366_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:31,765 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787291366_0001_00_000001
2016-01-14 16:01:31,765 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787291366_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:31 Completed Dag: dag_1452787291366_0001_1
2016-01-14 16:01:31,767 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787291366_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:31,767 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787291366_0001_1_post
2016-01-14 16:01:31,767 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:31,767 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:31,773 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452787291366_0001
2016-01-14 16:01:31,776 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:31,776 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:31,776 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:31,776 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:31,776 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:31,778 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:31,778 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:31,779 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:31,779 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:31,779 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:31,780 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:31,780 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:31,780 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:31,786 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/6227ECB1EE804EDD8A9454306321C783/AA00EDE28589448CABCFFF72A6476530/.tez/application_1452787291366_0001
2016-01-14 16:01:31,788 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.446
2016-01-14 16:01:31,960 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-01-14 16:01:32,002 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:32,002 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:32,054 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:01:32,063 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 16:01:32,065 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:32,065 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:32,066 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:32,084 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-01-14 16:01:32,085 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-01-14 16:01:32,107 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:32,107 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:32,107 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-01-14 16:01:32,108 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 16:01:32,108 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 16:01:32,108 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 16:01:32,109 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...arAll/quoted/specchartrue
2016-01-14 16:01:32,109 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:32,126 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:32,131 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:32,131 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:32,131 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:32,142 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001 doesn't exist and is created
2016-01-14 16:01:32,165 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:32,165 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:32,166 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001
2016-01-14 16:01:32,171 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787292131_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:32,184 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:32,185 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:32,187 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:32,187 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:32,188 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001/localmode-log-dir
2016-01-14 16:01:32,188 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001/localmode-log-dir/history.txt.appattempt_1452787292131_0001_000000, maxErrors=10
2016-01-14 16:01:32,188 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:32,189 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787292131_0001_000000, appSubmitTime=1452787292170, launchTime=1452787292171
2016-01-14 16:01:32,196 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:32,198 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:32,199 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:32,199 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:32,201 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:53154
2016-01-14 16:01:32,203 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:32,205 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787292131_0001_000000, startTime=1452787292205
2016-01-14 16:01:32,205 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:32,205 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:32,265 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:32,266 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:32,266 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452787292131_0001, dagName=[A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 16:01:32,289 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 16:01:32,291 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787292131_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001/localmode-log-dir/dag_1452787292131_0001_1.dot
2016-01-14 16:01:32,293 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001/localmode-log-dir/dag_1452787292131_0001_1-tez-dag.pb.txt
2016-01-14 16:01:32,320 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787292131_0001_1
2016-01-14 16:01:32,320 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:32,320 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 16:01:32 Running Dag: dag_1452787292131_0001_1
2016-01-14 16:01:32,337 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787292131_0001_1, submitTime=1452787292289
2016-01-14 16:01:32,337 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:32,337 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D6599856A25E47B3833A456F4F84815F
2016-01-14 16:01:32,338 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:32,339 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:32,340 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787292131_0001_1, initTime=1452787292337
2016-01-14 16:01:32,340 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292131_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:32,342 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:32,342 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:DAG_STARTED]: dagID=dag_1452787292131_0001_1, startTime=1452787292342
2016-01-14 16:01:32,342 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:32,343 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292131_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:32,343 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D6599856A25E47B3833A456F4F84815F : {31EA6CF621A74D36AA699A75527BFF32={InputName=31EA6CF621A74D36AA699A75527BFF32}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:32,343 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 31EA6CF621A74D36AA699A75527BFF32, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:32,343 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,343 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,343 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452787292131_0001, dagName=[A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 16:01:32,343 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,344 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]. Starting root input initializers: 1
2016-01-14 16:01:32,346 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:32,347 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 31EA6CF621A74D36AA699A75527BFF32 on vertex vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,349 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:32,350 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 31EA6CF621A74D36AA699A75527BFF32 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:32,351 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:32,351 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:32,354 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-01-14 16:01:32,355 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 31EA6CF621A74D36AA699A75527BFF32 on vertex vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,356 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:32,356 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {31EA6CF621A74D36AA699A75527BFF32=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:32,356 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] parallelism set to 1
2016-01-14 16:01:32,356 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:32,357 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787292131_0001_1_00, eventCount=1
2016-01-14 16:01:32,357 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,358 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=302AE30733E54586A626BF484019B9D0, vertexId=vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:32,358 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=302AE30733E54586A626BF484019B9D0, vertexId=vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,360 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=302AE30733E54586A626BF484019B9D0, vertexName=D6599856A25E47B3833A456F4F84815F, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:32,361 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=302AE30733E54586A626BF484019B9D0, vertexId=vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,363 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:32,363 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D6599856A25E47B3833A456F4F84815F, vertexId=vertex_1452787292131_0001_1_00, initRequestedTime=1452787292343, initedTime=1452787292363, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:32,364 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] with distanceFromRoot: 0
2016-01-14 16:01:32,364 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:32,364 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D6599856A25E47B3833A456F4F84815F
2016-01-14 16:01:32,365 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,365 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:32,365 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787292131_0001_1_00, startRequestedTime=1452787292364, startedTime=1452787292364
2016-01-14 16:01:32,366 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:32,367 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:32,367 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:TASK_STARTED]: vertexName=D6599856A25E47B3833A456F4F84815F, taskId=task_1452787292131_0001_1_00_000000, scheduledTime=1452787292366, launchTime=1452787292366
2016-01-14 16:01:32,367 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292131_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:32,368 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,368 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: D6599856A25E47B3833A456F4F84815F, VertexParallelism: 1, TaskAttemptID:attempt_1452787292131_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=31EA6CF621A74D36AA699A75527BFF32, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=302AE30733E54586A626BF484019B9D0, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:32,369 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292131_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:32,369 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:32,370 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:32,371 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:32,371 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:32,373 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787292131_0001_00_000001
2016-01-14 16:01:32,373 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:32,375 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787292131_0001_00_000001
2016-01-14 16:01:32,376 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:32,376 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787292131_0001, with dag id: dag_1452787292131_0001_1
2016-01-14 16:01:32,377 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:32,378 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:32,379 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787292131_0001_00_000001, launchTime=1452787292378
2016-01-14 16:01:32,380 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787292131_0001_00_000001
2016-01-14 16:01:32,381 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787292131_0001_1_00_000000_0] to container: [container_1452787292131_0001_00_000001]
2016-01-14 16:01:32,381 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:32,384 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787292131_0001_1_00_000000_0] started. Is using containerId: [container_1452787292131_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:32,384 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:32,384 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D6599856A25E47B3833A456F4F84815F, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0, startTime=1452787292383, containerId=container_1452787292131_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787292131_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:32,384 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292131_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:32,385 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292131_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:32,386 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787292131_0001_00_000001 given task: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,386 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787292131_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32 Starting to run new task attempt: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,387 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,387 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:32,387 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:32,387 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:32,387 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:32,387 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:32,387 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:32,387 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: D6599856A25E47B3833A456F4F84815F, VertexParallelism: 1, TaskAttemptID:attempt_1452787292131_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=31EA6CF621A74D36AA699A75527BFF32, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=302AE30733E54586A626BF484019B9D0, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:32,388 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:32,389 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,389 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787292131_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:32,390 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:32,390 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:32,391 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=31EA6CF621A74D36AA699A75527BFF32, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:32,391 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=302AE30733E54586A626BF484019B9D0, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:32,391 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:32,392 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:32,393 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,393 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,394 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:32,395 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 302AE30733E54586A626BF484019B9D0
2016-01-14 16:01:32,395 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:32,395 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:32,396 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 302AE30733E54586A626BF484019B9D0
2016-01-14 16:01:32,403 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:32,403 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,406 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,421 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D6599856A25E47B3833A456F4F84815F, ordinal: 0
2016-01-14 16:01:32,421 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D6599856A25E47B3833A456F4F84815F, mem on start (mb), free: 307, total: 397, max: 672
2016-01-14 16:01:32,421 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:32,422 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:32,422 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:32,427 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:32,427 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 302AE30733E54586A626BF484019B9D0
2016-01-14 16:01:32,427 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:32,427 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:32,428 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:32,428 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:32,428 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:32,428 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:32,428 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:32,428 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:32,429 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 31EA6CF621A74D36AA699A75527BFF32, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:32,429 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 302AE30733E54586A626BF484019B9D0, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:32,429 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:32,429 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 31EA6CF621A74D36AA699A75527BFF32 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:32,429 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,429 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:32,429 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,429 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:32,433 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:32,433 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:32,434 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,437 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:32,437 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:32,438 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: 31EA6CF621A74D36AA699A75527BFF32
2016-01-14 16:01:32,438 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"], id: 302AE30733E54586A626BF484019B9D0
2016-01-14 16:01:32,439 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-01-14 16:01:32,439 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5e460b57
2016-01-14 16:01:32,439 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 16:01:32,440 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:32,442 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5e460b57
2016-01-14 16:01:32,442 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:32,443 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:32,443 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D6599856A25E47B3833A456F4F84815F, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:32,447 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:32,447 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:32,448 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,448 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787292131_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:32,450 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,450 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D6599856A25E47B3833A456F4F84815F, mem on close (mb), free: 306, total: 397, max: 672
2016-01-14 16:01:32 Completed running task attempt: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,456 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:32,457 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:32,459 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D6599856A25E47B3833A456F4F84815F, taskAttemptId=attempt_1452787292131_0001_1_00_000000_0, startTime=1452787292383, finishTime=1452787292457, timeTaken=74, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787292443, Process_Duration=7, Process_End_Time=1452787292450, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:32,459 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292131_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:32,459 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32,460 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:32,460 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:TASK_FINISHED]: vertexName=D6599856A25E47B3833A456F4F84815F, taskId=task_1452787292131_0001_1_00_000000, startTime=1452787292383, finishTime=1452787292459, timeTaken=76, status=SUCCEEDED, successfulAttemptID=attempt_1452787292131_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787292443, Process_Duration=7, Process_End_Time=1452787292450, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:32,460 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:32,460 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292131_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:32,463 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] : 1
2016-01-14 16:01:32,463 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,463 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787292443, Process_Duration=7, Process_End_Time=1452787292450, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 16:01:32,464 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:01:32,464 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:32,464 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787292131_0001_00_000001
2016-01-14 16:01:32,465 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:32,467 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:VERTEX_FINISHED]: vertexName=D6599856A25E47B3833A456F4F84815F, vertexId=vertex_1452787292131_0001_1_00, initRequestedTime=1452787292343, initedTime=1452787292363, startRequestedTime=1452787292364, startedTime=1452787292364, finishTime=1452787292463, timeTaken=99, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787292443, Process_Duration=7, Process_End_Time=1452787292450, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452787292383, firstTasksToStart=[ task_1452787292131_0001_1_00_000000 ], lastTaskFinishTime=1452787292457, lastTasksToFinish=[ task_1452787292131_0001_1_00_000000 ], minTaskDuration=74, maxTaskDuration=74, avgTaskDuration=74.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787292131_0001_1_00_000000 ], longestDurationTasks=[ task_1452787292131_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:32,467 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:32,467 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:32,467 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787292131_0001_00_000001, stoppedTime=1452787292467, exitStatus=0
2016-01-14 16:01:32,467 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:32,468 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:32,469 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:32,469 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787292131_0001_1
2016-01-14 16:01:32,469 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787292131_0001_1
2016-01-14 16:01:32,469 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 302AE30733E54586A626BF484019B9D0 for vertex: vertex_1452787292131_0001_1_00 [D6599856A25E47B3833A456F4F84815F]
2016-01-14 16:01:32,475 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787292131_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:32,475 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787292131_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:32,476 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787292131_0001_00_000001, Exiting
2016-01-14 16:01:32,476 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787292131_0001_00_000001
2016-01-14 16:01:32,476 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787292131_0001_00_000001
2016-01-14 16:01:32,479 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787292131_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:32,480 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787292131_0001_00_000001 completed successfully
2016-01-14 16:01:32,483 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787292131_0001_1, queueSize=0
2016-01-14 16:01:32,483 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:32,483 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292131_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787292131_0001_1, startTime=1452787292342, finishTime=1452787292482, timeTaken=140, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787292443, Process_Duration=7, Process_End_Time=1452787292450, Read_Duration=3, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:32,484 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787292131_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:32,485 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292131_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:32,485 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292131_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:32 Completed Dag: dag_1452787292131_0001_1
2016-01-14 16:01:32,485 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787292131_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:32,485 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787292131_0001_1_post
2016-01-14 16:01:32,486 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:32,486 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:32,486 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787292131_0001_00_000001
2016-01-14 16:01:32,493 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452787292131_0001
2016-01-14 16:01:32,497 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:32,497 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:32,497 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:32,498 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:32,498 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:32,499 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:32,499 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:32,500 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:32,500 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:32,500 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:32,501 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:32,502 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:32,502 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:32,509 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/A60641BF38C8421980AB77A558F296DF/B6F081007EC649479595F5FEF67895BB/.tez/application_1452787292131_0001
2016-01-14 16:01:32,510 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.402
2016-01-14 16:01:32,632 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-01-14 16:01:32,662 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:32,662 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:32,710 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:01:32,725 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-14 16:01:32,726 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:32,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:32,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:32,747 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 16:01:32,748 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-01-14 16:01:32,769 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:32,770 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:32,770 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-01-14 16:01:32,771 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 16:01:32,771 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 16:01:32,772 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 16:01:32,773 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...m/testHeaderAll/headerall
2016-01-14 16:01:32,774 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:32,796 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:32,801 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:32,802 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:32,802 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:32,812 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001 doesn't exist and is created
2016-01-14 16:01:32,830 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:32,830 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:32,831 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001
2016-01-14 16:01:32,836 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787292802_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:32,854 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:32,855 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:32,857 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:32,857 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:32,858 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001/localmode-log-dir
2016-01-14 16:01:32,858 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001/localmode-log-dir/history.txt.appattempt_1452787292802_0001_000000, maxErrors=10
2016-01-14 16:01:32,859 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:32,859 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787292802_0001_000000, appSubmitTime=1452787292836, launchTime=1452787292836
2016-01-14 16:01:32,864 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:32,868 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:32,869 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:60799
2016-01-14 16:01:32,873 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:32,874 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:32,876 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:32,879 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787292802_0001_000000, startTime=1452787292878
2016-01-14 16:01:32,879 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:32,879 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:32,930 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:32,931 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:32,931 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452787292802_0001, dagName=[E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 16:01:32,956 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 16:01:32,958 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787292802_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001/localmode-log-dir/dag_1452787292802_0001_1.dot
2016-01-14 16:01:32,959 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001/localmode-log-dir/dag_1452787292802_0001_1-tez-dag.pb.txt
2016-01-14 16:01:32,993 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787292802_0001_1
2016-01-14 16:01:32,994 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:32,994 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 16:01:32 Running Dag: dag_1452787292802_0001_1
2016-01-14 16:01:33,008 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:33,009 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787292802_0001_1, submitTime=1452787292956
2016-01-14 16:01:33,010 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D56F16D814E845199B025ECA40D85788
2016-01-14 16:01:33,010 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:33,010 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:33,012 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787292802_0001_1, initTime=1452787293009
2016-01-14 16:01:33,012 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292802_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:33,012 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:DAG_STARTED]: dagID=dag_1452787292802_0001_1, startTime=1452787293012
2016-01-14 16:01:33,013 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:33,013 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292802_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:33,013 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D56F16D814E845199B025ECA40D85788 : {763F0C685A6046DE8C3D32DD68870F6C={InputName=763F0C685A6046DE8C3D32DD68870F6C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:33,013 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 763F0C685A6046DE8C3D32DD68870F6C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:33,013 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:33,013 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,014 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,014 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,014 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]. Starting root input initializers: 1
2016-01-14 16:01:33,014 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:33,014 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452787292802_0001, dagName=[E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 16:01:33,015 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 763F0C685A6046DE8C3D32DD68870F6C on vertex vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,017 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:33,017 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 763F0C685A6046DE8C3D32DD68870F6C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:33,018 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:33,018 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:33,021 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 16:01:33,021 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 763F0C685A6046DE8C3D32DD68870F6C on vertex vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,022 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:33,022 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {763F0C685A6046DE8C3D32DD68870F6C=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:33,022 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] parallelism set to 1
2016-01-14 16:01:33,022 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:33,022 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787292802_0001_1_00, eventCount=1
2016-01-14 16:01:33,023 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,023 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=451AA0DFCD704EC680DFFE60AC1DC83F, vertexId=vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:33,024 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=451AA0DFCD704EC680DFFE60AC1DC83F, vertexId=vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,026 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=451AA0DFCD704EC680DFFE60AC1DC83F, vertexName=D56F16D814E845199B025ECA40D85788, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:33,026 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=451AA0DFCD704EC680DFFE60AC1DC83F, vertexId=vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,028 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:33,028 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D56F16D814E845199B025ECA40D85788, vertexId=vertex_1452787292802_0001_1_00, initRequestedTime=1452787293013, initedTime=1452787293027, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:33,028 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] with distanceFromRoot: 0
2016-01-14 16:01:33,028 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:33,028 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D56F16D814E845199B025ECA40D85788
2016-01-14 16:01:33,028 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,029 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:33,029 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787292802_0001_1_00, startRequestedTime=1452787293028, startedTime=1452787293028
2016-01-14 16:01:33,029 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:33,029 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:33,029 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:TASK_STARTED]: vertexName=D56F16D814E845199B025ECA40D85788, taskId=task_1452787292802_0001_1_00_000000, scheduledTime=1452787293029, launchTime=1452787293029
2016-01-14 16:01:33,030 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292802_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:33,030 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,030 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: D56F16D814E845199B025ECA40D85788, VertexParallelism: 1, TaskAttemptID:attempt_1452787292802_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=763F0C685A6046DE8C3D32DD68870F6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=451AA0DFCD704EC680DFFE60AC1DC83F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:33,030 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292802_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:33,031 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:33,032 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:33,032 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:33,032 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:33,033 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787292802_0001_00_000001
2016-01-14 16:01:33,033 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:33,036 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787292802_0001_00_000001
2016-01-14 16:01:33,036 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:33,039 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:33,039 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:33,039 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787292802_0001_00_000001, launchTime=1452787293038
2016-01-14 16:01:33,041 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787292802_0001_00_000001
2016-01-14 16:01:33,042 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787292802_0001_1_00_000000_0] to container: [container_1452787292802_0001_00_000001]
2016-01-14 16:01:33,042 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:33,043 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787292802_0001_1_00_000000_0] started. Is using containerId: [container_1452787292802_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:33,043 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D56F16D814E845199B025ECA40D85788, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0, startTime=1452787293043, containerId=container_1452787292802_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787292802_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:33,044 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292802_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:33,044 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:33,044 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292802_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:33,044 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787292802_0001_00_000001 given task: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,044 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787292802_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33 Starting to run new task attempt: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,045 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,045 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,046 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:33,046 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:33,046 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:33,046 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:33,047 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:33,047 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: D56F16D814E845199B025ECA40D85788, VertexParallelism: 1, TaskAttemptID:attempt_1452787292802_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=763F0C685A6046DE8C3D32DD68870F6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=451AA0DFCD704EC680DFFE60AC1DC83F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:33,048 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:33,048 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,050 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:33,051 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,052 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787292802_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:33,053 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=763F0C685A6046DE8C3D32DD68870F6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:33,053 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,053 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=451AA0DFCD704EC680DFFE60AC1DC83F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:33,054 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:33,054 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 451AA0DFCD704EC680DFFE60AC1DC83F
2016-01-14 16:01:33,055 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:33,055 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 451AA0DFCD704EC680DFFE60AC1DC83F
2016-01-14 16:01:33,057 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:33,059 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787292802_0001, with dag id: dag_1452787292802_0001_1
2016-01-14 16:01:33,062 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:33,062 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,063 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,073 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:33,075 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,075 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,080 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D56F16D814E845199B025ECA40D85788, ordinal: 0
2016-01-14 16:01:33,080 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D56F16D814E845199B025ECA40D85788, mem on start (mb), free: 218, total: 397, max: 672
2016-01-14 16:01:33,080 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,080 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:33,080 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:33,082 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:33,082 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 451AA0DFCD704EC680DFFE60AC1DC83F
2016-01-14 16:01:33,082 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:33,082 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:33,082 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:33,082 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:33,082 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:33,083 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:33,083 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:33,083 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:33,083 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 451AA0DFCD704EC680DFFE60AC1DC83F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:33,083 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 763F0C685A6046DE8C3D32DD68870F6C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:33,083 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:33,083 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 763F0C685A6046DE8C3D32DD68870F6C being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:33,084 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,084 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:33,084 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,084 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:33,084 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:33,084 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:33,085 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,087 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:33,087 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@52009a96
2016-01-14 16:01:33,089 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@52009a96
2016-01-14 16:01:33,089 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:33,089 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:33,091 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:33,092 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 763F0C685A6046DE8C3D32DD68870F6C
2016-01-14 16:01:33,092 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"], id: 451AA0DFCD704EC680DFFE60AC1DC83F
2016-01-14 16:01:33,092 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-01-14 16:01:33,093 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:33,093 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:33,093 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D56F16D814E845199B025ECA40D85788, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:33,097 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:33,097 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:33,098 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,098 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787292802_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:33,099 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,099 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D56F16D814E845199B025ECA40D85788, mem on close (mb), free: 216, total: 397, max: 672
2016-01-14 16:01:33 Completed running task attempt: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,100 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:33,101 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787293093, Process_Duration=6, Process_End_Time=1452787293099, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-01-14 16:01:33,101 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:01:33,101 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,101 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:33,103 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D56F16D814E845199B025ECA40D85788, taskAttemptId=attempt_1452787292802_0001_1_00_000000_0, startTime=1452787293043, finishTime=1452787293101, timeTaken=58, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293093, Process_Duration=6, Process_End_Time=1452787293099, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:33,103 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787292802_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:33,103 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:33,101 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787292802_0001_00_000001
2016-01-14 16:01:33,103 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33,106 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:33,106 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:TASK_FINISHED]: vertexName=D56F16D814E845199B025ECA40D85788, taskId=task_1452787292802_0001_1_00_000000, startTime=1452787293043, finishTime=1452787293106, timeTaken=63, status=SUCCEEDED, successfulAttemptID=attempt_1452787292802_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293093, Process_Duration=6, Process_End_Time=1452787293099, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:33,107 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787292802_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:33,107 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] : 1
2016-01-14 16:01:33,108 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,109 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:33,110 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:VERTEX_FINISHED]: vertexName=D56F16D814E845199B025ECA40D85788, vertexId=vertex_1452787292802_0001_1_00, initRequestedTime=1452787293013, initedTime=1452787293027, startRequestedTime=1452787293028, startedTime=1452787293028, finishTime=1452787293108, timeTaken=80, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293093, Process_Duration=6, Process_End_Time=1452787293099, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1452787293043, firstTasksToStart=[ task_1452787292802_0001_1_00_000000 ], lastTaskFinishTime=1452787293101, lastTasksToFinish=[ task_1452787292802_0001_1_00_000000 ], minTaskDuration=58, maxTaskDuration=58, avgTaskDuration=58.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787292802_0001_1_00_000000 ], longestDurationTasks=[ task_1452787292802_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:33,111 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:33,111 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:33,111 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787292802_0001_00_000001, stoppedTime=1452787293111, exitStatus=0
2016-01-14 16:01:33,111 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:33,112 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:33,112 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:33,112 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787292802_0001_1
2016-01-14 16:01:33,112 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787292802_0001_1
2016-01-14 16:01:33,112 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 451AA0DFCD704EC680DFFE60AC1DC83F for vertex: vertex_1452787292802_0001_1_00 [D56F16D814E845199B025ECA40D85788]
2016-01-14 16:01:33,116 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787292802_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:33,116 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787292802_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:33,117 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787292802_0001_00_000001, Exiting
2016-01-14 16:01:33,117 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787292802_0001_00_000001
2016-01-14 16:01:33,117 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787292802_0001_00_000001
2016-01-14 16:01:33,122 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787292802_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:33,123 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787292802_0001_00_000001 completed successfully
2016-01-14 16:01:33,127 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787292802_0001_1, queueSize=0
2016-01-14 16:01:33,127 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:33,130 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787292802_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787292802_0001_1, startTime=1452787293012, finishTime=1452787293125, timeTaken=113, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293093, Process_Duration=6, Process_End_Time=1452787293099, Read_Duration=2, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:33,130 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787292802_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:33,131 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787292802_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:33,131 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787292802_0001_00_000001
2016-01-14 16:01:33,132 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787292802_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:33 Completed Dag: dag_1452787292802_0001_1
2016-01-14 16:01:33,132 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787292802_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:33,132 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787292802_0001_1_post
2016-01-14 16:01:33,133 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,133 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:33,141 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452787292802_0001
2016-01-14 16:01:33,144 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:33,145 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:33,145 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:33,145 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:33,145 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:33,146 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:33,148 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:33,149 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:33,149 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:33,150 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:33,150 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:33,151 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:33,151 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:33,157 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/E969033A098A47528234566B8E1406AD/FCC813EC3F994041AD7D060AC4339873/.tez/application_1452787292802_0001
2016-01-14 16:01:33,157 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.388
2016-01-14 16:01:33,213 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-01-14 16:01:33,248 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:33,249 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:33,306 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:01:33,315 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-01-14 16:01:33,316 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:33,316 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:33,316 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:33,338 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 16:01:33,340 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-01-14 16:01:33,355 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:33,355 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:33,355 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-01-14 16:01:33,356 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 16:01:33,356 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 16:01:33,356 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 16:01:33,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...Text/quoted/normcharfalse
2016-01-14 16:01:33,357 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:33,376 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:33,381 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:33,381 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:33,382 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:33,391 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001 doesn't exist and is created
2016-01-14 16:01:33,409 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:33,409 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:33,410 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001
2016-01-14 16:01:33,414 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787293381_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:33,431 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:33,432 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:33,435 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:33,435 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:33,435 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001/localmode-log-dir
2016-01-14 16:01:33,435 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001/localmode-log-dir/history.txt.appattempt_1452787293381_0001_000000, maxErrors=10
2016-01-14 16:01:33,435 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:33,437 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787293381_0001_000000, appSubmitTime=1452787293413, launchTime=1452787293413
2016-01-14 16:01:33,446 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:33,447 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:33,449 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:33,449 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:33,454 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:41773
2016-01-14 16:01:33,456 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:33,458 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787293381_0001_000000, startTime=1452787293458
2016-01-14 16:01:33,458 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:33,458 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:33,509 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:33,510 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:33,510 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452787293381_0001, dagName=[22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 16:01:33,535 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 16:01:33,539 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787293381_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001/localmode-log-dir/dag_1452787293381_0001_1.dot
2016-01-14 16:01:33,540 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001/localmode-log-dir/dag_1452787293381_0001_1-tez-dag.pb.txt
2016-01-14 16:01:33,562 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787293381_0001_1
2016-01-14 16:01:33,562 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,562 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 16:01:33 Running Dag: dag_1452787293381_0001_1
2016-01-14 16:01:33,577 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:33,578 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787293381_0001_1, submitTime=1452787293536
2016-01-14 16:01:33,579 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E522F08488274EAC9732D62DC215CDF0
2016-01-14 16:01:33,579 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:33,580 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:33,582 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787293381_0001_1, initTime=1452787293579
2016-01-14 16:01:33,582 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787293381_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:33,583 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:DAG_STARTED]: dagID=dag_1452787293381_0001_1, startTime=1452787293582
2016-01-14 16:01:33,583 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:33,583 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787293381_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:33,583 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E522F08488274EAC9732D62DC215CDF0 : {27D780E469E1437BA8036C455D32FE30={InputName=27D780E469E1437BA8036C455D32FE30}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:33,583 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 27D780E469E1437BA8036C455D32FE30, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:33,583 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,583 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,583 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,584 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]. Starting root input initializers: 1
2016-01-14 16:01:33,583 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:33,584 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:33,584 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 27D780E469E1437BA8036C455D32FE30 on vertex vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,585 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452787293381_0001, dagName=[22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 16:01:33,587 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:33,587 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 27D780E469E1437BA8036C455D32FE30 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:33,588 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:33,588 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:33,592 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 16:01:33,592 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 27D780E469E1437BA8036C455D32FE30 on vertex vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,593 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:33,593 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {27D780E469E1437BA8036C455D32FE30=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:33,594 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] parallelism set to 1
2016-01-14 16:01:33,594 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:33,594 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787293381_0001_1_00, eventCount=1
2016-01-14 16:01:33,594 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,595 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=03D959FC05F84E03BD66C325924F38C6, vertexId=vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:33,595 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=03D959FC05F84E03BD66C325924F38C6, vertexId=vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,598 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=03D959FC05F84E03BD66C325924F38C6, vertexName=E522F08488274EAC9732D62DC215CDF0, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:33,599 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=03D959FC05F84E03BD66C325924F38C6, vertexId=vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,602 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E522F08488274EAC9732D62DC215CDF0, vertexId=vertex_1452787293381_0001_1_00, initRequestedTime=1452787293583, initedTime=1452787293602, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:33,602 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:33,603 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] with distanceFromRoot: 0
2016-01-14 16:01:33,603 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:33,604 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E522F08488274EAC9732D62DC215CDF0
2016-01-14 16:01:33,605 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,606 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:33,606 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787293381_0001_1_00, startRequestedTime=1452787293604, startedTime=1452787293604
2016-01-14 16:01:33,607 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:33,608 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:33,608 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:TASK_STARTED]: vertexName=E522F08488274EAC9732D62DC215CDF0, taskId=task_1452787293381_0001_1_00_000000, scheduledTime=1452787293607, launchTime=1452787293607
2016-01-14 16:01:33,609 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787293381_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:33,609 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,610 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: E522F08488274EAC9732D62DC215CDF0, VertexParallelism: 1, TaskAttemptID:attempt_1452787293381_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=27D780E469E1437BA8036C455D32FE30, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=03D959FC05F84E03BD66C325924F38C6, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:33,610 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787293381_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:33,611 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:33,613 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:33,614 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:33,614 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:33,616 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787293381_0001_00_000001
2016-01-14 16:01:33,616 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:33,619 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787293381_0001, with dag id: dag_1452787293381_0001_1
2016-01-14 16:01:33,621 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787293381_0001_00_000001
2016-01-14 16:01:33,621 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:33,625 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:33,627 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:33,627 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787293381_0001_00_000001, launchTime=1452787293623
2016-01-14 16:01:33,628 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787293381_0001_00_000001
2016-01-14 16:01:33,632 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787293381_0001_1_00_000000_0] to container: [container_1452787293381_0001_00_000001]
2016-01-14 16:01:33,632 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:33,633 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787293381_0001_00_000001 given task: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,633 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787293381_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,633 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787293381_0001_1_00_000000_0] started. Is using containerId: [container_1452787293381_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:33 Starting to run new task attempt: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,635 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,636 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,636 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:33,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E522F08488274EAC9732D62DC215CDF0, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0, startTime=1452787293633, containerId=container_1452787293381_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787293381_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:33,636 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:33,637 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:33,638 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:33,638 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:33,639 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:33,639 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787293381_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:33,640 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787293381_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:33,639 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: E522F08488274EAC9732D62DC215CDF0, VertexParallelism: 1, TaskAttemptID:attempt_1452787293381_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=27D780E469E1437BA8036C455D32FE30, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=03D959FC05F84E03BD66C325924F38C6, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:33,640 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:33,641 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,642 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:33,643 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,642 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787293381_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:33,644 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=27D780E469E1437BA8036C455D32FE30, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:33,644 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,645 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:33,645 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=03D959FC05F84E03BD66C325924F38C6, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:33,645 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,646 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,647 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:33,647 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 03D959FC05F84E03BD66C325924F38C6
2016-01-14 16:01:33,647 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:33,647 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 03D959FC05F84E03BD66C325924F38C6
2016-01-14 16:01:33,650 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:33,650 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,650 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,653 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:33,664 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E522F08488274EAC9732D62DC215CDF0, ordinal: 0
2016-01-14 16:01:33,665 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E522F08488274EAC9732D62DC215CDF0, mem on start (mb), free: 142, total: 397, max: 672
2016-01-14 16:01:33,693 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:33,693 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:33,693 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:33,694 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:33,694 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 03D959FC05F84E03BD66C325924F38C6
2016-01-14 16:01:33,695 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:33,695 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:33,695 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:33,696 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:33,696 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:33,696 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:33,696 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:33,696 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:33,697 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 27D780E469E1437BA8036C455D32FE30, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:33,697 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 03D959FC05F84E03BD66C325924F38C6, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:33,697 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:33,697 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 27D780E469E1437BA8036C455D32FE30 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:33,697 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:33,697 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:33,698 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,698 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:33,698 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,698 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:33,699 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,700 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:33,701 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:33,702 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 27D780E469E1437BA8036C455D32FE30
2016-01-14 16:01:33,702 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@480c26ba
2016-01-14 16:01:33,702 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"], id: 03D959FC05F84E03BD66C325924F38C6
2016-01-14 16:01:33,702 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-01-14 16:01:33,702 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:33,703 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:33,703 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@480c26ba
2016-01-14 16:01:33,703 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:33,703 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:33,703 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E522F08488274EAC9732D62DC215CDF0, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:33,706 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:33,707 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:33,707 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,707 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787293381_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:33,708 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,708 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E522F08488274EAC9732D62DC215CDF0, mem on close (mb), free: 361, total: 397, max: 672
2016-01-14 16:01:33 Completed running task attempt: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,709 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:33,710 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=712, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=28, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787293703, Process_Duration=5, Process_End_Time=1452787293708, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 16:01:33,711 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E522F08488274EAC9732D62DC215CDF0, taskAttemptId=attempt_1452787293381_0001_1_00_000000_0, startTime=1452787293633, finishTime=1452787293710, timeTaken=77, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=712, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=28, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293703, Process_Duration=5, Process_End_Time=1452787293708, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:33,711 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787293381_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:33,711 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:01:33,712 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,712 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:33,713 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787293381_0001_00_000001
2016-01-14 16:01:33,711 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33,711 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:33,714 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:TASK_FINISHED]: vertexName=E522F08488274EAC9732D62DC215CDF0, taskId=task_1452787293381_0001_1_00_000000, startTime=1452787293633, finishTime=1452787293713, timeTaken=80, status=SUCCEEDED, successfulAttemptID=attempt_1452787293381_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=712, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=28, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293703, Process_Duration=5, Process_End_Time=1452787293708, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:33,714 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787293381_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:33,714 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] : 1
2016-01-14 16:01:33,715 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,715 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:33,716 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:VERTEX_FINISHED]: vertexName=E522F08488274EAC9732D62DC215CDF0, vertexId=vertex_1452787293381_0001_1_00, initRequestedTime=1452787293583, initedTime=1452787293602, startRequestedTime=1452787293604, startedTime=1452787293604, finishTime=1452787293715, timeTaken=111, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=712, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=28, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293703, Process_Duration=5, Process_End_Time=1452787293708, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452787293633, firstTasksToStart=[ task_1452787293381_0001_1_00_000000 ], lastTaskFinishTime=1452787293710, lastTasksToFinish=[ task_1452787293381_0001_1_00_000000 ], minTaskDuration=77, maxTaskDuration=77, avgTaskDuration=77.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787293381_0001_1_00_000000 ], longestDurationTasks=[ task_1452787293381_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:33,717 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:33,717 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:33,717 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:33,717 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787293381_0001_00_000001, stoppedTime=1452787293717, exitStatus=0
2016-01-14 16:01:33,718 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:33,718 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:33,718 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787293381_0001_1
2016-01-14 16:01:33,718 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787293381_0001_1
2016-01-14 16:01:33,718 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 03D959FC05F84E03BD66C325924F38C6 for vertex: vertex_1452787293381_0001_1_00 [E522F08488274EAC9732D62DC215CDF0]
2016-01-14 16:01:33,718 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:33,724 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787293381_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:33,724 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787293381_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:33,724 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787293381_0001_00_000001, Exiting
2016-01-14 16:01:33,724 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787293381_0001_00_000001
2016-01-14 16:01:33,724 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787293381_0001_00_000001
2016-01-14 16:01:33,727 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787293381_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:33,727 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787293381_0001_00_000001 completed successfully
2016-01-14 16:01:33,729 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787293381_0001_1, queueSize=0
2016-01-14 16:01:33,730 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:33,730 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787293381_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787293381_0001_1, startTime=1452787293582, finishTime=1452787293728, timeTaken=146, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=712, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=28, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787293703, Process_Duration=5, Process_End_Time=1452787293708, Read_Duration=0, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 16:01:33,730 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787293381_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:33,730 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787293381_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:33,730 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787293381_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:33,730 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787293381_0001_00_000001
2016-01-14 16:01:33 Completed Dag: dag_1452787293381_0001_1
2016-01-14 16:01:33,731 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787293381_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:33,731 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787293381_0001_1_post
2016-01-14 16:01:33,732 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:33,732 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:33,740 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452787293381_0001
2016-01-14 16:01:33,745 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:33,745 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:33,745 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:33,745 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:33,745 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:33,746 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:33,746 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:33,746 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:33,747 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:33,747 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:33,747 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:33,748 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:33,748 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:33,752 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/22918D4B6B084A3AAF26A4534CC2D496/EF699356BA1942C0BAA059ECB1B2874C/.tez/application_1452787293381_0001
2016-01-14 16:01:33,752 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.397
2016-01-14 16:01:33,860 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-01-14 16:01:33,995 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:33,995 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:34,038 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 16:01:34,053 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 16:01:34,053 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:34,054 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:34,054 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:34,069 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt
2016-01-14 16:01:34,070 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-01-14 16:01:34,095 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:34,096 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 16:01:34,097 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-01-14 16:01:34,097 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 16:01:34,097 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 16:01:34,098 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 16:01:34,098 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...oercion/testFieldCoercion
2016-01-14 16:01:34,099 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:34,113 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:34,120 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:34,120 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:34,120 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:34,130 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001 doesn't exist and is created
2016-01-14 16:01:34,146 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:34,147 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:34,147 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001
2016-01-14 16:01:34,151 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787294120_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:34,163 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:34,164 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:34,166 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:34,167 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:34,167 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001/localmode-log-dir
2016-01-14 16:01:34,167 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001/localmode-log-dir/history.txt.appattempt_1452787294120_0001_000000, maxErrors=10
2016-01-14 16:01:34,168 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:34,169 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787294120_0001_000000, appSubmitTime=1452787294151, launchTime=1452787294151
2016-01-14 16:01:34,174 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:34,176 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:34,177 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:33972
2016-01-14 16:01:34,178 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:34,178 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:34,179 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:34,182 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787294120_0001_000000, startTime=1452787294182
2016-01-14 16:01:34,182 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:34,182 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:34,247 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:34,247 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:34,247 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452787294120_0001, dagName=[38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 16:01:34,266 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 16:01:34,268 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787294120_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001/localmode-log-dir/dag_1452787294120_0001_1.dot
2016-01-14 16:01:34,270 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001/localmode-log-dir/dag_1452787294120_0001_1-tez-dag.pb.txt
2016-01-14 16:01:34,296 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787294120_0001_1
2016-01-14 16:01:34,296 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:34,296 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 16:01:34 Running Dag: dag_1452787294120_0001_1
2016-01-14 16:01:34,313 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:34,314 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787294120_0001_1, submitTime=1452787294266
2016-01-14 16:01:34,315 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AC54CE9988EB4760A489FEC4505ABA88
2016-01-14 16:01:34,315 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:34,316 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:34,317 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787294120_0001_1, initTime=1452787294314
2016-01-14 16:01:34,317 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294120_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:34,318 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:DAG_STARTED]: dagID=dag_1452787294120_0001_1, startTime=1452787294318
2016-01-14 16:01:34,318 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:34,319 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294120_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:34,319 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AC54CE9988EB4760A489FEC4505ABA88 : {0A0354BC4E9D4CF8B472A3F2B2067E71={InputName=0A0354BC4E9D4CF8B472A3F2B2067E71}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:34,319 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 0A0354BC4E9D4CF8B472A3F2B2067E71, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:34,319 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,319 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,319 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,320 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]. Starting root input initializers: 1
2016-01-14 16:01:34,320 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:34,321 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:34,322 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 0A0354BC4E9D4CF8B472A3F2B2067E71 on vertex vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,324 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:34,325 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452787294120_0001, dagName=[38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 16:01:34,325 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 0A0354BC4E9D4CF8B472A3F2B2067E71 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:34,326 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:34,327 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:34,330 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 420
2016-01-14 16:01:34,330 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 0A0354BC4E9D4CF8B472A3F2B2067E71 on vertex vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,331 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:34,331 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {0A0354BC4E9D4CF8B472A3F2B2067E71=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:34,332 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] parallelism set to 1
2016-01-14 16:01:34,332 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:34,332 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787294120_0001_1_00, eventCount=1
2016-01-14 16:01:34,332 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,333 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=47107B05F64F4C789DE8138798EB3138, vertexId=vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:34,333 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=47107B05F64F4C789DE8138798EB3138, vertexId=vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,336 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=47107B05F64F4C789DE8138798EB3138, vertexName=AC54CE9988EB4760A489FEC4505ABA88, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:34,336 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=47107B05F64F4C789DE8138798EB3138, vertexId=vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,340 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:34,340 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, vertexId=vertex_1452787294120_0001_1_00, initRequestedTime=1452787294319, initedTime=1452787294339, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:34,340 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] with distanceFromRoot: 0
2016-01-14 16:01:34,341 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:34,341 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AC54CE9988EB4760A489FEC4505ABA88
2016-01-14 16:01:34,342 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,342 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:34,343 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787294120_0001_1_00, startRequestedTime=1452787294341, startedTime=1452787294341
2016-01-14 16:01:34,343 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:34,344 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:34,345 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:TASK_STARTED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, taskId=task_1452787294120_0001_1_00_000000, scheduledTime=1452787294344, launchTime=1452787294344
2016-01-14 16:01:34,345 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294120_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:34,345 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,346 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: AC54CE9988EB4760A489FEC4505ABA88, VertexParallelism: 1, TaskAttemptID:attempt_1452787294120_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0A0354BC4E9D4CF8B472A3F2B2067E71, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=47107B05F64F4C789DE8138798EB3138, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:34,347 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294120_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:34,347 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:34,348 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:34,349 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:34,349 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:34,350 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787294120_0001_00_000001
2016-01-14 16:01:34,350 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:34,352 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787294120_0001, with dag id: dag_1452787294120_0001_1
2016-01-14 16:01:34,353 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787294120_0001_00_000001
2016-01-14 16:01:34,353 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:34,354 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:34,354 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787294120_0001_00_000001, launchTime=1452787294354
2016-01-14 16:01:34,355 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:34,355 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787294120_0001_00_000001
2016-01-14 16:01:34,357 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787294120_0001_1_00_000000_0] to container: [container_1452787294120_0001_00_000001]
2016-01-14 16:01:34,358 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:34,358 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787294120_0001_1_00_000000_0] started. Is using containerId: [container_1452787294120_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:34,358 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0, startTime=1452787294358, containerId=container_1452787294120_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787294120_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:34,359 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294120_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:34,359 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:34,359 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294120_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:34,359 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787294120_0001_00_000001 given task: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,360 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787294120_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34 Starting to run new task attempt: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,362 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,362 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:34,362 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:34,362 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:34,362 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:34,362 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:34,363 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:34,363 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: AC54CE9988EB4760A489FEC4505ABA88, VertexParallelism: 1, TaskAttemptID:attempt_1452787294120_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0A0354BC4E9D4CF8B472A3F2B2067E71, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=47107B05F64F4C789DE8138798EB3138, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:34,363 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:34,363 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,364 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:34,364 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:34,365 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=0A0354BC4E9D4CF8B472A3F2B2067E71, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:34,365 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:34,365 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,366 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,367 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:34,367 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=47107B05F64F4C789DE8138798EB3138, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:34,368 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:34,368 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 47107B05F64F4C789DE8138798EB3138
2016-01-14 16:01:34,368 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:34,369 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 47107B05F64F4C789DE8138798EB3138
2016-01-14 16:01:34,376 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787294120_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:34,377 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:34,380 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:34,386 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,387 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,393 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:34,393 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 47107B05F64F4C789DE8138798EB3138
2016-01-14 16:01:34,396 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AC54CE9988EB4760A489FEC4505ABA88, ordinal: 0
2016-01-14 16:01:34,396 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AC54CE9988EB4760A489FEC4505ABA88, mem on start (mb), free: 268, total: 397, max: 672
2016-01-14 16:01:34,396 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:34,396 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:34,396 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:34,396 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:34,397 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:34,397 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:34,397 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:34,398 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:34,398 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:34,398 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:34,399 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:34,399 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 0A0354BC4E9D4CF8B472A3F2B2067E71, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:34,399 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 47107B05F64F4C789DE8138798EB3138, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:34,399 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:34,400 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,400 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:34,400 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,400 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 0A0354BC4E9D4CF8B472A3F2B2067E71 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:34,401 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:34,401 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:34,401 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:34,402 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,405 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 16:01:34,406 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:34,408 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7afd1f50
2016-01-14 16:01:34,411 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7afd1f50
2016-01-14 16:01:34,411 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:34,411 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:34,415 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"] streamed: true, id: 0A0354BC4E9D4CF8B472A3F2B2067E71
2016-01-14 16:01:34,416 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"], id: 47107B05F64F4C789DE8138798EB3138
2016-01-14 16:01:34,417 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-01-14 16:01:34,510 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 16:01:34,510 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:34,510 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AC54CE9988EB4760A489FEC4505ABA88, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:34,517 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:34,517 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:34,518 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,518 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787294120_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:34,519 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,520 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AC54CE9988EB4760A489FEC4505ABA88, mem on close (mb), free: 263, total: 397, max: 672
2016-01-14 16:01:34 Completed running task attempt: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,521 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:34,522 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10][cascading.flow.SliceCounters Process_Begin_Time=1452787294510, Process_Duration=9, Process_End_Time=1452787294519, Read_Duration=2, Tuples_Read=9, Tuples_Written=9, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=9, Tuples_Written=9]]
2016-01-14 16:01:34,523 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:01:34,523 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:34,523 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, taskAttemptId=attempt_1452787294120_0001_1_00_000000_0, startTime=1452787294358, finishTime=1452787294522, timeTaken=164, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452787294510, Process_Duration=9, Process_End_Time=1452787294519, Read_Duration=2, Tuples_Read=9, Tuples_Written=9, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 16:01:34,524 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294120_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:34,524 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:34,524 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787294120_0001_00_000001
2016-01-14 16:01:34,526 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34,527 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:34,527 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:TASK_FINISHED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, taskId=task_1452787294120_0001_1_00_000000, startTime=1452787294358, finishTime=1452787294526, timeTaken=168, status=SUCCEEDED, successfulAttemptID=attempt_1452787294120_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452787294510, Process_Duration=9, Process_End_Time=1452787294519, Read_Duration=2, Tuples_Read=9, Tuples_Written=9, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 16:01:34,527 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294120_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:34,527 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:34,528 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] : 1
2016-01-14 16:01:34,529 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,530 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:34,530 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:VERTEX_FINISHED]: vertexName=AC54CE9988EB4760A489FEC4505ABA88, vertexId=vertex_1452787294120_0001_1_00, initRequestedTime=1452787294319, initedTime=1452787294339, startRequestedTime=1452787294341, startedTime=1452787294341, finishTime=1452787294529, timeTaken=188, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452787294510, Process_Duration=9, Process_End_Time=1452787294519, Read_Duration=2, Tuples_Read=9, Tuples_Written=9, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9, vertexStats=firstTaskStartTime=1452787294358, firstTasksToStart=[ task_1452787294120_0001_1_00_000000 ], lastTaskFinishTime=1452787294522, lastTasksToFinish=[ task_1452787294120_0001_1_00_000000 ], minTaskDuration=164, maxTaskDuration=164, avgTaskDuration=164.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787294120_0001_1_00_000000 ], longestDurationTasks=[ task_1452787294120_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:34,531 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:34,531 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:34,531 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787294120_0001_00_000001, stoppedTime=1452787294531, exitStatus=0
2016-01-14 16:01:34,531 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:34,532 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:34,532 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:34,533 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787294120_0001_1
2016-01-14 16:01:34,533 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787294120_0001_1
2016-01-14 16:01:34,533 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 47107B05F64F4C789DE8138798EB3138 for vertex: vertex_1452787294120_0001_1_00 [AC54CE9988EB4760A489FEC4505ABA88]
2016-01-14 16:01:34,536 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787294120_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:34,537 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787294120_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:34,537 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787294120_0001_00_000001, Exiting
2016-01-14 16:01:34,537 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787294120_0001_00_000001
2016-01-14 16:01:34,537 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787294120_0001_00_000001
2016-01-14 16:01:34,542 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787294120_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:34,542 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787294120_0001_00_000001 completed successfully
2016-01-14 16:01:34,547 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787294120_0001_1, queueSize=0
2016-01-14 16:01:34,547 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:34,548 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294120_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787294120_0001_1, startTime=1452787294318, finishTime=1452787294546, timeTaken=228, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452787294510, Process_Duration=9, Process_End_Time=1452787294519, Read_Duration=2, Tuples_Read=9, Tuples_Written=9, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 16:01:34,548 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787294120_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:34,548 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294120_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:34,548 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294120_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:34,548 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787294120_0001_00_000001
2016-01-14 16:01:34 Completed Dag: dag_1452787294120_0001_1
2016-01-14 16:01:34,549 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787294120_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:34,549 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787294120_0001_1_post
2016-01-14 16:01:34,549 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:34,549 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:34,557 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452787294120_0001
2016-01-14 16:01:34,560 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:34,561 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:34,561 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:34,561 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:34,561 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:34,562 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:34,563 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:34,563 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:34,563 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:34,564 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:34,564 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:34,565 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:34,565 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:34,573 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/38ABCFB78A8C447CAFE0E7C2CAD4F887/BA3383E2FDCA4EADAEFFC92496481E24/.tez/application_1452787294120_0001
2016-01-14 16:01:34,574 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.479
2016-01-14 16:01:34,615 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-01-14 16:01:34,644 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:34,645 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:34,718 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:01:34,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 16:01:34,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:34,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:34,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:34,746 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-header.txt
2016-01-14 16:01:34,752 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: __multisink_placeholder_56CBF38D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34,769 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:34,770 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 16:01:34,772 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-01-14 16:01:34,772 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 16:01:34,773 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 16:01:34,774 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 16:01:34,774 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34,775 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:34,790 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:34,796 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:34,797 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:34,797 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:34,810 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001 doesn't exist and is created
2016-01-14 16:01:34,829 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:34,829 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:34,830 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001
2016-01-14 16:01:34,835 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787294796_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:34,853 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:34,855 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:34,857 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:34,857 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:34,858 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001/localmode-log-dir
2016-01-14 16:01:34,859 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001/localmode-log-dir/history.txt.appattempt_1452787294796_0001_000000, maxErrors=10
2016-01-14 16:01:34,859 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:34,859 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787294796_0001_000000, appSubmitTime=1452787294835, launchTime=1452787294835
2016-01-14 16:01:34,864 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:34,866 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:34,875 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:34,875 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:34,877 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:54950
2016-01-14 16:01:34,880 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:34,883 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787294796_0001_000000, startTime=1452787294883
2016-01-14 16:01:34,883 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:34,883 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:34,930 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:34,930 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:34,930 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...D13CE4164BA4B9AC92A9D3984, applicationId=application_1452787294796_0001, dagName=[4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34,951 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34,953 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787294796_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001/localmode-log-dir/dag_1452787294796_0001_1.dot
2016-01-14 16:01:34,954 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001/localmode-log-dir/dag_1452787294796_0001_1-tez-dag.pb.txt
2016-01-14 16:01:34,965 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787294796_0001_1
2016-01-14 16:01:34,965 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:34,965 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34 Running Dag: dag_1452787294796_0001_1
2016-01-14 16:01:34,979 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787294796_0001_1, submitTime=1452787294951
2016-01-14 16:01:34,979 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:34,980 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B2250535EEB5466886B28F80EF4DDA04
2016-01-14 16:01:34,981 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:34,981 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787294796_0001_1, initTime=1452787294980
2016-01-14 16:01:34,982 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294796_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:34,981 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:34,983 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:DAG_STARTED]: dagID=dag_1452787294796_0001_1, startTime=1452787294983
2016-01-14 16:01:34,984 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:34,984 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294796_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:34,984 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B2250535EEB5466886B28F80EF4DDA04 : {AA53B2D6B93140E2A7BB64386AFEF37F={InputName=AA53B2D6B93140E2A7BB64386AFEF37F}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:34,984 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: AA53B2D6B93140E2A7BB64386AFEF37F, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:34,984 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:34,984 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:34,985 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:34,985 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:34,987 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...D13CE4164BA4B9AC92A9D3984, applicationId=application_1452787294796_0001, dagName=[4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984
2016-01-14 16:01:34,988 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]. Starting root input initializers: 1
2016-01-14 16:01:34,989 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:34,989 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: AA53B2D6B93140E2A7BB64386AFEF37F on vertex vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:34,991 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:34,991 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input AA53B2D6B93140E2A7BB64386AFEF37F asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:34,992 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:34,992 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:34,995 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 422
2016-01-14 16:01:34,997 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: AA53B2D6B93140E2A7BB64386AFEF37F on vertex vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,001 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:35,001 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {AA53B2D6B93140E2A7BB64386AFEF37F=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:35,001 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] parallelism set to 1
2016-01-14 16:01:35,002 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:35,002 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787294796_0001_1_00, eventCount=1
2016-01-14 16:01:35,002 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,002 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=EDC008CB8A364CE9BD60B29A1895778C, vertexId=vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:35,003 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=EDC008CB8A364CE9BD60B29A1895778C, vertexId=vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,006 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(120)) - Using mapred newApiCommitter.
2016-01-14 16:01:35,008 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=EDC008CB8A364CE9BD60B29A1895778C, vertexName=B2250535EEB5466886B28F80EF4DDA04, outputCommitterClass=org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2016-01-14 16:01:35,008 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=EDC008CB8A364CE9BD60B29A1895778C, vertexId=vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,010 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:35,010 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, vertexId=vertex_1452787294796_0001_1_00, initRequestedTime=1452787294984, initedTime=1452787295010, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:35,011 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] with distanceFromRoot: 0
2016-01-14 16:01:35,011 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:35,011 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B2250535EEB5466886B28F80EF4DDA04
2016-01-14 16:01:35,012 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,012 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:35,013 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787294796_0001_1_00, startRequestedTime=1452787295011, startedTime=1452787295011
2016-01-14 16:01:35,013 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:35,014 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:35,014 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:TASK_STARTED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, taskId=task_1452787294796_0001_1_00_000000, scheduledTime=1452787295013, launchTime=1452787295013
2016-01-14 16:01:35,015 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294796_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:35,015 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,015 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984, VertexName: B2250535EEB5466886B28F80EF4DDA04, VertexParallelism: 1, TaskAttemptID:attempt_1452787294796_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=AA53B2D6B93140E2A7BB64386AFEF37F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=EDC008CB8A364CE9BD60B29A1895778C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:35,016 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294796_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:35,016 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:35,018 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:35,019 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:35,019 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:35,020 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787294796_0001_00_000001
2016-01-14 16:01:35,020 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:35,024 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787294796_0001_00_000001
2016-01-14 16:01:35,024 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:35,026 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:35,026 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:35,027 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787294796_0001_00_000001, launchTime=1452787295026
2016-01-14 16:01:35,028 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787294796_0001_00_000001
2016-01-14 16:01:35,029 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787294796_0001, with dag id: dag_1452787294796_0001_1
2016-01-14 16:01:35,029 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787294796_0001_1_00_000000_0] to container: [container_1452787294796_0001_00_000001]
2016-01-14 16:01:35,035 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:35,036 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787294796_0001_00_000001 given task: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,036 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787294796_0001_1_00_000000_0] started. Is using containerId: [container_1452787294796_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:35,037 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0, startTime=1452787295036, containerId=container_1452787294796_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787294796_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:35,037 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294796_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:35,037 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294796_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:35,037 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:35,036 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787294796_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35 Starting to run new task attempt: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,040 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,040 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,041 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:35,041 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:35,041 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:35,041 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:35,041 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:35,041 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86] pipe/(1/1) ...D13CE4164BA4B9AC92A9D3984, VertexName: B2250535EEB5466886B28F80EF4DDA04, VertexParallelism: 1, TaskAttemptID:attempt_1452787294796_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=AA53B2D6B93140E2A7BB64386AFEF37F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=EDC008CB8A364CE9BD60B29A1895778C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:35,042 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:35,046 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,046 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:35,046 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,047 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=AA53B2D6B93140E2A7BB64386AFEF37F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:35,048 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,051 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787294796_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:35,054 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:35,055 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=EDC008CB8A364CE9BD60B29A1895778C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:35,058 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:35,058 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: EDC008CB8A364CE9BD60B29A1895778C
2016-01-14 16:01:35,059 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:35,059 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: EDC008CB8A364CE9BD60B29A1895778C
2016-01-14 16:01:35,052 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:35,060 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,060 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,066 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:35,066 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,066 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,073 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B2250535EEB5466886B28F80EF4DDA04, ordinal: 0
2016-01-14 16:01:35,073 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B2250535EEB5466886B28F80EF4DDA04, mem on start (mb), free: 190, total: 397, max: 672
2016-01-14 16:01:35,074 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,074 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:35,074 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:35,078 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: true
2016-01-14 16:01:35,078 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: EDC008CB8A364CE9BD60B29A1895778C
2016-01-14 16:01:35,078 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:35,079 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:35,079 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:35,079 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:35,079 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:35,079 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:35,080 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:35,080 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:35,080 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, EDC008CB8A364CE9BD60B29A1895778C, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:35,080 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, AA53B2D6B93140E2A7BB64386AFEF37F, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:35,081 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:35,081 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,081 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:35,081 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,081 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: AA53B2D6B93140E2A7BB64386AFEF37F being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:35,082 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:35,082 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:35,082 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:35,083 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,086 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:35,087 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@752e57
2016-01-14 16:01:35,087 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 16:01:35,089 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"] streamed: true, id: AA53B2D6B93140E2A7BB64386AFEF37F
2016-01-14 16:01:35,091 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@752e57
2016-01-14 16:01:35,091 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]], id: EDC008CB8A364CE9BD60B29A1895778C
2016-01-14 16:01:35,091 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:35,092 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:35,093 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-01-14 16:01:35,096 INFO  tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"]
2016-01-14 16:01:35,105 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14527872947960_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14527872947960_0001_m_000000_0
2016-01-14 16:01:35,105 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 16:01:35,115 INFO  tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]
2016-01-14 16:01:35,126 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14527872947960_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14527872947960_0001_m_000000_0
2016-01-14 16:01:35,126 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 16:01:35,136 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 16:01:35,136 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:35,136 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B2250535EEB5466886B28F80EF4DDA04, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:35,141 INFO  io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/part-00000
2016-01-14 16:01:35,142 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14527872947960_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14527872947960_0001_m_000000_0
2016-01-14 16:01:35,146 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14527872947960_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-01-14 16:01:35,146 INFO  io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/part-00000
2016-01-14 16:01:35,147 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14527872947960_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14527872947960_0001_m_000000_0
2016-01-14 16:01:35,149 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14527872947960_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-01-14 16:01:35,149 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,150 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787294796_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:35,150 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:35,151 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:35,152 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,152 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B2250535EEB5466886B28F80EF4DDA04, mem on close (mb), free: 183, total: 397, max: 672
2016-01-14 16:01:35 Completed running task attempt: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,154 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:35,155 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787295136, Process_Duration=16, Process_End_Time=1452787295152, Read_Duration=2, Tuples_Read=13, Tuples_Written=13, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=13, Tuples_Written=13]]
2016-01-14 16:01:35,156 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:35,156 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:01:35,157 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,156 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, taskAttemptId=attempt_1452787294796_0001_1_00_000000_0, startTime=1452787295036, finishTime=1452787295155, timeTaken=119, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787295136, Process_Duration=16, Process_End_Time=1452787295152, Read_Duration=2, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 16:01:35,157 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787294796_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:35,157 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35,157 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:35,159 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:35,160 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:TASK_FINISHED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, taskId=task_1452787294796_0001_1_00_000000, startTime=1452787295036, finishTime=1452787295157, timeTaken=121, status=SUCCEEDED, successfulAttemptID=attempt_1452787294796_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787295136, Process_Duration=16, Process_End_Time=1452787295152, Read_Duration=2, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 16:01:35,160 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787294796_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:35,160 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] : 1
2016-01-14 16:01:35,160 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,163 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787294796_0001_00_000001
2016-01-14 16:01:35,164 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:35,164 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:VERTEX_FINISHED]: vertexName=B2250535EEB5466886B28F80EF4DDA04, vertexId=vertex_1452787294796_0001_1_00, initRequestedTime=1452787294984, initedTime=1452787295010, startRequestedTime=1452787295011, startedTime=1452787295011, finishTime=1452787295160, timeTaken=149, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787295136, Process_Duration=16, Process_End_Time=1452787295152, Read_Duration=2, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13, vertexStats=firstTaskStartTime=1452787295036, firstTasksToStart=[ task_1452787294796_0001_1_00_000000 ], lastTaskFinishTime=1452787295155, lastTasksToFinish=[ task_1452787294796_0001_1_00_000000 ], minTaskDuration=119, maxTaskDuration=119, avgTaskDuration=119.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787294796_0001_1_00_000000 ], longestDurationTasks=[ task_1452787294796_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:35,164 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:35,165 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:35,165 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787294796_0001_00_000001, stoppedTime=1452787295165, exitStatus=0
2016-01-14 16:01:35,165 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:35,165 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:35,165 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787294796_0001_1
2016-01-14 16:01:35,165 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:35,166 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787294796_0001_1
2016-01-14 16:01:35,166 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: EDC008CB8A364CE9BD60B29A1895778C for vertex: vertex_1452787294796_0001_1_00 [B2250535EEB5466886B28F80EF4DDA04]
2016-01-14 16:01:35,174 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787294796_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:35,174 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787294796_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:35,174 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787294796_0001_00_000001, Exiting
2016-01-14 16:01:35,175 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787294796_0001_00_000001
2016-01-14 16:01:35,175 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787294796_0001_00_000001
2016-01-14 16:01:35,177 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787294796_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:35,177 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787294796_0001_00_000001 completed successfully
2016-01-14 16:01:35,178 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787294796_0001_1, queueSize=0
2016-01-14 16:01:35,178 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787294796_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787294796_0001_1, startTime=1452787294983, finishTime=1452787295175, timeTaken=192, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=416808960, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787295136, Process_Duration=16, Process_End_Time=1452787295152, Read_Duration=2, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 16:01:35,179 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787294796_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:35,179 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:35,179 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787294796_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:35,179 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787294796_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:35 Completed Dag: dag_1452787294796_0001_1
2016-01-14 16:01:35,180 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787294796_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:35,180 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787294796_0001_1_post
2016-01-14 16:01:35,180 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787294796_0001_00_000001
2016-01-14 16:01:35,180 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,180 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:35,187 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...D13CE4164BA4B9AC92A9D3984, applicationId=application_1452787294796_0001
2016-01-14 16:01:35,191 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:35,191 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:35,192 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:35,192 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:35,192 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:35,192 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:35,193 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:35,193 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:35,194 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:35,194 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:35,194 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:35,195 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:35,195 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:35,199 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/4631615DFC92445983345440EF9926C1/FA61F30D521E4D3993B796DCA278FB86/.tez/application_1452787294796_0001
2016-01-14 16:01:35,199 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.430
2016-01-14 16:01:35,359 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-01-14 16:01:35,359 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-01-14 16:01:35,388 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:35,389 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:35,428 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 16:01:35,434 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:01:35,434 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:35,435 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:35,435 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:35,451 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 16:01:35,452 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header
2016-01-14 16:01:35,465 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:35,465 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:35,465 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-01-14 16:01:35,465 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 16:01:35,466 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 16:01:35,466 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 16:01:35,466 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...latform/testHeader/header
2016-01-14 16:01:35,467 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:35,482 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:35,488 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:35,488 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:35,489 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:35,498 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001 doesn't exist and is created
2016-01-14 16:01:35,546 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:35,546 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:35,547 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001
2016-01-14 16:01:35,551 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787295488_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:35,565 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:35,567 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:35,569 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:35,569 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:35,570 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001/localmode-log-dir
2016-01-14 16:01:35,571 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001/localmode-log-dir/history.txt.appattempt_1452787295488_0001_000000, maxErrors=10
2016-01-14 16:01:35,571 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:35,572 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787295488_0001_000000, appSubmitTime=1452787295550, launchTime=1452787295550
2016-01-14 16:01:35,576 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:35,578 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:35,579 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:48717
2016-01-14 16:01:35,579 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:35,582 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:35,583 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:35,585 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787295488_0001_000000, startTime=1452787295585
2016-01-14 16:01:35,585 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:35,586 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:35,646 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:35,647 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:35,647 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452787295488_0001, dagName=[3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header
2016-01-14 16:01:35,663 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header
2016-01-14 16:01:35,665 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787295488_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001/localmode-log-dir/dag_1452787295488_0001_1.dot
2016-01-14 16:01:35,666 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001/localmode-log-dir/dag_1452787295488_0001_1-tez-dag.pb.txt
2016-01-14 16:01:35,677 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787295488_0001_1
2016-01-14 16:01:35,677 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,677 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header
2016-01-14 16:01:35 Running Dag: dag_1452787295488_0001_1
2016-01-14 16:01:35,690 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:35,690 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787295488_0001_1, submitTime=1452787295664
2016-01-14 16:01:35,691 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BC6EEA7A30804E9FAF321D16153ADA4E
2016-01-14 16:01:35,691 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:35,691 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:35,693 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787295488_0001_1, initTime=1452787295690
2016-01-14 16:01:35,693 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295488_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:35,694 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:DAG_STARTED]: dagID=dag_1452787295488_0001_1, startTime=1452787295693
2016-01-14 16:01:35,694 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:35,694 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:35,694 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295488_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:35,694 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452787295488_0001, dagName=[3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header
2016-01-14 16:01:35,694 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BC6EEA7A30804E9FAF321D16153ADA4E : {768425A581BD4874995DAC2A4D27682A={InputName=768425A581BD4874995DAC2A4D27682A}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:35,695 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 768425A581BD4874995DAC2A4D27682A, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:35,695 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,695 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,695 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,695 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]. Starting root input initializers: 1
2016-01-14 16:01:35,696 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:35,696 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 768425A581BD4874995DAC2A4D27682A on vertex vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,699 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:35,699 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 768425A581BD4874995DAC2A4D27682A asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:35,700 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:35,700 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:35,702 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 16:01:35,703 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 768425A581BD4874995DAC2A4D27682A on vertex vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,704 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:35,704 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {768425A581BD4874995DAC2A4D27682A=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:35,704 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] parallelism set to 1
2016-01-14 16:01:35,704 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:35,705 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787295488_0001_1_00, eventCount=1
2016-01-14 16:01:35,705 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,705 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=B808F545BFD54C3EA75C51A0BE472269, vertexId=vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:35,705 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=B808F545BFD54C3EA75C51A0BE472269, vertexId=vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,707 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=B808F545BFD54C3EA75C51A0BE472269, vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:35,707 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=B808F545BFD54C3EA75C51A0BE472269, vertexId=vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,709 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:35,709 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, vertexId=vertex_1452787295488_0001_1_00, initRequestedTime=1452787295694, initedTime=1452787295708, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:35,709 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] with distanceFromRoot: 0
2016-01-14 16:01:35,709 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:35,709 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BC6EEA7A30804E9FAF321D16153ADA4E
2016-01-14 16:01:35,710 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,710 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:35,711 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787295488_0001_1_00, startRequestedTime=1452787295709, startedTime=1452787295709
2016-01-14 16:01:35,711 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:35,711 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:35,712 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:TASK_STARTED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, taskId=task_1452787295488_0001_1_00_000000, scheduledTime=1452787295711, launchTime=1452787295711
2016-01-14 16:01:35,712 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295488_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:35,712 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,712 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header, VertexName: BC6EEA7A30804E9FAF321D16153ADA4E, VertexParallelism: 1, TaskAttemptID:attempt_1452787295488_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=768425A581BD4874995DAC2A4D27682A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B808F545BFD54C3EA75C51A0BE472269, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:35,713 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295488_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:35,713 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:35,715 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:35,716 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787295488_0001, with dag id: dag_1452787295488_0001_1
2016-01-14 16:01:35,718 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:35,720 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:35,721 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787295488_0001_00_000001
2016-01-14 16:01:35,721 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:35,722 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787295488_0001_00_000001
2016-01-14 16:01:35,722 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:35,723 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:35,723 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787295488_0001_00_000001, launchTime=1452787295723
2016-01-14 16:01:35,723 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:35,724 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787295488_0001_00_000001
2016-01-14 16:01:35,725 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787295488_0001_1_00_000000_0] to container: [container_1452787295488_0001_00_000001]
2016-01-14 16:01:35,726 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:35,727 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787295488_0001_1_00_000000_0] started. Is using containerId: [container_1452787295488_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:35,727 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0, startTime=1452787295726, containerId=container_1452787295488_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787295488_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:35,727 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:35,727 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295488_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:35,727 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295488_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:35,728 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787295488_0001_00_000001 given task: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,728 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787295488_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35 Starting to run new task attempt: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,729 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,729 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,729 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:35,729 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:35,729 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:35,729 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:35,730 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:35,730 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737] pipe/(1/1) ...latform/testHeader/header, VertexName: BC6EEA7A30804E9FAF321D16153ADA4E, VertexParallelism: 1, TaskAttemptID:attempt_1452787295488_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=768425A581BD4874995DAC2A4D27682A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B808F545BFD54C3EA75C51A0BE472269, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:35,730 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:35,731 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,734 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:35,735 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,735 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787295488_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:35,736 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=768425A581BD4874995DAC2A4D27682A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:35,737 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:35,737 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,738 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,736 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,736 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=B808F545BFD54C3EA75C51A0BE472269, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:35,739 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:35,740 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: B808F545BFD54C3EA75C51A0BE472269
2016-01-14 16:01:35,740 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:35,740 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: B808F545BFD54C3EA75C51A0BE472269
2016-01-14 16:01:35,742 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:35,748 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:35,748 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,748 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,752 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BC6EEA7A30804E9FAF321D16153ADA4E, ordinal: 0
2016-01-14 16:01:35,752 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BC6EEA7A30804E9FAF321D16153ADA4E, mem on start (mb), free: 299, total: 369, max: 672
2016-01-14 16:01:35,752 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:35,752 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:35,752 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:35,754 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:35,754 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: B808F545BFD54C3EA75C51A0BE472269
2016-01-14 16:01:35,754 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:35,754 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:35,755 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:35,755 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:35,755 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:35,755 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:35,755 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:35,755 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:35,755 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 768425A581BD4874995DAC2A4D27682A, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:35,756 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, B808F545BFD54C3EA75C51A0BE472269, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:35,756 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:35,756 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 768425A581BD4874995DAC2A4D27682A being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:35,756 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:35,756 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:35,757 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,757 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:35,757 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,757 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:35,757 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,758 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:35,760 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5c929b4a
2016-01-14 16:01:35,761 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:35,761 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 768425A581BD4874995DAC2A4D27682A
2016-01-14 16:01:35,761 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"], id: B808F545BFD54C3EA75C51A0BE472269
2016-01-14 16:01:35,762 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-01-14 16:01:35,762 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 16:01:35,762 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:35,762 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5c929b4a
2016-01-14 16:01:35,763 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:35,763 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:35,763 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BC6EEA7A30804E9FAF321D16153ADA4E, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:35,766 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:35,766 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:35,767 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,767 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787295488_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:35,768 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,769 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BC6EEA7A30804E9FAF321D16153ADA4E, mem on close (mb), free: 297, total: 369, max: 672
2016-01-14 16:01:35 Completed running task attempt: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,770 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:01:35,771 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452787295764, Process_Duration=4, Process_End_Time=1452787295768, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-01-14 16:01:35,772 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:35,771 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, taskAttemptId=attempt_1452787295488_0001_1_00_000000_0, startTime=1452787295726, finishTime=1452787295771, timeTaken=45, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787295764, Process_Duration=4, Process_End_Time=1452787295768, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:35,772 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295488_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:01:35,772 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35,773 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:35,773 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:TASK_FINISHED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, taskId=task_1452787295488_0001_1_00_000000, startTime=1452787295726, finishTime=1452787295773, timeTaken=47, status=SUCCEEDED, successfulAttemptID=attempt_1452787295488_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787295764, Process_Duration=4, Process_End_Time=1452787295768, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:35,773 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295488_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:01:35,774 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] : 1
2016-01-14 16:01:35,774 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,774 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:01:35,774 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,776 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:35,777 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787295488_0001_00_000001
2016-01-14 16:01:35,777 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:35,777 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:VERTEX_FINISHED]: vertexName=BC6EEA7A30804E9FAF321D16153ADA4E, vertexId=vertex_1452787295488_0001_1_00, initRequestedTime=1452787295694, initedTime=1452787295708, startRequestedTime=1452787295709, startedTime=1452787295709, finishTime=1452787295774, timeTaken=65, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787295764, Process_Duration=4, Process_End_Time=1452787295768, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1452787295726, firstTasksToStart=[ task_1452787295488_0001_1_00_000000 ], lastTaskFinishTime=1452787295771, lastTasksToFinish=[ task_1452787295488_0001_1_00_000000 ], minTaskDuration=45, maxTaskDuration=45, avgTaskDuration=45.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787295488_0001_1_00_000000 ], longestDurationTasks=[ task_1452787295488_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:01:35,778 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:01:35,778 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:01:35,778 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787295488_0001_00_000001, stoppedTime=1452787295778, exitStatus=0
2016-01-14 16:01:35,778 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:35,778 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:01:35,779 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787295488_0001_1
2016-01-14 16:01:35,779 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787295488_0001_1
2016-01-14 16:01:35,779 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: B808F545BFD54C3EA75C51A0BE472269 for vertex: vertex_1452787295488_0001_1_00 [BC6EEA7A30804E9FAF321D16153ADA4E]
2016-01-14 16:01:35,779 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:35,788 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787295488_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:01:35,788 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787295488_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:01:35,789 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787295488_0001_00_000001, Exiting
2016-01-14 16:01:35,789 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787295488_0001_00_000001
2016-01-14 16:01:35,789 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787295488_0001_00_000001
2016-01-14 16:01:35,791 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787295488_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:01:35,792 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787295488_0001_00_000001 completed successfully
2016-01-14 16:01:35,793 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787295488_0001_1, queueSize=0
2016-01-14 16:01:35,793 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:35,794 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295488_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787295488_0001_1, startTime=1452787295693, finishTime=1452787295789, timeTaken=96, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452787295764, Process_Duration=4, Process_End_Time=1452787295768, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 16:01:35,795 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787295488_0001_1 finished with state: SUCCEEDED
2016-01-14 16:01:35,795 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295488_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:35,796 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787295488_0001_00_000001
2016-01-14 16:01:35,796 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295488_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:35 Completed Dag: dag_1452787295488_0001_1
2016-01-14 16:01:35,798 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787295488_0001_1, dagState=SUCCEEDED
2016-01-14 16:01:35,798 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787295488_0001_1_post
2016-01-14 16:01:35,798 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:35,800 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:35,803 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452787295488_0001
2016-01-14 16:01:35,807 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:35,807 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:35,807 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:35,807 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:35,808 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:35,808 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:35,808 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:35,809 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:35,810 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:35,810 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:35,811 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:35,811 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:35,811 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:35,815 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3882705E68694CC6AF0A9EC912069C79/A12D116B70384565AB8867D584D56737/.tez/application_1452787295488_0001
2016-01-14 16:01:35,816 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.350
2016-01-14 16:01:35,853 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeader/header
2016-01-14 16:01:35,881 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:01:35,881 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:01:35,929 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 16:01:35,941 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 16:01:35,941 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:35,942 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:01:35,942 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:01:35,956 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt
2016-01-14 16:01:35,957 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic
2016-01-14 16:01:35,966 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 16:01:35,966 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 16:01:35,966 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-01-14 16:01:35,966 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 16:01:35,966 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 16:01:35,967 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 16:01:35,967 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...t/strict-nondeterministic
2016-01-14 16:01:35,968 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:01:35,979 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 16:01:35,984 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:35,985 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:01:35,985 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:01:35,994 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001 doesn't exist and is created
2016-01-14 16:01:35,995 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:01:35,995 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:01:36,013 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:01:36,013 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:01:36,013 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001
2016-01-14 16:01:36,017 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787295984_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:01:36,027 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:01:36,028 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:01:36,030 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:01:36,030 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:01:36,030 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001/localmode-log-dir
2016-01-14 16:01:36,030 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001/localmode-log-dir/history.txt.appattempt_1452787295984_0001_000000, maxErrors=10
2016-01-14 16:01:36,030 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:01:36,031 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787295984_0001_000000, appSubmitTime=1452787296016, launchTime=1452787296016
2016-01-14 16:01:36,036 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:01:36,036 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:01:36,037 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:55754
2016-01-14 16:01:36,039 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:01:36,039 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:01:36,040 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:01:36,043 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787295984_0001_000000, startTime=1452787296043
2016-01-14 16:01:36,043 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:01:36,043 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:01:36,113 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:01:36,113 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:01:36,114 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452787295984_0001, dagName=[24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 16:01:36,131 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 16:01:36,133 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787295984_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001/localmode-log-dir/dag_1452787295984_0001_1.dot
2016-01-14 16:01:36,133 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001/localmode-log-dir/dag_1452787295984_0001_1-tez-dag.pb.txt
2016-01-14 16:01:36,140 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787295984_0001_1
2016-01-14 16:01:36,141 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:36,141 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 16:01:36 Running Dag: dag_1452787295984_0001_1
2016-01-14 16:01:36,152 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:01:36,153 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787295984_0001_1, submitTime=1452787296131
2016-01-14 16:01:36,153 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D723D02604724632A33EC1CFB80A47C0
2016-01-14 16:01:36,154 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:01:36,154 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:01:36,154 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787295984_0001_1, initTime=1452787296153
2016-01-14 16:01:36,155 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295984_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:01:36,156 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:DAG_STARTED]: dagID=dag_1452787295984_0001_1, startTime=1452787296155
2016-01-14 16:01:36,156 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:01:36,156 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295984_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:01:36,156 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:01:36,156 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D723D02604724632A33EC1CFB80A47C0 : {1D80025A53DA49D3BE248FB829C50EE2={InputName=1D80025A53DA49D3BE248FB829C50EE2}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:01:36,156 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452787295984_0001, dagName=[24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 16:01:36,156 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 1D80025A53DA49D3BE248FB829C50EE2, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:01:36,157 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,157 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,157 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,157 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]. Starting root input initializers: 1
2016-01-14 16:01:36,158 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:01:36,158 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 1D80025A53DA49D3BE248FB829C50EE2 on vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,160 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:01:36,161 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 1D80025A53DA49D3BE248FB829C50EE2 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:01:36,161 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:01:36,162 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:01:36,164 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 432
2016-01-14 16:01:36,165 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 1D80025A53DA49D3BE248FB829C50EE2 on vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,165 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:36,165 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {1D80025A53DA49D3BE248FB829C50EE2=forAllWorkUnits=true, update=[1]}
2016-01-14 16:01:36,165 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] parallelism set to 1
2016-01-14 16:01:36,165 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:01:36,166 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787295984_0001_1_00, eventCount=1
2016-01-14 16:01:36,166 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,166 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=A7CBD319387F4BE08DBF72F111710C37, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:01:36,167 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=A7CBD319387F4BE08DBF72F111710C37, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,168 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=A7CBD319387F4BE08DBF72F111710C37, vertexName=D723D02604724632A33EC1CFB80A47C0, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:01:36,169 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=A7CBD319387F4BE08DBF72F111710C37, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,170 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D723D02604724632A33EC1CFB80A47C0, vertexId=vertex_1452787295984_0001_1_00, initRequestedTime=1452787296156, initedTime=1452787296170, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:01:36,171 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] with distanceFromRoot: 0
2016-01-14 16:01:36,171 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:01:36,170 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:01:36,171 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D723D02604724632A33EC1CFB80A47C0
2016-01-14 16:01:36,172 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,172 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787295984_0001_1_00, startRequestedTime=1452787296171, startedTime=1452787296171
2016-01-14 16:01:36,172 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:01:36,172 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:01:36,173 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:01:36,173 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:TASK_STARTED]: vertexName=D723D02604724632A33EC1CFB80A47C0, taskId=task_1452787295984_0001_1_00_000000, scheduledTime=1452787296173, launchTime=1452787296173
2016-01-14 16:01:36,173 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295984_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:01:36,174 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,174 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic, VertexName: D723D02604724632A33EC1CFB80A47C0, VertexParallelism: 1, TaskAttemptID:attempt_1452787295984_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1D80025A53DA49D3BE248FB829C50EE2, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A7CBD319387F4BE08DBF72F111710C37, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:36,174 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295984_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:01:36,175 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:01:36,175 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452787295984_0001, with dag id: dag_1452787295984_0001_1
2016-01-14 16:01:36,175 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:01:36,177 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:01:36,177 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:01:36,177 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787295984_0001_00_000001
2016-01-14 16:01:36,178 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295984_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:01:36,181 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787295984_0001_00_000001
2016-01-14 16:01:36,181 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:01:36,183 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:01:36,183 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787295984_0001_00_000001, launchTime=1452787296182
2016-01-14 16:01:36,183 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787295984_0001_00_000001
2016-01-14 16:01:36,184 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295984_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:01:36,186 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787295984_0001_1_00_000000_0] to container: [container_1452787295984_0001_00_000001]
2016-01-14 16:01:36,186 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295984_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:01:36,187 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787295984_0001_1_00_000000_0] started. Is using containerId: [container_1452787295984_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:01:36,187 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D723D02604724632A33EC1CFB80A47C0, taskAttemptId=attempt_1452787295984_0001_1_00_000000_0, startTime=1452787296187, containerId=container_1452787295984_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787295984_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:01:36,188 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:01:36,188 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295984_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:01:36,188 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295984_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:01:36,189 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787295984_0001_00_000001 given task: attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,189 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787295984_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36 Starting to run new task attempt: attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,190 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,190 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:36,190 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:01:36,190 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:01:36,190 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:01:36,190 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:01:36,190 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:01:36,191 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF] pipe/(1/1) ...t/strict-nondeterministic, VertexName: D723D02604724632A33EC1CFB80A47C0, VertexParallelism: 1, TaskAttemptID:attempt_1452787295984_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1D80025A53DA49D3BE248FB829C50EE2, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A7CBD319387F4BE08DBF72F111710C37, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:01:36,191 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:01:36,192 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,192 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:01:36,193 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:36,193 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787295984_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:01:36,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=1D80025A53DA49D3BE248FB829C50EE2, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:01:36,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=A7CBD319387F4BE08DBF72F111710C37, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:01:36,195 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:01:36,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:36,195 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:01:36,196 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: A7CBD319387F4BE08DBF72F111710C37
2016-01-14 16:01:36,196 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:01:36,196 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: A7CBD319387F4BE08DBF72F111710C37
2016-01-14 16:01:36,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,198 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,199 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:01:36,205 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:01:36,205 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,205 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,209 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D723D02604724632A33EC1CFB80A47C0, ordinal: 0
2016-01-14 16:01:36,209 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D723D02604724632A33EC1CFB80A47C0, mem on start (mb), free: 231, total: 369, max: 672
2016-01-14 16:01:36,209 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:01:36,210 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:01:36,210 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:01:36,215 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:01:36,215 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: A7CBD319387F4BE08DBF72F111710C37
2016-01-14 16:01:36,216 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:01:36,216 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:01:36,216 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:01:36,216 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:36,216 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:01:36,216 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:01:36,217 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:01:36,217 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:01:36,217 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, A7CBD319387F4BE08DBF72F111710C37, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:01:36,217 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 1D80025A53DA49D3BE248FB829C50EE2, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:01:36,218 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:01:36,218 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 1D80025A53DA49D3BE248FB829C50EE2 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:01:36,218 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,218 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:36,218 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,218 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:01:36,219 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:01:36,219 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:01:36,219 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,220 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:01:36,220 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@363fb96b
2016-01-14 16:01:36,221 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@363fb96b
2016-01-14 16:01:36,222 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:01:36,222 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:01:36,222 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 16:01:36,223 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"] streamed: true, id: 1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,223 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"], id: A7CBD319387F4BE08DBF72F111710C37
2016-01-14 16:01:36,223 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-01-14 16:01:36,224 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 16:01:36,224 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:01:36,224 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D723D02604724632A33EC1CFB80A47C0, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:01:36,228 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
2016-01-14 16:01:36,230 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
2016-01-14 16:01:36,231 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:01:36,231 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:01:36,232 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36,232 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787295984_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:01:36,233 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787295984_0001_1_00_000000_0
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
2016-01-14 16:01:36,240 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=135, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6][cascading.flow.SliceCounters Process_Begin_Time=1452787296224, Process_Duration=9, Process_End_Time=1452787296233, Read_Duration=0, Tuples_Read=6, Tuples_Written=6, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=6, Tuples_Written=6]]
2016-01-14 16:01:36,240 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D723D02604724632A33EC1CFB80A47C0, mem on close (mb), free: 229, total: 369, max: 672
2016-01-14 16:01:36,241 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=D723D02604724632A33EC1CFB80A47C0, index=0
2016-01-14 16:01:36,241 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:01:36,242 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D723D02604724632A33EC1CFB80A47C0, taskAttemptId=attempt_1452787295984_0001_1_00_000000_0, startTime=1452787296187, finishTime=1452787296239, timeTaken=52, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=135, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=387448832, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6, cascading.flow.SliceCounters, Process_Begin_Time=1452787296224, Process_Duration=9, Process_End_Time=1452787296233, Read_Duration=0, Tuples_Read=6, Tuples_Written=6, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=6, Tuples_Written=6
2016-01-14 16:01:36,242 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295984_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:01:36,243 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787295984_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:01:36,243 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:TASK_FINISHED]: vertexName=D723D02604724632A33EC1CFB80A47C0, taskId=task_1452787295984_0001_1_00_000000, startTime=1452787296187, finishTime=1452787296243, timeTaken=56, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
], counters=Counters: 0
2016-01-14 16:01:36,243 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=D723D02604724632A33EC1CFB80A47C0, sourceVertex=1D80025A53DA49D3BE248FB829C50EE2
2016-01-14 16:01:36,243 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787295984_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:01:36,243 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:01:36,244 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] : 1
2016-01-14 16:01:36,244 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] because task failed: task_1452787295984_0001_1_00_000000
2016-01-14 16:01:36,243 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=D723D02604724632A33EC1CFB80A47C0, sourceVertex=A7CBD319387F4BE08DBF72F111710C37
2016-01-14 16:01:36,243 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:01:36,246 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:01:36,246 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:01:36,246 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,247 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=A7CBD319387F4BE08DBF72F111710C37, vertexId=vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,247 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787295984_0001_00_000001
2016-01-14 16:01:36,250 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787295984_0001_00_000001
2016-01-14 16:01:36,255 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787295984_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:01:36,255 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787295984_0001_00_000001 completed but with errors
2016-01-14 16:01:36,257 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:01:36,257 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:VERTEX_FINISHED]: vertexName=D723D02604724632A33EC1CFB80A47C0, vertexId=vertex_1452787295984_0001_1_00, initRequestedTime=1452787296156, initedTime=1452787296170, startRequestedTime=1452787296171, startedTime=1452787296171, finishTime=1452787296256, timeTaken=85, status=FAILED, diagnostics=Task failed, taskId=task_1452787295984_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787296187, firstTasksToStart=[ task_1452787295984_0001_1_00_000000 ], lastTaskFinishTime=1452787296239, lastTasksToFinish=[ task_1452787295984_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:01:36,258 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:01:36,261 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787295984_0001_00_000001, stoppedTime=1452787296261, exitStatus=0
2016-01-14 16:01:36,261 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:01:36,261 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295984_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:01:36,262 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787295984_0001_1_00_000000_0 failed: true container: container_1452787295984_0001_00_000001 numFailedTAs: 0
2016-01-14 16:01:36,264 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:01:36,264 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:01:36,264 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787295984_0001_1
2016-01-14 16:01:36,265 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: A7CBD319387F4BE08DBF72F111710C37 for vertex: vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0]
2016-01-14 16:01:36,267 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787295984_0001_1, queueSize=0
2016-01-14 16:01:36,267 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:01:36,267 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787295984_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787295984_0001_1, startTime=1452787296155, finishTime=1452787296266, timeTaken=111, status=FAILED, diagnostics=Vertex failed, vertexName=D723D02604724632A33EC1CFB80A47C0, vertexId=vertex_1452787295984_0001_1_00, diagnostics=[Task failed, taskId=task_1452787295984_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787295984_0001_1_00 [D723D02604724632A33EC1CFB80A47C0] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:01:36,273 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787295984_0001_1 finished with state: FAILED
2016-01-14 16:01:36,273 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787295984_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:01:36,274 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452787295984_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:01:36,274 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787295984_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:01:36,275 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787295984_0001_00_000001
2016-01-14 16:01:36 Completed Dag: dag_1452787295984_0001_1
2016-01-14 16:01:36,276 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787295984_0001_1, dagState=FAILED
2016-01-14 16:01:36,276 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787295984_0001_1_post
2016-01-14 16:01:36,276 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:01:36,277 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:01:36,277 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787295984_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:01:36,279 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452787295984_0001
2016-01-14 16:01:36,281 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:01:36,282 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:01:36,282 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:01:36,282 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:01:36,282 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:01:36,283 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:01:36,283 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:01:36,283 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:01:36,283 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:01:36,283 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:01:36,284 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:01:36,284 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:01:36,284 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:01:36,290 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/24D9BA7AA6DE446D95D3B7C7ABEE1690/E9F92D834CD8487CBD6E6D1855D129FF/.tez/application_1452787295984_0001
2016-01-14 16:01:36,291 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopping all jobs
2016-01-14 16:01:36,291 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopping: (1/1) ...t/strict-nondeterministic
2016-01-14 16:01:36,292 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopped all jobs
2016-01-14 16:01:36,293 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.327
2016-01-14 16:01:36,293 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic

Standard error

2016-01-14 16:01:30 Running Dag: dag_1452787289312_0001_1
2016-01-14 16:01:30 Starting to run new task attempt: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30 Completed running task attempt: attempt_1452787289312_0001_1_00_000000_0
2016-01-14 16:01:30 Completed Dag: dag_1452787289312_0001_1
2016-01-14 16:01:31 Running Dag: dag_1452787291366_0001_1
2016-01-14 16:01:31 Starting to run new task attempt: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31 Completed running task attempt: attempt_1452787291366_0001_1_00_000000_0
2016-01-14 16:01:31 Completed Dag: dag_1452787291366_0001_1
2016-01-14 16:01:32 Running Dag: dag_1452787292131_0001_1
2016-01-14 16:01:32 Starting to run new task attempt: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32 Completed running task attempt: attempt_1452787292131_0001_1_00_000000_0
2016-01-14 16:01:32 Completed Dag: dag_1452787292131_0001_1
2016-01-14 16:01:32 Running Dag: dag_1452787292802_0001_1
2016-01-14 16:01:33 Starting to run new task attempt: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33 Completed running task attempt: attempt_1452787292802_0001_1_00_000000_0
2016-01-14 16:01:33 Completed Dag: dag_1452787292802_0001_1
2016-01-14 16:01:33 Running Dag: dag_1452787293381_0001_1
2016-01-14 16:01:33 Starting to run new task attempt: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33 Completed running task attempt: attempt_1452787293381_0001_1_00_000000_0
2016-01-14 16:01:33 Completed Dag: dag_1452787293381_0001_1
2016-01-14 16:01:34 Running Dag: dag_1452787294120_0001_1
2016-01-14 16:01:34 Starting to run new task attempt: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34 Completed running task attempt: attempt_1452787294120_0001_1_00_000000_0
2016-01-14 16:01:34 Completed Dag: dag_1452787294120_0001_1
2016-01-14 16:01:34 Running Dag: dag_1452787294796_0001_1
2016-01-14 16:01:35 Starting to run new task attempt: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35 Completed running task attempt: attempt_1452787294796_0001_1_00_000000_0
2016-01-14 16:01:35 Completed Dag: dag_1452787294796_0001_1
2016-01-14 16:01:35 Running Dag: dag_1452787295488_0001_1
2016-01-14 16:01:35 Starting to run new task attempt: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35 Completed running task attempt: attempt_1452787295488_0001_1_00_000000_0
2016-01-14 16:01:35 Completed Dag: dag_1452787295488_0001_1
2016-01-14 16:01:36 Running Dag: dag_1452787295984_0001_1
2016-01-14 16:01:36 Starting to run new task attempt: attempt_1452787295984_0001_1_00_000000_0
2016-01-14 16:01:36 Completed Dag: dag_1452787295984_0001_1