Class cascading.scheme.TextDelimitedPlatformTest

9

tests

0

failures

0

ignored

8.597s

duration

100%

successful

Tests

Test Duration Result
testFieldCoercion 0.876s passed
testHeader 0.454s passed
testHeaderAll 0.527s passed
testHeaderFieldsAll 0.689s passed
testQuotedText 0.559s passed
testQuotedTextAll 0.759s passed
testQuotedTextSpecChar 3.583s passed
testQuotedTextSpecCharAll 0.712s passed
testStrict 0.438s passed

Standard output

2016-01-14 17:10:02,764 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 17:10:02,788 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.scheme.TextDelimitedPlatformTest, with platform: hadoop2-tez
2016-01-14 17:10:02,815 INFO  tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-01-14 17:10:03,174 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 17:10:03,514 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-14 17:10:03,695 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:10:03,696 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:10:03,783 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 0AA1D345DC8A403285FA4A8391DE5EC0
2016-01-14 17:10:03,987 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.070
2016-01-14 17:10:03,998 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.083
2016-01-14 17:10:03,999 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:03,999 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:04,001 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:10:04,131 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-01-14 17:10:04,134 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-01-14 17:10:04,366 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 17:10:04,368 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 17:10:04,369 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 17:10:04,370 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-01-14 17:10:04,372 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 17:10:04,372 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 17:10:04,372 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 17:10:04,374 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...Char/quoted/speccharfalse
2016-01-14 17:10:04,374 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:10:04,404 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 17:10:04,578 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:04,584 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:10:04,585 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:10:04,625 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068/.tez/application_1452791404584_0001 doesn't exist and is created
2016-01-14 17:10:04,694 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:10:04,694 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:04,695 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068/.tez/application_1452791404584_0001
2016-01-14 17:10:04,728 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452791404584_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:04,767 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:10:04,782 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:10:04,795 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-01-14 17:10:04,795 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-01-14 17:10:04,795 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:04,809 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:10:04,814 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:10:04,819 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068/.tez/application_1452791404584_0001/localmode-log-dir
2016-01-14 17:10:04,819 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068/.tez/application_1452791404584_0001/localmode-log-dir/history.txt.appattempt_1452791404584_0001_000000, maxErrors=10
2016-01-14 17:10:04,820 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:10:04,822 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452791404584_0001_000000, appSubmitTime=1452791404713, launchTime=1452791404727
2016-01-14 17:10:04,829 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:10:04,829 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:10:04,832 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:10:04,833 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:10:04,890 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:50454
2016-01-14 17:10:04,896 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 17:10:04,896 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 17:10:04,896 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:04,929 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:10:04,995 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:10:04,996 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452791404584_0001_000000, startTime=1452791404995
2016-01-14 17:10:04,996 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 17:10:04,997 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 17:10:04,997 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:04,997 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:10:05,097 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:10:05,113 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:10:05,114 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452791404584_0001, dagName=[D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 17:10:05,332 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 17:10:05,426 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452791404584_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068/.tez/application_1452791404584_0001/localmode-log-dir/dag_1452791404584_0001_1.dot
2016-01-14 17:10:05,429 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068/.tez/application_1452791404584_0001/localmode-log-dir/dag_1452791404584_0001_1-tez-dag.pb.txt
2016-01-14 17:10:05,538 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791404584_0001_1
2016-01-14 17:10:05,538 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:05,539 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 17:10:05 Running Dag: dag_1452791404584_0001_1
2016-01-14 17:10:05,570 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:10:05,570 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452791404584_0001_1, submitTime=1452791405332
2016-01-14 17:10:05,610 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F533247B014B41248F6E783173171B5C
2016-01-14 17:10:05,613 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:10:05,617 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:10:05,619 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452791404584_0001_1, initTime=1452791405572
2016-01-14 17:10:05,619 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791404584_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:10:05,621 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:10:05,621 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:DAG_STARTED]: dagID=dag_1452791404584_0001_1, startTime=1452791405620
2016-01-14 17:10:05,622 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:10:05,623 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791404584_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:10:05,624 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F533247B014B41248F6E783173171B5C : {A43BF3B62D9A495CB75609E2466FE55C={InputName=A43BF3B62D9A495CB75609E2466FE55C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:10:05,624 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: A43BF3B62D9A495CB75609E2466FE55C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:10:05,624 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:05,631 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452791404584_0001, dagName=[D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068] pipe/(1/1) ...Char/quoted/speccharfalse
2016-01-14 17:10:05,636 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:05,637 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:05,639 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]. Starting root input initializers: 1
2016-01-14 17:10:05,655 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: A43BF3B62D9A495CB75609E2466FE55C on vertex vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:05,665 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:10:05,670 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452791404584_0001, with dag id: dag_1452791404584_0001_1
2016-01-14 17:10:05,679 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:10:05,681 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input A43BF3B62D9A495CB75609E2466FE55C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:10:05,682 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:10:05,682 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:10:05,740 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-01-14 17:10:05,743 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: A43BF3B62D9A495CB75609E2466FE55C on vertex vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:05,744 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:05,744 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {A43BF3B62D9A495CB75609E2466FE55C=forAllWorkUnits=true, update=[1]}
2016-01-14 17:10:05,758 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C] parallelism set to 1
2016-01-14 17:10:05,758 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:05,769 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452791404584_0001_1_00, eventCount=1
2016-01-14 17:10:05,772 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:05,772 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=1BF34DD7703F4D54AC7FD9C203F040DB, vertexId=vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:10:05,777 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=1BF34DD7703F4D54AC7FD9C203F040DB, vertexId=vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:05,796 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=1BF34DD7703F4D54AC7FD9C203F040DB, vertexName=F533247B014B41248F6E783173171B5C, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:10:05,804 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=1BF34DD7703F4D54AC7FD9C203F040DB, vertexId=vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:05,808 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:10:05,808 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F533247B014B41248F6E783173171B5C, vertexId=vertex_1452791404584_0001_1_00, initRequestedTime=1452791405624, initedTime=1452791405807, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:10:05,809 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C] with distanceFromRoot: 0
2016-01-14 17:10:05,809 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:10:05,813 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F533247B014B41248F6E783173171B5C
2016-01-14 17:10:05,813 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:05,815 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:10:05,815 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452791404584_0001_1_00, startRequestedTime=1452791405812, startedTime=1452791405812
2016-01-14 17:10:05,817 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:10:05,839 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:10:05,839 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:TASK_STARTED]: vertexName=F533247B014B41248F6E783173171B5C, taskId=task_1452791404584_0001_1_00_000000, scheduledTime=1452791405838, launchTime=1452791405838
2016-01-14 17:10:05,840 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791404584_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:10:05,843 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:05,845 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: F533247B014B41248F6E783173171B5C, VertexParallelism: 1, TaskAttemptID:attempt_1452791404584_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A43BF3B62D9A495CB75609E2466FE55C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1BF34DD7703F4D54AC7FD9C203F040DB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:05,848 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791404584_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:10:05,848 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:10:05,889 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:10:05,892 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:10:05,893 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:10:05,897 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452791404584_0001_00_000001
2016-01-14 17:10:05,897 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791404584_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:10:05,907 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452791404584_0001_00_000001
2016-01-14 17:10:05,907 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:10:05,912 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791404584_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:10:05,912 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:10:05,913 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452791404584_0001_00_000001, launchTime=1452791405912
2016-01-14 17:10:05,915 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791404584_0001_00_000001
2016-01-14 17:10:05,919 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452791404584_0001_1_00_000000_0] to container: [container_1452791404584_0001_00_000001]
2016-01-14 17:10:05,919 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791404584_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:10:05,921 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452791404584_0001_00_000001 given task: attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:05,921 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791404584_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:05,922 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452791404584_0001_1_00_000000_0] started. Is using containerId: [container_1452791404584_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:10:05 Starting to run new task attempt: attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:05,922 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:05,922 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:05,923 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:10:05,923 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F533247B014B41248F6E783173171B5C, taskAttemptId=attempt_1452791404584_0001_1_00_000000_0, startTime=1452791405920, containerId=container_1452791404584_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452791404584_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:10:05,926 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791404584_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:10:05,926 INFO  counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters:  GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-01-14 17:10:05,928 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:10:05,928 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:10:05,929 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:10:05,930 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791404584_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:10:05,931 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:10:05,960 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:10:05,960 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068] pipe/(1/1) ...Char/quoted/speccharfalse, VertexName: F533247B014B41248F6E783173171B5C, VertexParallelism: 1, TaskAttemptID:attempt_1452791404584_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A43BF3B62D9A495CB75609E2466FE55C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1BF34DD7703F4D54AC7FD9C203F040DB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:05,962 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:10:05,969 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:05,969 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:10:05,969 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:05,971 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452791404584_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:10:05,975 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=A43BF3B62D9A495CB75609E2466FE55C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:10:05,976 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:05,976 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=1BF34DD7703F4D54AC7FD9C203F040DB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:10:05,977 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:10:05,978 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: A43BF3B62D9A495CB75609E2466FE55C
2016-01-14 17:10:05,978 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:10:05,978 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 1BF34DD7703F4D54AC7FD9C203F040DB
2016-01-14 17:10:05,978 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:10:05,989 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 1BF34DD7703F4D54AC7FD9C203F040DB
2016-01-14 17:10:05,989 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: A43BF3B62D9A495CB75609E2466FE55C
2016-01-14 17:10:06,015 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:10:06,016 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: A43BF3B62D9A495CB75609E2466FE55C
2016-01-14 17:10:06,016 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: A43BF3B62D9A495CB75609E2466FE55C
2016-01-14 17:10:06,019 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:10:06,035 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F533247B014B41248F6E783173171B5C, ordinal: 0
2016-01-14 17:10:06,036 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F533247B014B41248F6E783173171B5C, mem on start (mb), free: 164, total: 223, max: 672
2016-01-14 17:10:06,036 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:06,036 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:10:06,036 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:10:06,042 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:10:06,042 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 1BF34DD7703F4D54AC7FD9C203F040DB
2016-01-14 17:10:06,042 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:10:06,043 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:10:06,052 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:10:06,053 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:06,053 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:10:06,053 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:06,053 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:10:06,054 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:10:06,054 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 1BF34DD7703F4D54AC7FD9C203F040DB, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:10:06,054 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, A43BF3B62D9A495CB75609E2466FE55C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:10:06,054 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:10:06,055 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: A43BF3B62D9A495CB75609E2466FE55C
2016-01-14 17:10:06,055 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:06,055 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: A43BF3B62D9A495CB75609E2466FE55C
2016-01-14 17:10:06,056 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: A43BF3B62D9A495CB75609E2466FE55C being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:10:06,056 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:10:06,056 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:10:06,056 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:10:06,058 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:06,060 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:10:06,065 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5e78d934
2016-01-14 17:10:06,073 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5e78d934
2016-01-14 17:10:06,074 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:10:06,074 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:10:06,090 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 17:10:06,094 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: A43BF3B62D9A495CB75609E2466FE55C
2016-01-14 17:10:06,095 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"], id: 1BF34DD7703F4D54AC7FD9C203F040DB
2016-01-14 17:10:06,095 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse"]
2016-01-14 17:10:06,099 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 17:10:06,099 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:06,102 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F533247B014B41248F6E783173171B5C, all 1 inputs ready in: 00:00:00.002
2016-01-14 17:10:06,113 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:10:06,114 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:10:06,115 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:06,115 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452791404584_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:10:06,116 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:06,116 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F533247B014B41248F6E783173171B5C, mem on close (mb), free: 158, total: 223, max: 672
2016-01-14 17:10:06 Completed running task attempt: attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:06,122 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452791404584_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:10:06,127 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=233832448, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452791406102, Process_Duration=14, Process_End_Time=1452791406116, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 17:10:06,128 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:10:06,128 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:06,127 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:10:06,129 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791404584_0001_00_000001
2016-01-14 17:10:06,132 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F533247B014B41248F6E783173171B5C, taskAttemptId=attempt_1452791404584_0001_1_00_000000_0, startTime=1452791405920, finishTime=1452791406124, timeTaken=204, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=233832448, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791406102, Process_Duration=14, Process_End_Time=1452791406116, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:06,135 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791404584_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:10:06,135 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:10:06,138 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:06,141 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:TASK_FINISHED]: vertexName=F533247B014B41248F6E783173171B5C, taskId=task_1452791404584_0001_1_00_000000, startTime=1452791405920, finishTime=1452791406139, timeTaken=219, status=SUCCEEDED, successfulAttemptID=attempt_1452791404584_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=233832448, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791406102, Process_Duration=14, Process_End_Time=1452791406116, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:06,144 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791404584_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:10:06,145 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791404584_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:10:06,146 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:10:06,149 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C] : 1
2016-01-14 17:10:06,149 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:06,160 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:10:06,163 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:VERTEX_FINISHED]: vertexName=F533247B014B41248F6E783173171B5C, vertexId=vertex_1452791404584_0001_1_00, initRequestedTime=1452791405624, initedTime=1452791405807, startRequestedTime=1452791405812, startedTime=1452791405812, finishTime=1452791406149, timeTaken=337, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=233832448, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791406102, Process_Duration=14, Process_End_Time=1452791406116, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452791405920, firstTasksToStart=[ task_1452791404584_0001_1_00_000000 ], lastTaskFinishTime=1452791406124, lastTasksToFinish=[ task_1452791404584_0001_1_00_000000 ], minTaskDuration=204, maxTaskDuration=204, avgTaskDuration=204.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452791404584_0001_1_00_000000 ], longestDurationTasks=[ task_1452791404584_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:10:06,164 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:10:06,166 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:10:06,167 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452791404584_0001_00_000001, stoppedTime=1452791406166, exitStatus=0
2016-01-14 17:10:06,169 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791404584_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:10:06,169 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:10:06,169 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452791404584_0001_1
2016-01-14 17:10:06,171 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452791404584_0001_1
2016-01-14 17:10:06,171 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 1BF34DD7703F4D54AC7FD9C203F040DB for vertex: vertex_1452791404584_0001_1_00 [F533247B014B41248F6E783173171B5C]
2016-01-14 17:10:06,175 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452791404584_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:10:06,175 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791404584_0001_00_000001: 30 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:10:06,176 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452791404584_0001_00_000001, Exiting
2016-01-14 17:10:06,176 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452791404584_0001_00_000001
2016-01-14 17:10:06,176 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452791404584_0001_00_000001
2016-01-14 17:10:06,185 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452791404584_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:10:06,185 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452791404584_0001_00_000001 completed successfully
2016-01-14 17:10:06,194 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452791404584_0001_1, queueSize=0
2016-01-14 17:10:06,194 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:10:06,197 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791404584_0001_1][Event:DAG_FINISHED]: dagId=dag_1452791404584_0001_1, startTime=1452791405620, finishTime=1452791406189, timeTaken=569, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=233832448, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791406102, Process_Duration=14, Process_End_Time=1452791406116, Read_Duration=2, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:06,199 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452791404584_0001_1 finished with state: SUCCEEDED
2016-01-14 17:10:06,199 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791404584_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:10:06,200 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791404584_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:10:06,200 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452791404584_0001_00_000001
2016-01-14 17:10:06 Completed Dag: dag_1452791404584_0001_1
2016-01-14 17:10:06,204 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452791404584_0001_1, dagState=SUCCEEDED
2016-01-14 17:10:06,204 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791404584_0001_1_post
2016-01-14 17:10:06,205 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:06,206 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:10:06,211 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Char/quoted/speccharfalse, applicationId=application_1452791404584_0001
2016-01-14 17:10:06,217 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:10:06,217 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:10:06,217 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:10:06,217 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:10:06,217 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:10:06,218 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:10:06,221 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:10:06,221 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:10:06,222 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:10:06,222 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:10:06,223 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:10:06,223 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:10:06,224 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:10:06,229 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/D31B906918554FB8AA5EC407107911E4/F2B1F1E8E2DF49A5BE2A4DF5F6E0C068/.tez/application_1452791404584_0001
2016-01-14 17:10:06,230 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:01.861
2016-01-14 17:10:06,395 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecChar/quoted/speccharfalse
2016-01-14 17:10:06,429 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:10:06,430 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:10:06,486 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 17:10:06,509 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.045
2016-01-14 17:10:06,509 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:06,510 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:06,510 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:10:06,531 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 17:10:06,532 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-01-14 17:10:06,558 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 17:10:06,559 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:06,559 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-01-14 17:10:06,559 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 17:10:06,559 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 17:10:06,560 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 17:10:06,560 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...xtAll/quoted/normchartrue
2016-01-14 17:10:06,561 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:10:06,577 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 17:10:06,583 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:06,584 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:10:06,584 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:10:06,595 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532/.tez/application_1452791406583_0001 doesn't exist and is created
2016-01-14 17:10:06,620 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:10:06,620 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:06,622 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532/.tez/application_1452791406583_0001
2016-01-14 17:10:06,626 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452791406583_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:06,641 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:10:06,642 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:10:06,644 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:10:06,644 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:10:06,644 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532/.tez/application_1452791406583_0001/localmode-log-dir
2016-01-14 17:10:06,645 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532/.tez/application_1452791406583_0001/localmode-log-dir/history.txt.appattempt_1452791406583_0001_000000, maxErrors=10
2016-01-14 17:10:06,645 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:10:06,645 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452791406583_0001_000000, appSubmitTime=1452791406625, launchTime=1452791406626
2016-01-14 17:10:06,654 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:10:06,659 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:10:06,662 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:10:06,662 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:10:06,662 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:39277
2016-01-14 17:10:06,666 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:10:06,670 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452791406583_0001_000000, startTime=1452791406670
2016-01-14 17:10:06,670 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:10:06,671 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:10:06,721 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:10:06,722 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:10:06,722 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452791406583_0001, dagName=[5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 17:10:06,749 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 17:10:06,752 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452791406583_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532/.tez/application_1452791406583_0001/localmode-log-dir/dag_1452791406583_0001_1.dot
2016-01-14 17:10:06,754 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532/.tez/application_1452791406583_0001/localmode-log-dir/dag_1452791406583_0001_1-tez-dag.pb.txt
2016-01-14 17:10:06,781 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791406583_0001_1
2016-01-14 17:10:06,781 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:06,781 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 17:10:06 Running Dag: dag_1452791406583_0001_1
2016-01-14 17:10:06,799 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:10:06,799 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452791406583_0001_1, submitTime=1452791406749
2016-01-14 17:10:06,801 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AF95A1E2CBB54793B42B5825165B45FC
2016-01-14 17:10:06,801 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:10:06,802 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:10:06,802 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452791406583_0001_1, initTime=1452791406800
2016-01-14 17:10:06,803 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791406583_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:10:06,803 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:DAG_STARTED]: dagID=dag_1452791406583_0001_1, startTime=1452791406803
2016-01-14 17:10:06,803 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:10:06,804 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791406583_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:10:06,804 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AF95A1E2CBB54793B42B5825165B45FC : {F3E7B190BBC545C790B73B1284D9EC6C={InputName=F3E7B190BBC545C790B73B1284D9EC6C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:10:06,804 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: F3E7B190BBC545C790B73B1284D9EC6C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:10:06,804 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,804 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,804 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,804 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]. Starting root input initializers: 1
2016-01-14 17:10:06,805 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:10:06,805 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: F3E7B190BBC545C790B73B1284D9EC6C on vertex vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,807 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:10:06,809 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452791406583_0001, dagName=[5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532] pipe/(1/1) ...xtAll/quoted/normchartrue
2016-01-14 17:10:06,811 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:10:06,812 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input F3E7B190BBC545C790B73B1284D9EC6C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:10:06,813 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:10:06,813 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:10:06,816 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 17:10:06,817 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: F3E7B190BBC545C790B73B1284D9EC6C on vertex vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,818 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:06,818 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {F3E7B190BBC545C790B73B1284D9EC6C=forAllWorkUnits=true, update=[1]}
2016-01-14 17:10:06,818 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC] parallelism set to 1
2016-01-14 17:10:06,819 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:06,819 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452791406583_0001_1_00, eventCount=1
2016-01-14 17:10:06,819 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,820 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=65D9188B0CB24AA881F81DB1FC1CAABA, vertexId=vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:10:06,821 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=65D9188B0CB24AA881F81DB1FC1CAABA, vertexId=vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,824 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=65D9188B0CB24AA881F81DB1FC1CAABA, vertexName=AF95A1E2CBB54793B42B5825165B45FC, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:10:06,825 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=65D9188B0CB24AA881F81DB1FC1CAABA, vertexId=vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,826 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:10:06,826 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AF95A1E2CBB54793B42B5825165B45FC, vertexId=vertex_1452791406583_0001_1_00, initRequestedTime=1452791406804, initedTime=1452791406826, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:10:06,827 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC] with distanceFromRoot: 0
2016-01-14 17:10:06,827 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:10:06,828 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AF95A1E2CBB54793B42B5825165B45FC
2016-01-14 17:10:06,828 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,828 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:10:06,828 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452791406583_0001_1_00, startRequestedTime=1452791406827, startedTime=1452791406827
2016-01-14 17:10:06,829 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:10:06,830 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:10:06,830 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:TASK_STARTED]: vertexName=AF95A1E2CBB54793B42B5825165B45FC, taskId=task_1452791406583_0001_1_00_000000, scheduledTime=1452791406829, launchTime=1452791406829
2016-01-14 17:10:06,830 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791406583_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:10:06,831 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,831 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: AF95A1E2CBB54793B42B5825165B45FC, VertexParallelism: 1, TaskAttemptID:attempt_1452791406583_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F3E7B190BBC545C790B73B1284D9EC6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=65D9188B0CB24AA881F81DB1FC1CAABA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:06,832 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791406583_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:10:06,833 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:10:06,835 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:10:06,835 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:10:06,838 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:10:06,839 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452791406583_0001_00_000001
2016-01-14 17:10:06,839 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791406583_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:10:06,847 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452791406583_0001_00_000001
2016-01-14 17:10:06,847 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:10:06,854 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791406583_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:10:06,854 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:10:06,854 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452791406583_0001_00_000001, launchTime=1452791406854
2016-01-14 17:10:06,855 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791406583_0001_00_000001
2016-01-14 17:10:06,857 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452791406583_0001_1_00_000000_0] to container: [container_1452791406583_0001_00_000001]
2016-01-14 17:10:06,857 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791406583_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:10:06,858 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452791406583_0001, with dag id: dag_1452791406583_0001_1
2016-01-14 17:10:06,858 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452791406583_0001_00_000001 given task: attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06,858 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452791406583_0001_1_00_000000_0] started. Is using containerId: [container_1452791406583_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:10:06,859 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:10:06,859 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AF95A1E2CBB54793B42B5825165B45FC, taskAttemptId=attempt_1452791406583_0001_1_00_000000_0, startTime=1452791406858, containerId=container_1452791406583_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452791406583_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:10:06,860 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791406583_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:10:06,860 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791406583_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:10:06,860 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791406583_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06 Starting to run new task attempt: attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06,861 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06,861 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:06,861 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:10:06,862 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:10:06,862 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:10:06,862 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:10:06,862 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:10:06,865 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532] pipe/(1/1) ...xtAll/quoted/normchartrue, VertexName: AF95A1E2CBB54793B42B5825165B45FC, VertexParallelism: 1, TaskAttemptID:attempt_1452791406583_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F3E7B190BBC545C790B73B1284D9EC6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=65D9188B0CB24AA881F81DB1FC1CAABA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:06,866 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:10:06,866 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06,867 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:10:06,868 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:06,872 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=F3E7B190BBC545C790B73B1284D9EC6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:10:06,872 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=65D9188B0CB24AA881F81DB1FC1CAABA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:10:06,876 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452791406583_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:10:06,872 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:06,877 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:10:06,877 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 65D9188B0CB24AA881F81DB1FC1CAABA
2016-01-14 17:10:06,877 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:10:06,877 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 65D9188B0CB24AA881F81DB1FC1CAABA
2016-01-14 17:10:06,876 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:10:06,879 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: F3E7B190BBC545C790B73B1284D9EC6C
2016-01-14 17:10:06,880 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: F3E7B190BBC545C790B73B1284D9EC6C
2016-01-14 17:10:06,886 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:10:06,898 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:10:06,898 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: F3E7B190BBC545C790B73B1284D9EC6C
2016-01-14 17:10:06,899 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: F3E7B190BBC545C790B73B1284D9EC6C
2016-01-14 17:10:06,911 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:10:06,911 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 65D9188B0CB24AA881F81DB1FC1CAABA
2016-01-14 17:10:06,911 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AF95A1E2CBB54793B42B5825165B45FC, ordinal: 0
2016-01-14 17:10:06,912 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AF95A1E2CBB54793B42B5825165B45FC, mem on start (mb), free: 179, total: 281, max: 672
2016-01-14 17:10:06,912 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:06,912 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:10:06,912 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:10:06,912 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:10:06,912 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:10:06,913 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:10:06,914 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:06,915 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:10:06,915 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:06,915 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:10:06,916 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:10:06,916 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 65D9188B0CB24AA881F81DB1FC1CAABA, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:10:06,916 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, F3E7B190BBC545C790B73B1284D9EC6C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:10:06,917 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:10:06,917 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: F3E7B190BBC545C790B73B1284D9EC6C being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:10:06,917 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: F3E7B190BBC545C790B73B1284D9EC6C
2016-01-14 17:10:06,918 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:06,918 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: F3E7B190BBC545C790B73B1284D9EC6C
2016-01-14 17:10:06,918 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:10:06,918 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:10:06,919 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:10:06,919 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06,920 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:10:06,921 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@3c07d315
2016-01-14 17:10:06,928 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@3c07d315
2016-01-14 17:10:06,928 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:10:06,929 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:10:06,930 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:06,931 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: F3E7B190BBC545C790B73B1284D9EC6C
2016-01-14 17:10:06,932 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"], id: 65D9188B0CB24AA881F81DB1FC1CAABA
2016-01-14 17:10:06,932 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue"]
2016-01-14 17:10:06,933 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:06,933 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:06,934 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AF95A1E2CBB54793B42B5825165B45FC, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:10:06,937 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:10:06,937 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:10:06,938 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06,939 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452791406583_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:10:06,940 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06,940 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AF95A1E2CBB54793B42B5825165B45FC, mem on close (mb), free: 177, total: 281, max: 672
2016-01-14 17:10:06 Completed running task attempt: attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06,944 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452791406583_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:10:06,945 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452791406934, Process_Duration=6, Process_End_Time=1452791406940, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 17:10:06,945 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:10:06,946 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AF95A1E2CBB54793B42B5825165B45FC, taskAttemptId=attempt_1452791406583_0001_1_00_000000_0, startTime=1452791406858, finishTime=1452791406945, timeTaken=87, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791406934, Process_Duration=6, Process_End_Time=1452791406940, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:06,947 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:10:06,947 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791406583_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:10:06,947 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:06,948 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:10:06,948 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06,948 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791406583_0001_00_000001
2016-01-14 17:10:06,949 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:10:06,949 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:TASK_FINISHED]: vertexName=AF95A1E2CBB54793B42B5825165B45FC, taskId=task_1452791406583_0001_1_00_000000, startTime=1452791406858, finishTime=1452791406948, timeTaken=90, status=SUCCEEDED, successfulAttemptID=attempt_1452791406583_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791406934, Process_Duration=6, Process_End_Time=1452791406940, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:06,950 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791406583_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:10:06,950 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC] : 1
2016-01-14 17:10:06,950 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,952 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:10:06,954 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:VERTEX_FINISHED]: vertexName=AF95A1E2CBB54793B42B5825165B45FC, vertexId=vertex_1452791406583_0001_1_00, initRequestedTime=1452791406804, initedTime=1452791406826, startRequestedTime=1452791406827, startedTime=1452791406827, finishTime=1452791406950, timeTaken=123, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791406934, Process_Duration=6, Process_End_Time=1452791406940, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452791406858, firstTasksToStart=[ task_1452791406583_0001_1_00_000000 ], lastTaskFinishTime=1452791406945, lastTasksToFinish=[ task_1452791406583_0001_1_00_000000 ], minTaskDuration=87, maxTaskDuration=87, avgTaskDuration=87.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452791406583_0001_1_00_000000 ], longestDurationTasks=[ task_1452791406583_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:10:06,954 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:10:06,954 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791406583_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:10:06,955 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452791406583_0001_00_000001, stoppedTime=1452791406955, exitStatus=0
2016-01-14 17:10:06,955 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:10:06,955 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791406583_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:10:06,956 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:10:06,956 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452791406583_0001_1
2016-01-14 17:10:06,956 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452791406583_0001_1
2016-01-14 17:10:06,957 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 65D9188B0CB24AA881F81DB1FC1CAABA for vertex: vertex_1452791406583_0001_1_00 [AF95A1E2CBB54793B42B5825165B45FC]
2016-01-14 17:10:06,959 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452791406583_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:10:06,959 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791406583_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:10:06,959 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452791406583_0001_00_000001, Exiting
2016-01-14 17:10:06,959 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452791406583_0001_00_000001
2016-01-14 17:10:06,959 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452791406583_0001_00_000001
2016-01-14 17:10:06,961 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452791406583_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:10:06,962 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452791406583_0001_00_000001 completed successfully
2016-01-14 17:10:06,975 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452791406583_0001_1, queueSize=0
2016-01-14 17:10:06,976 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:10:06,976 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791406583_0001_1][Event:DAG_FINISHED]: dagId=dag_1452791406583_0001_1, startTime=1452791406803, finishTime=1452791406974, timeTaken=171, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791406934, Process_Duration=6, Process_End_Time=1452791406940, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:06,976 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452791406583_0001_1 finished with state: SUCCEEDED
2016-01-14 17:10:06,977 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791406583_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:10:06,977 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452791406583_0001_00_000001
2016-01-14 17:10:06,978 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791406583_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:10:06 Completed Dag: dag_1452791406583_0001_1
2016-01-14 17:10:06,980 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452791406583_0001_1, dagState=SUCCEEDED
2016-01-14 17:10:06,981 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791406583_0001_1_post
2016-01-14 17:10:06,981 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:06,981 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:10:06,986 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...xtAll/quoted/normchartrue, applicationId=application_1452791406583_0001
2016-01-14 17:10:06,989 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:10:06,989 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:10:06,989 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:10:06,989 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:10:06,989 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:10:06,990 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:10:06,991 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:10:06,991 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:10:06,991 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:10:06,992 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:10:06,992 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:10:06,992 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:10:06,993 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:10:06,997 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/5A597372B34B4A1296B4A5400F946BA1/BB5EF69DC51E4646B23375B2525E6532/.tez/application_1452791406583_0001
2016-01-14 17:10:06,998 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.440
2016-01-14 17:10:07,155 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextAll/quoted/normchartrue
2016-01-14 17:10:07,226 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:10:07,226 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:10:07,278 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 17:10:07,290 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-14 17:10:07,291 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:07,291 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:07,292 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:10:07,309 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt
2016-01-14 17:10:07,310 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-01-14 17:10:07,334 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 17:10:07,334 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 17:10:07,335 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-01-14 17:10:07,335 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 17:10:07,335 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 17:10:07,335 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 17:10:07,336 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...arAll/quoted/specchartrue
2016-01-14 17:10:07,337 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:10:07,356 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 17:10:07,361 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:07,362 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:10:07,362 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:10:07,372 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F/.tez/application_1452791407361_0001 doesn't exist and is created
2016-01-14 17:10:07,395 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:10:07,395 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:07,396 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F/.tez/application_1452791407361_0001
2016-01-14 17:10:07,401 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452791407361_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:07,414 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:10:07,415 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:10:07,417 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:10:07,417 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:10:07,418 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F/.tez/application_1452791407361_0001/localmode-log-dir
2016-01-14 17:10:07,418 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F/.tez/application_1452791407361_0001/localmode-log-dir/history.txt.appattempt_1452791407361_0001_000000, maxErrors=10
2016-01-14 17:10:07,419 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:10:07,420 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452791407361_0001_000000, appSubmitTime=1452791407400, launchTime=1452791407401
2016-01-14 17:10:07,427 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:10:07,431 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:10:07,432 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:10:07,434 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:10:07,435 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:50420
2016-01-14 17:10:07,436 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:10:07,441 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:10:07,441 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452791407361_0001_000000, startTime=1452791407441
2016-01-14 17:10:07,442 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:10:07,496 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:10:07,496 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:10:07,496 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452791407361_0001, dagName=[4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 17:10:07,521 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 17:10:07,523 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452791407361_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F/.tez/application_1452791407361_0001/localmode-log-dir/dag_1452791407361_0001_1.dot
2016-01-14 17:10:07,525 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F/.tez/application_1452791407361_0001/localmode-log-dir/dag_1452791407361_0001_1-tez-dag.pb.txt
2016-01-14 17:10:07,562 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791407361_0001_1
2016-01-14 17:10:07,562 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:07,562 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 17:10:07 Running Dag: dag_1452791407361_0001_1
2016-01-14 17:10:07,583 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:10:07,583 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452791407361_0001_1, submitTime=1452791407521
2016-01-14 17:10:07,585 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BB89613A42664664974364AA4FF34453
2016-01-14 17:10:07,586 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:10:07,587 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:10:07,587 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452791407361_0001_1, initTime=1452791407584
2016-01-14 17:10:07,588 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791407361_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:10:07,590 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:DAG_STARTED]: dagID=dag_1452791407361_0001_1, startTime=1452791407590
2016-01-14 17:10:07,590 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:10:07,590 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452791407361_0001, dagName=[4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F] pipe/(1/1) ...arAll/quoted/specchartrue
2016-01-14 17:10:07,591 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:10:07,590 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791407361_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:10:07,591 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BB89613A42664664974364AA4FF34453 : {43581600EF8448BEA5D3708236EEFF53={InputName=43581600EF8448BEA5D3708236EEFF53}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:10:07,591 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 43581600EF8448BEA5D3708236EEFF53, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:10:07,591 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,591 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,592 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,592 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]. Starting root input initializers: 1
2016-01-14 17:10:07,592 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:10:07,593 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 43581600EF8448BEA5D3708236EEFF53 on vertex vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,595 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:10:07,595 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 43581600EF8448BEA5D3708236EEFF53 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:10:07,596 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:10:07,597 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:10:07,599 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 428
2016-01-14 17:10:07,599 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 43581600EF8448BEA5D3708236EEFF53 on vertex vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,599 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:07,600 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {43581600EF8448BEA5D3708236EEFF53=forAllWorkUnits=true, update=[1]}
2016-01-14 17:10:07,600 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453] parallelism set to 1
2016-01-14 17:10:07,600 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:07,601 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452791407361_0001_1_00, eventCount=1
2016-01-14 17:10:07,601 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,601 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=58A5A7DCEE6448DF85A2E13AC39C60BA, vertexId=vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:10:07,601 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=58A5A7DCEE6448DF85A2E13AC39C60BA, vertexId=vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,604 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=58A5A7DCEE6448DF85A2E13AC39C60BA, vertexName=BB89613A42664664974364AA4FF34453, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:10:07,604 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=58A5A7DCEE6448DF85A2E13AC39C60BA, vertexId=vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,605 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:10:07,605 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BB89613A42664664974364AA4FF34453, vertexId=vertex_1452791407361_0001_1_00, initRequestedTime=1452791407591, initedTime=1452791407605, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:10:07,607 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453] with distanceFromRoot: 0
2016-01-14 17:10:07,608 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:10:07,608 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BB89613A42664664974364AA4FF34453
2016-01-14 17:10:07,608 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,608 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:10:07,608 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452791407361_0001_1_00, startRequestedTime=1452791407608, startedTime=1452791407608
2016-01-14 17:10:07,608 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:10:07,609 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:10:07,609 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:TASK_STARTED]: vertexName=BB89613A42664664974364AA4FF34453, taskId=task_1452791407361_0001_1_00_000000, scheduledTime=1452791407609, launchTime=1452791407609
2016-01-14 17:10:07,609 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791407361_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:10:07,609 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,610 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: BB89613A42664664974364AA4FF34453, VertexParallelism: 1, TaskAttemptID:attempt_1452791407361_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=43581600EF8448BEA5D3708236EEFF53, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=58A5A7DCEE6448DF85A2E13AC39C60BA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:07,611 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791407361_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:10:07,611 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:10:07,614 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:10:07,615 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:10:07,616 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:10:07,616 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452791407361_0001_00_000001
2016-01-14 17:10:07,617 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791407361_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:10:07,619 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452791407361_0001_00_000001
2016-01-14 17:10:07,620 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:10:07,623 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452791407361_0001, with dag id: dag_1452791407361_0001_1
2016-01-14 17:10:07,624 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791407361_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:10:07,624 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:10:07,626 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452791407361_0001_00_000001, launchTime=1452791407624
2016-01-14 17:10:07,629 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791407361_0001_00_000001
2016-01-14 17:10:07,633 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452791407361_0001_1_00_000000_0] to container: [container_1452791407361_0001_00_000001]
2016-01-14 17:10:07,634 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791407361_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:10:07,635 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452791407361_0001_1_00_000000_0] started. Is using containerId: [container_1452791407361_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:10:07,635 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:10:07,635 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452791407361_0001_00_000001 given task: attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07,636 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791407361_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07,636 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BB89613A42664664974364AA4FF34453, taskAttemptId=attempt_1452791407361_0001_1_00_000000_0, startTime=1452791407634, containerId=container_1452791407361_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452791407361_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:10:07 Starting to run new task attempt: attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07,636 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07,637 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:07,637 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:10:07,637 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:10:07,637 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:10:07,637 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:10:07,637 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:10:07,638 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F] pipe/(1/1) ...arAll/quoted/specchartrue, VertexName: BB89613A42664664974364AA4FF34453, VertexParallelism: 1, TaskAttemptID:attempt_1452791407361_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=43581600EF8448BEA5D3708236EEFF53, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=58A5A7DCEE6448DF85A2E13AC39C60BA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:07,638 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:10:07,638 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791407361_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:10:07,639 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07,641 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791407361_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:10:07,642 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452791407361_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:10:07,642 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:10:07,642 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:07,643 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=43581600EF8448BEA5D3708236EEFF53, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:10:07,643 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=58A5A7DCEE6448DF85A2E13AC39C60BA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:10:07,643 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:07,644 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:10:07,643 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:10:07,645 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 43581600EF8448BEA5D3708236EEFF53
2016-01-14 17:10:07,645 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 43581600EF8448BEA5D3708236EEFF53
2016-01-14 17:10:07,645 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 58A5A7DCEE6448DF85A2E13AC39C60BA
2016-01-14 17:10:07,645 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:10:07,646 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 58A5A7DCEE6448DF85A2E13AC39C60BA
2016-01-14 17:10:07,651 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:10:07,653 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 43581600EF8448BEA5D3708236EEFF53
2016-01-14 17:10:07,653 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 43581600EF8448BEA5D3708236EEFF53
2016-01-14 17:10:07,656 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:10:07,666 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:10:07,667 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 58A5A7DCEE6448DF85A2E13AC39C60BA
2016-01-14 17:10:07,670 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BB89613A42664664974364AA4FF34453, ordinal: 0
2016-01-14 17:10:07,670 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BB89613A42664664974364AA4FF34453, mem on start (mb), free: 205, total: 281, max: 672
2016-01-14 17:10:07,671 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:07,671 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:10:07,671 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:10:07,671 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:10:07,671 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:10:07,671 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:10:07,671 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:07,672 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:10:07,672 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:07,672 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:10:07,672 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:10:07,672 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 43581600EF8448BEA5D3708236EEFF53, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:10:07,672 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 58A5A7DCEE6448DF85A2E13AC39C60BA, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:10:07,672 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:10:07,673 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 43581600EF8448BEA5D3708236EEFF53
2016-01-14 17:10:07,673 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:07,673 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 43581600EF8448BEA5D3708236EEFF53
2016-01-14 17:10:07,673 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 43581600EF8448BEA5D3708236EEFF53 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:10:07,673 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:10:07,675 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:10:07,675 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:10:07,676 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07,676 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:10:07,677 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@61a79e53
2016-01-14 17:10:07,678 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@61a79e53
2016-01-14 17:10:07,679 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:10:07,680 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:10:07,681 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 17:10:07,682 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"] streamed: true, id: 43581600EF8448BEA5D3708236EEFF53
2016-01-14 17:10:07,682 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"], id: 58A5A7DCEE6448DF85A2E13AC39C60BA
2016-01-14 17:10:07,683 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue"]
2016-01-14 17:10:07,683 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-spec-char.txt"]
2016-01-14 17:10:07,684 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:07,684 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BB89613A42664664974364AA4FF34453, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:10:07,688 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:10:07,689 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:10:07,690 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07,690 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452791407361_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:10:07,692 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07,692 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BB89613A42664664974364AA4FF34453, mem on close (mb), free: 203, total: 281, max: 672
2016-01-14 17:10:07 Completed running task attempt: attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07,696 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452791407361_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:10:07,697 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452791407684, Process_Duration=8, Process_End_Time=1452791407692, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 17:10:07,697 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:10:07,698 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BB89613A42664664974364AA4FF34453, taskAttemptId=attempt_1452791407361_0001_1_00_000000_0, startTime=1452791407634, finishTime=1452791407697, timeTaken=63, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791407684, Process_Duration=8, Process_End_Time=1452791407692, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:07,699 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:10:07,699 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791407361_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:10:07,699 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:07,700 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:10:07,700 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07,700 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791407361_0001_00_000001
2016-01-14 17:10:07,701 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:TASK_FINISHED]: vertexName=BB89613A42664664974364AA4FF34453, taskId=task_1452791407361_0001_1_00_000000, startTime=1452791407634, finishTime=1452791407700, timeTaken=66, status=SUCCEEDED, successfulAttemptID=attempt_1452791407361_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791407684, Process_Duration=8, Process_End_Time=1452791407692, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:07,701 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791407361_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:10:07,701 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453] : 1
2016-01-14 17:10:07,702 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,702 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:10:07,704 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:VERTEX_FINISHED]: vertexName=BB89613A42664664974364AA4FF34453, vertexId=vertex_1452791407361_0001_1_00, initRequestedTime=1452791407591, initedTime=1452791407605, startRequestedTime=1452791407608, startedTime=1452791407608, finishTime=1452791407702, timeTaken=94, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791407684, Process_Duration=8, Process_End_Time=1452791407692, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452791407634, firstTasksToStart=[ task_1452791407361_0001_1_00_000000 ], lastTaskFinishTime=1452791407697, lastTasksToFinish=[ task_1452791407361_0001_1_00_000000 ], minTaskDuration=63, maxTaskDuration=63, avgTaskDuration=63.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452791407361_0001_1_00_000000 ], longestDurationTasks=[ task_1452791407361_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:10:07,704 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:10:07,704 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791407361_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:10:07,704 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452791407361_0001_00_000001, stoppedTime=1452791407704, exitStatus=0
2016-01-14 17:10:07,704 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791407361_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:10:07,705 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:10:07,705 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452791407361_0001_1
2016-01-14 17:10:07,705 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452791407361_0001_1
2016-01-14 17:10:07,705 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 58A5A7DCEE6448DF85A2E13AC39C60BA for vertex: vertex_1452791407361_0001_1_00 [BB89613A42664664974364AA4FF34453]
2016-01-14 17:10:07,707 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:10:07,709 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:10:07,711 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452791407361_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:10:07,712 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791407361_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:10:07,712 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452791407361_0001_00_000001, Exiting
2016-01-14 17:10:07,712 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452791407361_0001_00_000001
2016-01-14 17:10:07,712 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452791407361_0001_00_000001
2016-01-14 17:10:07,717 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452791407361_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:10:07,717 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452791407361_0001_00_000001 completed successfully
2016-01-14 17:10:07,724 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452791407361_0001_1, queueSize=0
2016-01-14 17:10:07,724 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:10:07,725 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791407361_0001_1][Event:DAG_FINISHED]: dagId=dag_1452791407361_0001_1, startTime=1452791407590, finishTime=1452791407722, timeTaken=132, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=296, FILE_BYTES_WRITTEN=188, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791407684, Process_Duration=8, Process_End_Time=1452791407692, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:07,725 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452791407361_0001_1 finished with state: SUCCEEDED
2016-01-14 17:10:07,725 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791407361_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:10:07,726 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791407361_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:10:07 Completed Dag: dag_1452791407361_0001_1
2016-01-14 17:10:07,727 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452791407361_0001_00_000001
2016-01-14 17:10:07,728 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452791407361_0001_1, dagState=SUCCEEDED
2016-01-14 17:10:07,731 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791407361_0001_1_post
2016-01-14 17:10:07,731 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:07,731 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:10:07,736 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...arAll/quoted/specchartrue, applicationId=application_1452791407361_0001
2016-01-14 17:10:07,740 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:10:07,740 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:10:07,740 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:10:07,740 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:10:07,740 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:10:07,740 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:10:07,741 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:10:07,741 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:10:07,742 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:10:07,742 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:10:07,742 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:10:07,743 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:10:07,744 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:10:07,753 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/4FAAF45D88B74866BF0F62BE6EDB85AD/AD29D177F8FC4D47B71D1C74A689F23F/.tez/application_1452791407361_0001
2016-01-14 17:10:07,754 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.420
2016-01-14 17:10:07,869 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedTextSpecCharAll/quoted/specchartrue
2016-01-14 17:10:07,903 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:10:07,903 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:10:07,950 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 17:10:07,960 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 17:10:07,961 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:07,961 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:07,962 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:10:07,979 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 17:10:07,980 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-01-14 17:10:08,000 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 17:10:08,000 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:08,000 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-01-14 17:10:08,001 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 17:10:08,002 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 17:10:08,002 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 17:10:08,003 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...m/testHeaderAll/headerall
2016-01-14 17:10:08,004 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:10:08,019 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 17:10:08,024 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:08,025 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:10:08,025 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:10:08,035 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D/.tez/application_1452791408024_0001 doesn't exist and is created
2016-01-14 17:10:08,055 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:10:08,055 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:08,056 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D/.tez/application_1452791408024_0001
2016-01-14 17:10:08,060 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452791408024_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:08,096 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:10:08,097 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:10:08,099 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:10:08,099 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:10:08,099 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D/.tez/application_1452791408024_0001/localmode-log-dir
2016-01-14 17:10:08,100 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D/.tez/application_1452791408024_0001/localmode-log-dir/history.txt.appattempt_1452791408024_0001_000000, maxErrors=10
2016-01-14 17:10:08,100 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:10:08,100 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452791408024_0001_000000, appSubmitTime=1452791408059, launchTime=1452791408059
2016-01-14 17:10:08,108 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:10:08,109 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:10:08,111 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:36337
2016-01-14 17:10:08,114 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:10:08,115 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:10:08,116 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:10:08,118 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:10:08,118 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452791408024_0001_000000, startTime=1452791408118
2016-01-14 17:10:08,118 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:10:08,155 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:10:08,156 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:10:08,156 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452791408024_0001, dagName=[0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 17:10:08,174 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 17:10:08,176 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452791408024_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D/.tez/application_1452791408024_0001/localmode-log-dir/dag_1452791408024_0001_1.dot
2016-01-14 17:10:08,177 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D/.tez/application_1452791408024_0001/localmode-log-dir/dag_1452791408024_0001_1-tez-dag.pb.txt
2016-01-14 17:10:08,212 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791408024_0001_1
2016-01-14 17:10:08,212 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:08,212 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 17:10:08 Running Dag: dag_1452791408024_0001_1
2016-01-14 17:10:08,226 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452791408024_0001_1, submitTime=1452791408174
2016-01-14 17:10:08,226 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:10:08,227 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E6A5B6EFC3C14ED98E2D08F11DBE2F4A
2016-01-14 17:10:08,228 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:10:08,228 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452791408024_0001_1, initTime=1452791408227
2016-01-14 17:10:08,228 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:10:08,230 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791408024_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:10:08,231 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:DAG_STARTED]: dagID=dag_1452791408024_0001_1, startTime=1452791408230
2016-01-14 17:10:08,231 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:10:08,231 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791408024_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:10:08,231 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E6A5B6EFC3C14ED98E2D08F11DBE2F4A : {64FB11F966C54B569DBC7E504503FAFA={InputName=64FB11F966C54B569DBC7E504503FAFA}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:10:08,231 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 64FB11F966C54B569DBC7E504503FAFA, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:10:08,231 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,232 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,232 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,232 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:10:08,232 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]. Starting root input initializers: 1
2016-01-14 17:10:08,232 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:10:08,233 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 64FB11F966C54B569DBC7E504503FAFA on vertex vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,233 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452791408024_0001, dagName=[0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D] pipe/(1/1) ...m/testHeaderAll/headerall
2016-01-14 17:10:08,236 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:10:08,236 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 64FB11F966C54B569DBC7E504503FAFA asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:10:08,237 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:10:08,237 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:10:08,240 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 17:10:08,241 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 64FB11F966C54B569DBC7E504503FAFA on vertex vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,242 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:08,242 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {64FB11F966C54B569DBC7E504503FAFA=forAllWorkUnits=true, update=[1]}
2016-01-14 17:10:08,242 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A] parallelism set to 1
2016-01-14 17:10:08,242 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:08,242 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452791408024_0001_1_00, eventCount=1
2016-01-14 17:10:08,242 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,243 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=0CBAA5102B3741D8A6E47FC25CF8ECCC, vertexId=vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:10:08,243 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=0CBAA5102B3741D8A6E47FC25CF8ECCC, vertexId=vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,245 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=0CBAA5102B3741D8A6E47FC25CF8ECCC, vertexName=E6A5B6EFC3C14ED98E2D08F11DBE2F4A, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:10:08,246 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=0CBAA5102B3741D8A6E47FC25CF8ECCC, vertexId=vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,248 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:10:08,248 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E6A5B6EFC3C14ED98E2D08F11DBE2F4A, vertexId=vertex_1452791408024_0001_1_00, initRequestedTime=1452791408231, initedTime=1452791408248, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:10:08,248 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A] with distanceFromRoot: 0
2016-01-14 17:10:08,248 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:10:08,248 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E6A5B6EFC3C14ED98E2D08F11DBE2F4A
2016-01-14 17:10:08,248 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,249 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:10:08,249 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452791408024_0001_1_00, startRequestedTime=1452791408248, startedTime=1452791408248
2016-01-14 17:10:08,249 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:10:08,249 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:10:08,250 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:TASK_STARTED]: vertexName=E6A5B6EFC3C14ED98E2D08F11DBE2F4A, taskId=task_1452791408024_0001_1_00_000000, scheduledTime=1452791408249, launchTime=1452791408249
2016-01-14 17:10:08,250 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791408024_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:10:08,250 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,250 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: E6A5B6EFC3C14ED98E2D08F11DBE2F4A, VertexParallelism: 1, TaskAttemptID:attempt_1452791408024_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=64FB11F966C54B569DBC7E504503FAFA, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0CBAA5102B3741D8A6E47FC25CF8ECCC, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:08,250 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791408024_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:10:08,251 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:10:08,251 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:10:08,252 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:10:08,252 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:10:08,252 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452791408024_0001_00_000001
2016-01-14 17:10:08,252 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408024_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:10:08,254 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452791408024_0001_00_000001
2016-01-14 17:10:08,254 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:10:08,255 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408024_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:10:08,255 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:10:08,255 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452791408024_0001_00_000001, launchTime=1452791408255
2016-01-14 17:10:08,256 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791408024_0001_00_000001
2016-01-14 17:10:08,257 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452791408024_0001_1_00_000000_0] to container: [container_1452791408024_0001_00_000001]
2016-01-14 17:10:08,257 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408024_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:10:08,257 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452791408024_0001_00_000001 given task: attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08,257 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791408024_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08,257 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452791408024_0001_1_00_000000_0] started. Is using containerId: [container_1452791408024_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:10:08,257 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E6A5B6EFC3C14ED98E2D08F11DBE2F4A, taskAttemptId=attempt_1452791408024_0001_1_00_000000_0, startTime=1452791408257, containerId=container_1452791408024_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452791408024_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:10:08,258 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791408024_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:10:08,258 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791408024_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:10:08,258 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:10:08 Starting to run new task attempt: attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08,259 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08,259 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:08,260 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:10:08,260 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:10:08,260 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:10:08,260 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:10:08,260 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:10:08,260 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D] pipe/(1/1) ...m/testHeaderAll/headerall, VertexName: E6A5B6EFC3C14ED98E2D08F11DBE2F4A, VertexParallelism: 1, TaskAttemptID:attempt_1452791408024_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=64FB11F966C54B569DBC7E504503FAFA, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0CBAA5102B3741D8A6E47FC25CF8ECCC, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:08,260 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:10:08,261 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452791408024_0001, with dag id: dag_1452791408024_0001_1
2016-01-14 17:10:08,261 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08,262 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:10:08,266 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:08,266 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452791408024_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:10:08,267 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=64FB11F966C54B569DBC7E504503FAFA, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:10:08,267 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=0CBAA5102B3741D8A6E47FC25CF8ECCC, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:10:08,267 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:08,269 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:10:08,269 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:10:08,271 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 64FB11F966C54B569DBC7E504503FAFA
2016-01-14 17:10:08,272 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 64FB11F966C54B569DBC7E504503FAFA
2016-01-14 17:10:08,273 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 0CBAA5102B3741D8A6E47FC25CF8ECCC
2016-01-14 17:10:08,273 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:10:08,274 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 0CBAA5102B3741D8A6E47FC25CF8ECCC
2016-01-14 17:10:08,275 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:10:08,280 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:10:08,281 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 64FB11F966C54B569DBC7E504503FAFA
2016-01-14 17:10:08,282 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 64FB11F966C54B569DBC7E504503FAFA
2016-01-14 17:10:08,284 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E6A5B6EFC3C14ED98E2D08F11DBE2F4A, ordinal: 0
2016-01-14 17:10:08,284 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E6A5B6EFC3C14ED98E2D08F11DBE2F4A, mem on start (mb), free: 335, total: 391, max: 672
2016-01-14 17:10:08,284 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:08,285 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:10:08,285 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:10:08,293 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:10:08,293 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 0CBAA5102B3741D8A6E47FC25CF8ECCC
2016-01-14 17:10:08,293 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:10:08,293 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:10:08,293 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:10:08,293 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:08,293 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:10:08,293 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:08,294 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:10:08,294 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:10:08,294 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 64FB11F966C54B569DBC7E504503FAFA, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:10:08,294 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 0CBAA5102B3741D8A6E47FC25CF8ECCC, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:10:08,294 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:10:08,294 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 64FB11F966C54B569DBC7E504503FAFA being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:10:08,294 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:10:08,295 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:10:08,295 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 64FB11F966C54B569DBC7E504503FAFA
2016-01-14 17:10:08,295 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:08,295 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 64FB11F966C54B569DBC7E504503FAFA
2016-01-14 17:10:08,295 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:10:08,296 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08,296 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:10:08,296 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@33157362
2016-01-14 17:10:08,298 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@33157362
2016-01-14 17:10:08,298 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:10:08,298 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:10:08,298 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:08,299 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 64FB11F966C54B569DBC7E504503FAFA
2016-01-14 17:10:08,299 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"], id: 0CBAA5102B3741D8A6E47FC25CF8ECCC
2016-01-14 17:10:08,300 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall"]
2016-01-14 17:10:08,300 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:08,300 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:08,300 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E6A5B6EFC3C14ED98E2D08F11DBE2F4A, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:10:08,304 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:10:08,305 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:10:08,305 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08,306 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452791408024_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:10:08,306 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08,307 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E6A5B6EFC3C14ED98E2D08F11DBE2F4A, mem on close (mb), free: 333, total: 391, max: 672
2016-01-14 17:10:08 Completed running task attempt: attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08,307 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452791408024_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:10:08,308 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=409993216, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452791408301, Process_Duration=5, Process_End_Time=1452791408306, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-01-14 17:10:08,308 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:10:08,309 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:10:08,309 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:08,309 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791408024_0001_00_000001
2016-01-14 17:10:08,310 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E6A5B6EFC3C14ED98E2D08F11DBE2F4A, taskAttemptId=attempt_1452791408024_0001_1_00_000000_0, startTime=1452791408257, finishTime=1452791408308, timeTaken=51, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=409993216, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791408301, Process_Duration=5, Process_End_Time=1452791408306, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 17:10:08,310 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791408024_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:10:08,310 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:10:08,310 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08,311 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:10:08,311 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:TASK_FINISHED]: vertexName=E6A5B6EFC3C14ED98E2D08F11DBE2F4A, taskId=task_1452791408024_0001_1_00_000000, startTime=1452791408257, finishTime=1452791408311, timeTaken=54, status=SUCCEEDED, successfulAttemptID=attempt_1452791408024_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=409993216, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791408301, Process_Duration=5, Process_End_Time=1452791408306, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 17:10:08,312 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791408024_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:10:08,312 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A] : 1
2016-01-14 17:10:08,312 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,313 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:10:08,315 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:VERTEX_FINISHED]: vertexName=E6A5B6EFC3C14ED98E2D08F11DBE2F4A, vertexId=vertex_1452791408024_0001_1_00, initRequestedTime=1452791408231, initedTime=1452791408248, startRequestedTime=1452791408248, startedTime=1452791408248, finishTime=1452791408312, timeTaken=64, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=409993216, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791408301, Process_Duration=5, Process_End_Time=1452791408306, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1452791408257, firstTasksToStart=[ task_1452791408024_0001_1_00_000000 ], lastTaskFinishTime=1452791408308, lastTasksToFinish=[ task_1452791408024_0001_1_00_000000 ], minTaskDuration=51, maxTaskDuration=51, avgTaskDuration=51.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452791408024_0001_1_00_000000 ], longestDurationTasks=[ task_1452791408024_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:10:08,316 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:10:08,316 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408024_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:10:08,316 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:10:08,316 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452791408024_0001_00_000001, stoppedTime=1452791408316, exitStatus=0
2016-01-14 17:10:08,317 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408024_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:10:08,318 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:10:08,319 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452791408024_0001_1
2016-01-14 17:10:08,319 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452791408024_0001_1
2016-01-14 17:10:08,319 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 0CBAA5102B3741D8A6E47FC25CF8ECCC for vertex: vertex_1452791408024_0001_1_00 [E6A5B6EFC3C14ED98E2D08F11DBE2F4A]
2016-01-14 17:10:08,320 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452791408024_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:10:08,320 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791408024_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:10:08,320 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452791408024_0001_00_000001, Exiting
2016-01-14 17:10:08,320 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452791408024_0001_00_000001
2016-01-14 17:10:08,320 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452791408024_0001_00_000001
2016-01-14 17:10:08,324 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452791408024_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:10:08,324 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452791408024_0001_00_000001 completed successfully
2016-01-14 17:10:08,333 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452791408024_0001_1, queueSize=0
2016-01-14 17:10:08,333 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:10:08,334 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408024_0001_1][Event:DAG_FINISHED]: dagId=dag_1452791408024_0001_1, startTime=1452791408230, finishTime=1452791408331, timeTaken=101, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=409993216, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791408301, Process_Duration=5, Process_End_Time=1452791408306, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 17:10:08,335 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452791408024_0001_1 finished with state: SUCCEEDED
2016-01-14 17:10:08,335 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791408024_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:10:08,336 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452791408024_0001_00_000001
2016-01-14 17:10:08,337 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408024_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:10:08 Completed Dag: dag_1452791408024_0001_1
2016-01-14 17:10:08,337 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452791408024_0001_1, dagState=SUCCEEDED
2016-01-14 17:10:08,337 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791408024_0001_1_post
2016-01-14 17:10:08,337 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:08,338 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:10:08,343 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...m/testHeaderAll/headerall, applicationId=application_1452791408024_0001
2016-01-14 17:10:08,347 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:10:08,347 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:10:08,347 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:10:08,347 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:10:08,347 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:10:08,348 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:10:08,348 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:10:08,349 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:10:08,350 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:10:08,350 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:10:08,350 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:10:08,351 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:10:08,352 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:10:08,355 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/0D618CC02A4F41BB812848814436EA73/E85F8EBC849F49F1BEAEB2CF3EB76E8D/.tez/application_1452791408024_0001
2016-01-14 17:10:08,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.356
2016-01-14 17:10:08,396 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderAll/headerall
2016-01-14 17:10:08,423 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:10:08,424 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:10:08,473 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 17:10:08,481 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 17:10:08,482 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:08,482 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:08,482 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:10:08,499 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 17:10:08,500 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-01-14 17:10:08,511 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 17:10:08,511 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:08,512 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-01-14 17:10:08,512 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 17:10:08,512 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 17:10:08,512 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 17:10:08,513 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...Text/quoted/normcharfalse
2016-01-14 17:10:08,513 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:10:08,526 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 17:10:08,531 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:08,531 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:10:08,531 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:10:08,541 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0/.tez/application_1452791408531_0001 doesn't exist and is created
2016-01-14 17:10:08,558 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:10:08,558 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:08,559 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0/.tez/application_1452791408531_0001
2016-01-14 17:10:08,563 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452791408531_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:08,577 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:10:08,578 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:10:08,580 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:10:08,580 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:10:08,580 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0/.tez/application_1452791408531_0001/localmode-log-dir
2016-01-14 17:10:08,581 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0/.tez/application_1452791408531_0001/localmode-log-dir/history.txt.appattempt_1452791408531_0001_000000, maxErrors=10
2016-01-14 17:10:08,581 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:10:08,581 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452791408531_0001_000000, appSubmitTime=1452791408563, launchTime=1452791408563
2016-01-14 17:10:08,585 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:10:08,586 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:10:08,591 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:10:08,593 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:10:08,593 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:33527
2016-01-14 17:10:08,596 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:10:08,598 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452791408531_0001_000000, startTime=1452791408598
2016-01-14 17:10:08,598 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:10:08,598 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:10:08,658 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:10:08,658 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:10:08,659 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452791408531_0001, dagName=[A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 17:10:08,677 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 17:10:08,679 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452791408531_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0/.tez/application_1452791408531_0001/localmode-log-dir/dag_1452791408531_0001_1.dot
2016-01-14 17:10:08,680 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0/.tez/application_1452791408531_0001/localmode-log-dir/dag_1452791408531_0001_1-tez-dag.pb.txt
2016-01-14 17:10:08,696 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791408531_0001_1
2016-01-14 17:10:08,697 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:08,697 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 17:10:08 Running Dag: dag_1452791408531_0001_1
2016-01-14 17:10:08,710 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452791408531_0001_1, submitTime=1452791408678
2016-01-14 17:10:08,710 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:10:08,710 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D57E80C251954212A807F1CC6E7B6BA7
2016-01-14 17:10:08,711 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:10:08,711 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:10:08,712 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452791408531_0001_1, initTime=1452791408710
2016-01-14 17:10:08,712 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791408531_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:10:08,713 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452791408531_0001, dagName=[A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0] pipe/(1/1) ...Text/quoted/normcharfalse
2016-01-14 17:10:08,714 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:DAG_STARTED]: dagID=dag_1452791408531_0001_1, startTime=1452791408713
2016-01-14 17:10:08,714 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:10:08,714 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:10:08,714 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791408531_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:10:08,714 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D57E80C251954212A807F1CC6E7B6BA7 : {DA20CB27296E4ECE9C3A2C4D0C2095BB={InputName=DA20CB27296E4ECE9C3A2C4D0C2095BB}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:10:08,714 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: DA20CB27296E4ECE9C3A2C4D0C2095BB, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:10:08,715 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,715 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,715 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,715 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]. Starting root input initializers: 1
2016-01-14 17:10:08,716 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:10:08,716 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: DA20CB27296E4ECE9C3A2C4D0C2095BB on vertex vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,718 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:10:08,718 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input DA20CB27296E4ECE9C3A2C4D0C2095BB asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:10:08,719 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:10:08,719 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:10:08,721 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 17:10:08,723 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: DA20CB27296E4ECE9C3A2C4D0C2095BB on vertex vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,724 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:08,724 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {DA20CB27296E4ECE9C3A2C4D0C2095BB=forAllWorkUnits=true, update=[1]}
2016-01-14 17:10:08,724 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7] parallelism set to 1
2016-01-14 17:10:08,724 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:08,724 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452791408531_0001_1_00, eventCount=1
2016-01-14 17:10:08,724 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,725 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=AFFA04513F444A959C3767EA087A3ED4, vertexId=vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:10:08,725 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=AFFA04513F444A959C3767EA087A3ED4, vertexId=vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,728 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=AFFA04513F444A959C3767EA087A3ED4, vertexName=D57E80C251954212A807F1CC6E7B6BA7, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:10:08,728 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=AFFA04513F444A959C3767EA087A3ED4, vertexId=vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,729 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D57E80C251954212A807F1CC6E7B6BA7, vertexId=vertex_1452791408531_0001_1_00, initRequestedTime=1452791408714, initedTime=1452791408729, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:10:08,729 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:10:08,730 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7] with distanceFromRoot: 0
2016-01-14 17:10:08,733 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:10:08,733 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D57E80C251954212A807F1CC6E7B6BA7
2016-01-14 17:10:08,733 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,734 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:10:08,734 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452791408531_0001_1_00, startRequestedTime=1452791408733, startedTime=1452791408733
2016-01-14 17:10:08,734 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:10:08,734 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:10:08,735 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:TASK_STARTED]: vertexName=D57E80C251954212A807F1CC6E7B6BA7, taskId=task_1452791408531_0001_1_00_000000, scheduledTime=1452791408734, launchTime=1452791408734
2016-01-14 17:10:08,735 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791408531_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:10:08,735 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,735 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: D57E80C251954212A807F1CC6E7B6BA7, VertexParallelism: 1, TaskAttemptID:attempt_1452791408531_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=DA20CB27296E4ECE9C3A2C4D0C2095BB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=AFFA04513F444A959C3767EA087A3ED4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:08,736 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791408531_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:10:08,736 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:10:08,737 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:10:08,737 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:10:08,738 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:10:08,738 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452791408531_0001_00_000001
2016-01-14 17:10:08,738 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408531_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:10:08,739 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452791408531_0001, with dag id: dag_1452791408531_0001_1
2016-01-14 17:10:08,740 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452791408531_0001_00_000001
2016-01-14 17:10:08,741 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:10:08,742 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408531_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:10:08,742 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:10:08,743 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452791408531_0001_00_000001, launchTime=1452791408742
2016-01-14 17:10:08,745 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791408531_0001_00_000001
2016-01-14 17:10:08,746 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452791408531_0001_1_00_000000_0] to container: [container_1452791408531_0001_00_000001]
2016-01-14 17:10:08,747 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408531_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:10:08,748 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452791408531_0001_1_00_000000_0] started. Is using containerId: [container_1452791408531_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:10:08,748 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D57E80C251954212A807F1CC6E7B6BA7, taskAttemptId=attempt_1452791408531_0001_1_00_000000_0, startTime=1452791408748, containerId=container_1452791408531_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452791408531_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:10:08,748 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791408531_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:10:08,748 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:10:08,748 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791408531_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:10:08,749 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452791408531_0001_00_000001 given task: attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08,749 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791408531_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08 Starting to run new task attempt: attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08,749 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08,750 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:08,750 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:10:08,750 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:10:08,750 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:10:08,750 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:10:08,750 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:10:08,751 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0] pipe/(1/1) ...Text/quoted/normcharfalse, VertexName: D57E80C251954212A807F1CC6E7B6BA7, VertexParallelism: 1, TaskAttemptID:attempt_1452791408531_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=DA20CB27296E4ECE9C3A2C4D0C2095BB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=AFFA04513F444A959C3767EA087A3ED4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:08,751 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:10:08,751 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08,752 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:10:08,752 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:08,753 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452791408531_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:10:08,753 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=DA20CB27296E4ECE9C3A2C4D0C2095BB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:10:08,753 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=AFFA04513F444A959C3767EA087A3ED4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:10:08,753 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:08,754 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:10:08,754 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:10:08,754 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: DA20CB27296E4ECE9C3A2C4D0C2095BB
2016-01-14 17:10:08,755 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: AFFA04513F444A959C3767EA087A3ED4
2016-01-14 17:10:08,755 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:10:08,755 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: AFFA04513F444A959C3767EA087A3ED4
2016-01-14 17:10:08,755 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: DA20CB27296E4ECE9C3A2C4D0C2095BB
2016-01-14 17:10:08,761 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:10:08,763 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: DA20CB27296E4ECE9C3A2C4D0C2095BB
2016-01-14 17:10:08,763 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: DA20CB27296E4ECE9C3A2C4D0C2095BB
2016-01-14 17:10:08,764 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:10:08,771 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:10:08,771 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: AFFA04513F444A959C3767EA087A3ED4
2016-01-14 17:10:08,773 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D57E80C251954212A807F1CC6E7B6BA7, ordinal: 0
2016-01-14 17:10:08,773 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D57E80C251954212A807F1CC6E7B6BA7, mem on start (mb), free: 253, total: 391, max: 672
2016-01-14 17:10:08,773 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:08,773 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:10:08,773 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:10:08,773 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:10:08,773 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:10:08,774 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:10:08,774 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:08,774 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:10:08,774 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:08,775 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:10:08,775 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:10:08,776 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, AFFA04513F444A959C3767EA087A3ED4, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:10:08,776 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, DA20CB27296E4ECE9C3A2C4D0C2095BB, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:10:08,776 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:10:08,777 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: DA20CB27296E4ECE9C3A2C4D0C2095BB being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:10:08,777 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: DA20CB27296E4ECE9C3A2C4D0C2095BB
2016-01-14 17:10:08,777 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:08,777 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: DA20CB27296E4ECE9C3A2C4D0C2095BB
2016-01-14 17:10:08,777 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:10:08,778 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:10:08,778 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:10:08,778 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08,779 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:10:08,780 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2d64581f
2016-01-14 17:10:08,781 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2d64581f
2016-01-14 17:10:08,781 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:10:08,781 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:10:08,782 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:08,782 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: DA20CB27296E4ECE9C3A2C4D0C2095BB
2016-01-14 17:10:08,782 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"], id: AFFA04513F444A959C3767EA087A3ED4
2016-01-14 17:10:08,784 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse"]
2016-01-14 17:10:08,784 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:08,784 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:08,784 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D57E80C251954212A807F1CC6E7B6BA7, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:10:08,788 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:10:08,788 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:10:08,789 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08,789 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452791408531_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:10:08,790 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08,791 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D57E80C251954212A807F1CC6E7B6BA7, mem on close (mb), free: 251, total: 391, max: 672
2016-01-14 17:10:08 Completed running task attempt: attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08,792 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452791408531_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:10:08,793 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D57E80C251954212A807F1CC6E7B6BA7, taskAttemptId=attempt_1452791408531_0001_1_00_000000_0, startTime=1452791408748, finishTime=1452791408793, timeTaken=45, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=409993216, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791408785, Process_Duration=5, Process_End_Time=1452791408790, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:08,793 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:10:08,793 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791408531_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:10:08,794 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:10:08,794 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08,795 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:10:08,795 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:TASK_FINISHED]: vertexName=D57E80C251954212A807F1CC6E7B6BA7, taskId=task_1452791408531_0001_1_00_000000, startTime=1452791408748, finishTime=1452791408795, timeTaken=47, status=SUCCEEDED, successfulAttemptID=attempt_1452791408531_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=409993216, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791408785, Process_Duration=5, Process_End_Time=1452791408790, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:08,796 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791408531_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:10:08,796 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7] : 1
2016-01-14 17:10:08,796 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,797 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=409993216, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452791408785, Process_Duration=5, Process_End_Time=1452791408790, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=12, Tuples_Written=12]]
2016-01-14 17:10:08,797 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:10:08,797 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:VERTEX_FINISHED]: vertexName=D57E80C251954212A807F1CC6E7B6BA7, vertexId=vertex_1452791408531_0001_1_00, initRequestedTime=1452791408714, initedTime=1452791408729, startRequestedTime=1452791408733, startedTime=1452791408733, finishTime=1452791408796, timeTaken=63, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=409993216, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791408785, Process_Duration=5, Process_End_Time=1452791408790, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12, vertexStats=firstTaskStartTime=1452791408748, firstTasksToStart=[ task_1452791408531_0001_1_00_000000 ], lastTaskFinishTime=1452791408793, lastTasksToFinish=[ task_1452791408531_0001_1_00_000000 ], minTaskDuration=45, maxTaskDuration=45, avgTaskDuration=45.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452791408531_0001_1_00_000000 ], longestDurationTasks=[ task_1452791408531_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:10:08,799 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:10:08,797 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:10:08,799 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:08,800 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791408531_0001_00_000001
2016-01-14 17:10:08,800 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408531_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:10:08,800 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452791408531_0001_00_000001, stoppedTime=1452791408800, exitStatus=0
2016-01-14 17:10:08,800 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408531_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:10:08,800 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:10:08,801 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452791408531_0001_1
2016-01-14 17:10:08,801 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452791408531_0001_1
2016-01-14 17:10:08,801 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: AFFA04513F444A959C3767EA087A3ED4 for vertex: vertex_1452791408531_0001_1_00 [D57E80C251954212A807F1CC6E7B6BA7]
2016-01-14 17:10:08,802 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:10:08,802 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452791408531_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:10:08,803 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791408531_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:10:08,803 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452791408531_0001_00_000001, Exiting
2016-01-14 17:10:08,803 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452791408531_0001_00_000001
2016-01-14 17:10:08,803 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452791408531_0001_00_000001
2016-01-14 17:10:08,807 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452791408531_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:10:08,807 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452791408531_0001_00_000001 completed successfully
2016-01-14 17:10:08,813 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452791408531_0001_1, queueSize=0
2016-01-14 17:10:08,813 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:10:08,814 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791408531_0001_1][Event:DAG_FINISHED]: dagId=dag_1452791408531_0001_1, startTime=1452791408713, finishTime=1452791408811, timeTaken=98, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=192, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=409993216, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791408785, Process_Duration=5, Process_End_Time=1452791408790, Read_Duration=1, Tuples_Read=12, Tuples_Written=12, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=12, Tuples_Written=12
2016-01-14 17:10:08,815 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452791408531_0001_1 finished with state: SUCCEEDED
2016-01-14 17:10:08,815 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791408531_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:10:08,816 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452791408531_0001_00_000001
2016-01-14 17:10:08,817 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791408531_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:10:08 Completed Dag: dag_1452791408531_0001_1
2016-01-14 17:10:08,818 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452791408531_0001_1, dagState=SUCCEEDED
2016-01-14 17:10:08,819 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791408531_0001_1_post
2016-01-14 17:10:08,820 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:08,820 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:10:08,823 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...Text/quoted/normcharfalse, applicationId=application_1452791408531_0001
2016-01-14 17:10:08,825 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:10:08,826 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:10:08,826 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:10:08,826 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:10:08,826 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:10:08,826 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:10:08,827 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:10:08,827 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:10:08,827 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:10:08,828 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:10:08,828 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:10:08,829 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:10:08,829 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:10:08,832 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A289E8BFDC85456EA10FE0EAD3FFA2D5/AE7C4B2611294AE0BB27F711346047D0/.tez/application_1452791408531_0001
2016-01-14 17:10:08,833 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.322
2016-01-14 17:10:08,956 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testQuotedText/quoted/normcharfalse
2016-01-14 17:10:09,101 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:10:09,102 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:10:09,162 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 17:10:09,170 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 17:10:09,171 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:09,171 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:09,171 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:10:09,194 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt
2016-01-14 17:10:09,195 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-01-14 17:10:09,222 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 17:10:09,223 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 17:10:09,223 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-01-14 17:10:09,224 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 17:10:09,224 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 17:10:09,224 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 17:10:09,224 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...oercion/testFieldCoercion
2016-01-14 17:10:09,225 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:10:09,244 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 17:10:09,249 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:09,249 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:10:09,250 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:10:09,259 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F/.tez/application_1452791409249_0001 doesn't exist and is created
2016-01-14 17:10:09,279 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:10:09,279 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:09,280 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F/.tez/application_1452791409249_0001
2016-01-14 17:10:09,285 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452791409249_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:09,301 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:10:09,302 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:10:09,303 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:10:09,304 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:10:09,304 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F/.tez/application_1452791409249_0001/localmode-log-dir
2016-01-14 17:10:09,304 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F/.tez/application_1452791409249_0001/localmode-log-dir/history.txt.appattempt_1452791409249_0001_000000, maxErrors=10
2016-01-14 17:10:09,304 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:10:09,305 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452791409249_0001_000000, appSubmitTime=1452791409285, launchTime=1452791409285
2016-01-14 17:10:09,309 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:10:09,312 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:10:09,313 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:10:09,314 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:10:09,315 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:55667
2016-01-14 17:10:09,317 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:10:09,319 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452791409249_0001_000000, startTime=1452791409319
2016-01-14 17:10:09,319 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:10:09,320 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:10:09,380 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:10:09,380 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:10:09,380 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452791409249_0001, dagName=[74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 17:10:09,405 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 17:10:09,408 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452791409249_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F/.tez/application_1452791409249_0001/localmode-log-dir/dag_1452791409249_0001_1.dot
2016-01-14 17:10:09,409 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F/.tez/application_1452791409249_0001/localmode-log-dir/dag_1452791409249_0001_1-tez-dag.pb.txt
2016-01-14 17:10:09,438 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791409249_0001_1
2016-01-14 17:10:09,438 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:09,438 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 17:10:09 Running Dag: dag_1452791409249_0001_1
2016-01-14 17:10:09,458 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452791409249_0001_1, submitTime=1452791409405
2016-01-14 17:10:09,458 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C899A31F0EE94AF4BCB2D89F466E4812
2016-01-14 17:10:09,459 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:10:09,459 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452791409249_0001_1, initTime=1452791409458
2016-01-14 17:10:09,458 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:10:09,462 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:10:09,463 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791409249_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:10:09,464 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:DAG_STARTED]: dagID=dag_1452791409249_0001_1, startTime=1452791409463
2016-01-14 17:10:09,464 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452791409249_0001, dagName=[74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F] pipe/(1/1) ...oercion/testFieldCoercion
2016-01-14 17:10:09,464 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:10:09,465 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791409249_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:10:09,465 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C899A31F0EE94AF4BCB2D89F466E4812 : {93C698BA04034A35AE25167CF19389B3={InputName=93C698BA04034A35AE25167CF19389B3}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:10:09,465 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 93C698BA04034A35AE25167CF19389B3, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:10:09,465 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,465 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,465 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,466 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]. Starting root input initializers: 1
2016-01-14 17:10:09,466 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:10:09,468 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:10:09,472 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 93C698BA04034A35AE25167CF19389B3 on vertex vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,475 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:10:09,476 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 93C698BA04034A35AE25167CF19389B3 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:10:09,476 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:10:09,478 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:10:09,481 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 420
2016-01-14 17:10:09,482 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 93C698BA04034A35AE25167CF19389B3 on vertex vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,482 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:09,482 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {93C698BA04034A35AE25167CF19389B3=forAllWorkUnits=true, update=[1]}
2016-01-14 17:10:09,482 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812] parallelism set to 1
2016-01-14 17:10:09,483 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:09,483 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452791409249_0001_1_00, eventCount=1
2016-01-14 17:10:09,483 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,483 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=3FB6B6064BC34D0E97FFF40BC378E90A, vertexId=vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:10:09,484 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=3FB6B6064BC34D0E97FFF40BC378E90A, vertexId=vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,491 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=3FB6B6064BC34D0E97FFF40BC378E90A, vertexName=C899A31F0EE94AF4BCB2D89F466E4812, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:10:09,492 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=3FB6B6064BC34D0E97FFF40BC378E90A, vertexId=vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,494 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:10:09,494 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C899A31F0EE94AF4BCB2D89F466E4812, vertexId=vertex_1452791409249_0001_1_00, initRequestedTime=1452791409465, initedTime=1452791409494, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:10:09,495 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812] with distanceFromRoot: 0
2016-01-14 17:10:09,495 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:10:09,495 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C899A31F0EE94AF4BCB2D89F466E4812
2016-01-14 17:10:09,496 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,496 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:10:09,497 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452791409249_0001_1_00, startRequestedTime=1452791409495, startedTime=1452791409495
2016-01-14 17:10:09,497 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:10:09,498 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:10:09,498 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:TASK_STARTED]: vertexName=C899A31F0EE94AF4BCB2D89F466E4812, taskId=task_1452791409249_0001_1_00_000000, scheduledTime=1452791409497, launchTime=1452791409497
2016-01-14 17:10:09,498 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791409249_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:10:09,499 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,499 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: C899A31F0EE94AF4BCB2D89F466E4812, VertexParallelism: 1, TaskAttemptID:attempt_1452791409249_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=93C698BA04034A35AE25167CF19389B3, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3FB6B6064BC34D0E97FFF40BC378E90A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:09,500 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791409249_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:10:09,500 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:10:09,502 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452791409249_0001, with dag id: dag_1452791409249_0001_1
2016-01-14 17:10:09,502 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:10:09,505 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:10:09,505 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:10:09,506 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452791409249_0001_00_000001
2016-01-14 17:10:09,506 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791409249_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:10:09,508 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452791409249_0001_00_000001
2016-01-14 17:10:09,508 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:10:09,512 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791409249_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:10:09,512 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:10:09,513 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452791409249_0001_00_000001, launchTime=1452791409512
2016-01-14 17:10:09,514 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791409249_0001_00_000001
2016-01-14 17:10:09,515 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452791409249_0001_1_00_000000_0] to container: [container_1452791409249_0001_00_000001]
2016-01-14 17:10:09,516 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791409249_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:10:09,516 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452791409249_0001_1_00_000000_0] started. Is using containerId: [container_1452791409249_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:10:09,517 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C899A31F0EE94AF4BCB2D89F466E4812, taskAttemptId=attempt_1452791409249_0001_1_00_000000_0, startTime=1452791409516, containerId=container_1452791409249_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452791409249_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:10:09,517 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791409249_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:10:09,517 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:10:09,517 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791409249_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:10:09,517 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452791409249_0001_00_000001 given task: attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09,517 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791409249_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09 Starting to run new task attempt: attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09,518 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09,518 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:09,518 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:10:09,519 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:10:09,519 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:10:09,519 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:10:09,519 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:10:09,519 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F] pipe/(1/1) ...oercion/testFieldCoercion, VertexName: C899A31F0EE94AF4BCB2D89F466E4812, VertexParallelism: 1, TaskAttemptID:attempt_1452791409249_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=93C698BA04034A35AE25167CF19389B3, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3FB6B6064BC34D0E97FFF40BC378E90A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:09,520 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:10:09,520 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09,522 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:10:09,522 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:09,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=93C698BA04034A35AE25167CF19389B3, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:10:09,524 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452791409249_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:10:09,525 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:10:09,525 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 93C698BA04034A35AE25167CF19389B3
2016-01-14 17:10:09,526 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 93C698BA04034A35AE25167CF19389B3
2016-01-14 17:10:09,528 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:09,528 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=3FB6B6064BC34D0E97FFF40BC378E90A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:10:09,529 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:10:09,529 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 3FB6B6064BC34D0E97FFF40BC378E90A
2016-01-14 17:10:09,529 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:10:09,530 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 3FB6B6064BC34D0E97FFF40BC378E90A
2016-01-14 17:10:09,535 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:10:09,538 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:10:09,544 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 93C698BA04034A35AE25167CF19389B3
2016-01-14 17:10:09,545 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 93C698BA04034A35AE25167CF19389B3
2016-01-14 17:10:09,559 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C899A31F0EE94AF4BCB2D89F466E4812, ordinal: 0
2016-01-14 17:10:09,560 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C899A31F0EE94AF4BCB2D89F466E4812, mem on start (mb), free: 150, total: 391, max: 672
2016-01-14 17:10:09,560 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:09,560 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:10:09,560 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 3FB6B6064BC34D0E97FFF40BC378E90A
2016-01-14 17:10:09,560 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:10:09,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:10:09,562 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:10:09,562 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:10:09,563 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:10:09,563 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:09,564 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:10:09,564 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:09,565 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:10:09,565 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:10:09,566 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 93C698BA04034A35AE25167CF19389B3, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:10:09,566 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 3FB6B6064BC34D0E97FFF40BC378E90A, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:10:09,567 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:10:09,567 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 93C698BA04034A35AE25167CF19389B3
2016-01-14 17:10:09,567 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:09,568 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 93C698BA04034A35AE25167CF19389B3
2016-01-14 17:10:09,568 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 93C698BA04034A35AE25167CF19389B3 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:10:09,569 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:10:09,569 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:10:09,569 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:10:09,571 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09,572 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:10:09,574 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2759c18f
2016-01-14 17:10:09,575 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2759c18f
2016-01-14 17:10:09,575 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:10:09,576 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:10:09,579 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 17:10:09,587 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"] streamed: true, id: 93C698BA04034A35AE25167CF19389B3
2016-01-14 17:10:09,587 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"], id: 3FB6B6064BC34D0E97FFF40BC378E90A
2016-01-14 17:10:09,588 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion"]
2016-01-14 17:10:09,726 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/apache-clean.10.txt"]
2016-01-14 17:10:09,726 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:09,727 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C899A31F0EE94AF4BCB2D89F466E4812, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:10:09,736 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:10:09,737 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:10:09,738 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09,738 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452791409249_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:10:09,739 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09,740 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C899A31F0EE94AF4BCB2D89F466E4812, mem on close (mb), free: 359, total: 392, max: 672
2016-01-14 17:10:09 Completed running task attempt: attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09,741 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452791409249_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:10:09,742 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=31, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10][cascading.flow.SliceCounters Process_Begin_Time=1452791409728, Process_Duration=11, Process_End_Time=1452791409739, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=9, Tuples_Written=9]]
2016-01-14 17:10:09,744 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:10:09,743 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C899A31F0EE94AF4BCB2D89F466E4812, taskAttemptId=attempt_1452791409249_0001_1_00_000000_0, startTime=1452791409516, finishTime=1452791409742, timeTaken=226, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=31, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452791409728, Process_Duration=11, Process_End_Time=1452791409739, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 17:10:09,745 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:10:09,747 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791409249_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:10:09,747 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:09,747 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09,748 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:TASK_FINISHED]: vertexName=C899A31F0EE94AF4BCB2D89F466E4812, taskId=task_1452791409249_0001_1_00_000000, startTime=1452791409516, finishTime=1452791409747, timeTaken=231, status=SUCCEEDED, successfulAttemptID=attempt_1452791409249_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=31, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452791409728, Process_Duration=11, Process_End_Time=1452791409739, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 17:10:09,748 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791409249_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:10:09,748 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812] : 1
2016-01-14 17:10:09,748 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,749 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:10:09,747 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791409249_0001_00_000001
2016-01-14 17:10:09,747 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:10:09,753 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:10:09,753 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:VERTEX_FINISHED]: vertexName=C899A31F0EE94AF4BCB2D89F466E4812, vertexId=vertex_1452791409249_0001_1_00, initRequestedTime=1452791409465, initedTime=1452791409494, startRequestedTime=1452791409495, startedTime=1452791409495, finishTime=1452791409749, timeTaken=254, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=31, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452791409728, Process_Duration=11, Process_End_Time=1452791409739, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9, vertexStats=firstTaskStartTime=1452791409516, firstTasksToStart=[ task_1452791409249_0001_1_00_000000 ], lastTaskFinishTime=1452791409742, lastTasksToFinish=[ task_1452791409249_0001_1_00_000000 ], minTaskDuration=226, maxTaskDuration=226, avgTaskDuration=226.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452791409249_0001_1_00_000000 ], longestDurationTasks=[ task_1452791409249_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:10:09,753 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:10:09,754 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791409249_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:10:09,754 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452791409249_0001_00_000001, stoppedTime=1452791409754, exitStatus=0
2016-01-14 17:10:09,754 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791409249_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:10:09,754 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:10:09,754 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:10:09,754 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452791409249_0001_1
2016-01-14 17:10:09,755 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452791409249_0001_1
2016-01-14 17:10:09,755 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 3FB6B6064BC34D0E97FFF40BC378E90A for vertex: vertex_1452791409249_0001_1_00 [C899A31F0EE94AF4BCB2D89F466E4812]
2016-01-14 17:10:09,763 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452791409249_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:10:09,763 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791409249_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:10:09,763 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452791409249_0001_00_000001, Exiting
2016-01-14 17:10:09,763 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452791409249_0001_00_000001
2016-01-14 17:10:09,763 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452791409249_0001_00_000001
2016-01-14 17:10:09,766 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452791409249_0001_1, queueSize=0
2016-01-14 17:10:09,766 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:10:09,767 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791409249_0001_1][Event:DAG_FINISHED]: dagId=dag_1452791409249_0001_1, startTime=1452791409463, finishTime=1452791409764, timeTaken=301, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=2174, FILE_BYTES_WRITTEN=1306, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=31, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=10, cascading.flow.SliceCounters, Process_Begin_Time=1452791409728, Process_Duration=11, Process_End_Time=1452791409739, Read_Duration=1, Tuples_Read=9, Tuples_Written=9, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=9, Tuples_Written=9
2016-01-14 17:10:09,767 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452791409249_0001_1 finished with state: SUCCEEDED
2016-01-14 17:10:09,767 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791409249_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:10:09 Completed Dag: dag_1452791409249_0001_1
2016-01-14 17:10:09,768 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452791409249_0001_1, dagState=SUCCEEDED
2016-01-14 17:10:09,768 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791409249_0001_1_post
2016-01-14 17:10:09,768 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:09,768 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452791409249_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 17:10:09,768 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:10:09,769 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791409249_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 17:10:09,771 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452791409249_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:10:09,773 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452791409249_0001_00_000001 completed successfully
2016-01-14 17:10:09,773 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791409249_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 17:10:09,777 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...oercion/testFieldCoercion, applicationId=application_1452791409249_0001
2016-01-14 17:10:09,780 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:10:09,780 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:10:09,780 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:10:09,780 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:10:09,780 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:10:09,781 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:10:09,782 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:10:09,783 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:10:09,783 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:10:09,783 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:10:09,784 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:10:09,785 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:10:09,785 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:10:09,791 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/74E6CE3A44FA4421AD017CE1B6EDE5C7/E412E277732541C5A087259EED85E61F/.tez/application_1452791409249_0001
2016-01-14 17:10:09,792 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.569
2016-01-14 17:10:09,833 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testFieldCoercion/testFieldCoercion
2016-01-14 17:10:09,862 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:10:09,863 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:10:09,936 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 17:10:09,945 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 17:10:09,946 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:09,946 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:09,946 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:10:09,963 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt
2016-01-14 17:10:09,968 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: __multisink_placeholder_4A612D14CEC3436992DC815A763608D2
2016-01-14 17:10:09,981 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 17:10:09,982 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 17:10:09,984 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-01-14 17:10:09,984 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 17:10:09,984 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 17:10:09,985 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 17:10:09,986 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...4CEC3436992DC815A763608D2
2016-01-14 17:10:09,986 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:10:10,000 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 17:10:10,006 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:10,006 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:10:10,006 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:10:10,017 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F/.tez/application_1452791410006_0001 doesn't exist and is created
2016-01-14 17:10:10,041 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:10:10,041 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:10,042 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F/.tez/application_1452791410006_0001
2016-01-14 17:10:10,048 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452791410006_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:10,066 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:10:10,069 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:10:10,072 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:10:10,072 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:10:10,073 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F/.tez/application_1452791410006_0001/localmode-log-dir
2016-01-14 17:10:10,074 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F/.tez/application_1452791410006_0001/localmode-log-dir/history.txt.appattempt_1452791410006_0001_000000, maxErrors=10
2016-01-14 17:10:10,074 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:10:10,075 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452791410006_0001_000000, appSubmitTime=1452791410047, launchTime=1452791410047
2016-01-14 17:10:10,080 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:10:10,083 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:10:10,085 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:10:10,085 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:10:10,092 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:55931
2016-01-14 17:10:10,094 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:10:10,097 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:10:10,098 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452791410006_0001_000000, startTime=1452791410097
2016-01-14 17:10:10,098 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:10:10,141 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:10:10,141 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:10:10,142 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...4CEC3436992DC815A763608D2, applicationId=application_1452791410006_0001, dagName=[A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F] pipe/(1/1) ...4CEC3436992DC815A763608D2
2016-01-14 17:10:10,168 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F] pipe/(1/1) ...4CEC3436992DC815A763608D2
2016-01-14 17:10:10,171 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452791410006_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F/.tez/application_1452791410006_0001/localmode-log-dir/dag_1452791410006_0001_1.dot
2016-01-14 17:10:10,172 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F/.tez/application_1452791410006_0001/localmode-log-dir/dag_1452791410006_0001_1-tez-dag.pb.txt
2016-01-14 17:10:10,183 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791410006_0001_1
2016-01-14 17:10:10,183 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:10,183 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F] pipe/(1/1) ...4CEC3436992DC815A763608D2
2016-01-14 17:10:10 Running Dag: dag_1452791410006_0001_1
2016-01-14 17:10:10,197 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452791410006_0001_1, submitTime=1452791410169
2016-01-14 17:10:10,197 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:10:10,198 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex EEF2BF2FCFDB401893D0E9AEA2C3213A
2016-01-14 17:10:10,198 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:10:10,198 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452791410006_0001_1, initTime=1452791410198
2016-01-14 17:10:10,198 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:10:10,198 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791410006_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:10:10,201 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:DAG_STARTED]: dagID=dag_1452791410006_0001_1, startTime=1452791410201
2016-01-14 17:10:10,201 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:10:10,201 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:10:10,202 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...4CEC3436992DC815A763608D2, applicationId=application_1452791410006_0001, dagName=[A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F] pipe/(1/1) ...4CEC3436992DC815A763608D2
2016-01-14 17:10:10,202 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791410006_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:10:10,203 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: EEF2BF2FCFDB401893D0E9AEA2C3213A : {AB1314B011444ACF872D8989DACCF7F1={InputName=AB1314B011444ACF872D8989DACCF7F1}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:10:10,204 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: AB1314B011444ACF872D8989DACCF7F1, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:10:10,204 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,204 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,204 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,204 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]. Starting root input initializers: 1
2016-01-14 17:10:10,208 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:10:10,208 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: AB1314B011444ACF872D8989DACCF7F1 on vertex vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,211 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:10:10,212 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input AB1314B011444ACF872D8989DACCF7F1 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:10:10,213 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:10:10,214 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:10:10,217 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 422
2016-01-14 17:10:10,218 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: AB1314B011444ACF872D8989DACCF7F1 on vertex vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,218 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:10,218 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {AB1314B011444ACF872D8989DACCF7F1=forAllWorkUnits=true, update=[1]}
2016-01-14 17:10:10,219 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A] parallelism set to 1
2016-01-14 17:10:10,219 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:10,219 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452791410006_0001_1_00, eventCount=1
2016-01-14 17:10:10,220 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,220 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=76CCFAF056B3434C9390E0852F23EECE, vertexId=vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:10:10,221 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=76CCFAF056B3434C9390E0852F23EECE, vertexId=vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,222 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(120)) - Using mapred newApiCommitter.
2016-01-14 17:10:10,223 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=76CCFAF056B3434C9390E0852F23EECE, vertexName=EEF2BF2FCFDB401893D0E9AEA2C3213A, outputCommitterClass=org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2016-01-14 17:10:10,224 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=76CCFAF056B3434C9390E0852F23EECE, vertexId=vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,224 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452791410006_0001, with dag id: dag_1452791410006_0001_1
2016-01-14 17:10:10,226 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:VERTEX_INITIALIZED]: vertexName=EEF2BF2FCFDB401893D0E9AEA2C3213A, vertexId=vertex_1452791410006_0001_1_00, initRequestedTime=1452791410203, initedTime=1452791410226, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:10:10,226 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A] with distanceFromRoot: 0
2016-01-14 17:10:10,226 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:10:10,226 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:10:10,227 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in EEF2BF2FCFDB401893D0E9AEA2C3213A
2016-01-14 17:10:10,228 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,228 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:10:10,228 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452791410006_0001_1_00, startRequestedTime=1452791410227, startedTime=1452791410227
2016-01-14 17:10:10,228 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:10:10,229 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:10:10,229 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:TASK_STARTED]: vertexName=EEF2BF2FCFDB401893D0E9AEA2C3213A, taskId=task_1452791410006_0001_1_00_000000, scheduledTime=1452791410229, launchTime=1452791410229
2016-01-14 17:10:10,229 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791410006_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:10:10,231 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,235 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F] pipe/(1/1) ...4CEC3436992DC815A763608D2, VertexName: EEF2BF2FCFDB401893D0E9AEA2C3213A, VertexParallelism: 1, TaskAttemptID:attempt_1452791410006_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=AB1314B011444ACF872D8989DACCF7F1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=76CCFAF056B3434C9390E0852F23EECE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:10,237 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791410006_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:10:10,241 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:10:10,242 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:10:10,243 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:10:10,244 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:10:10,244 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452791410006_0001_00_000001
2016-01-14 17:10:10,245 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410006_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:10:10,247 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452791410006_0001_00_000001
2016-01-14 17:10:10,247 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:10:10,247 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410006_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:10:10,248 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:10:10,248 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452791410006_0001_00_000001, launchTime=1452791410247
2016-01-14 17:10:10,249 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791410006_0001_00_000001
2016-01-14 17:10:10,250 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452791410006_0001_1_00_000000_0] to container: [container_1452791410006_0001_00_000001]
2016-01-14 17:10:10,251 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410006_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:10:10,251 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452791410006_0001_00_000001 given task: attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10,251 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791410006_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10,252 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452791410006_0001_1_00_000000_0] started. Is using containerId: [container_1452791410006_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:10:10,253 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:10:10,253 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=EEF2BF2FCFDB401893D0E9AEA2C3213A, taskAttemptId=attempt_1452791410006_0001_1_00_000000_0, startTime=1452791410251, containerId=container_1452791410006_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452791410006_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:10:10,253 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791410006_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:10:10 Starting to run new task attempt: attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10,255 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10,255 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791410006_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:10:10,255 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:10,256 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:10:10,256 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:10:10,256 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:10:10,256 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:10:10,256 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:10:10,256 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F] pipe/(1/1) ...4CEC3436992DC815A763608D2, VertexName: EEF2BF2FCFDB401893D0E9AEA2C3213A, VertexParallelism: 1, TaskAttemptID:attempt_1452791410006_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=AB1314B011444ACF872D8989DACCF7F1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=76CCFAF056B3434C9390E0852F23EECE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:10,256 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:10:10,258 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10,259 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:10:10,259 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:10,261 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452791410006_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:10:10,262 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=AB1314B011444ACF872D8989DACCF7F1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:10:10,262 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:10:10,263 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: AB1314B011444ACF872D8989DACCF7F1
2016-01-14 17:10:10,263 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: AB1314B011444ACF872D8989DACCF7F1
2016-01-14 17:10:10,265 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:10,268 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=76CCFAF056B3434C9390E0852F23EECE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:10:10,268 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:10:10,269 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:10:10,270 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 76CCFAF056B3434C9390E0852F23EECE
2016-01-14 17:10:10,270 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:10:10,272 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 76CCFAF056B3434C9390E0852F23EECE
2016-01-14 17:10:10,275 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:10:10,275 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: AB1314B011444ACF872D8989DACCF7F1
2016-01-14 17:10:10,276 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: AB1314B011444ACF872D8989DACCF7F1
2016-01-14 17:10:10,281 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: EEF2BF2FCFDB401893D0E9AEA2C3213A, ordinal: 0
2016-01-14 17:10:10,281 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EEF2BF2FCFDB401893D0E9AEA2C3213A, mem on start (mb), free: 280, total: 392, max: 672
2016-01-14 17:10:10,282 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:10,282 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:10:10,282 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:10:10,288 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: true
2016-01-14 17:10:10,288 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 76CCFAF056B3434C9390E0852F23EECE
2016-01-14 17:10:10,288 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:10:10,288 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:10:10,290 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:10:10,290 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:10,290 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:10:10,290 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:10,290 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:10:10,291 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:10:10,291 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, AB1314B011444ACF872D8989DACCF7F1, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:10:10,292 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 76CCFAF056B3434C9390E0852F23EECE, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:10:10,292 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:10:10,293 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: AB1314B011444ACF872D8989DACCF7F1
2016-01-14 17:10:10,293 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:10,293 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: AB1314B011444ACF872D8989DACCF7F1
2016-01-14 17:10:10,294 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: AB1314B011444ACF872D8989DACCF7F1 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:10:10,294 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:10:10,295 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:10:10,295 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:10:10,296 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10,296 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:10:10,299 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@73c8693
2016-01-14 17:10:10,300 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 17:10:10,301 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"] streamed: true, id: AB1314B011444ACF872D8989DACCF7F1
2016-01-14 17:10:10,302 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]], id: 76CCFAF056B3434C9390E0852F23EECE
2016-01-14 17:10:10,302 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@73c8693
2016-01-14 17:10:10,302 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:10:10,304 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:10:10,303 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]]]
2016-01-14 17:10:10,307 INFO  tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1"]
2016-01-14 17:10:10,314 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14527914100060_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14527914100060_0001_m_000000_0
2016-01-14 17:10:10,315 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 17:10:10,325 INFO  tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2"]
2016-01-14 17:10:10,331 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(105)) - setting up task: 'attempt_14527914100060_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14527914100060_0001_m_000000_0
2016-01-14 17:10:10,331 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(117)) - creating path: part-00000
2016-01-14 17:10:10,337 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-header.txt"]
2016-01-14 17:10:10,337 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:10,338 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: EEF2BF2FCFDB401893D0E9AEA2C3213A, all 1 inputs ready in: 00:00:00.001
2016-01-14 17:10:10,342 INFO  io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/part-00000
2016-01-14 17:10:10,343 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14527914100060_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1/_temporary/_attempt_14527914100060_0001_m_000000_0
2016-01-14 17:10:10,347 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14527914100060_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-01-14 17:10:10,347 INFO  io.TapOutputCollector (TapOutputCollector.java:close(150)) - closing tap collector for: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/part-00000
2016-01-14 17:10:10,348 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(162)) - committing task: 'attempt_14527914100060_0001_m_000000_0' - file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2/_temporary/_attempt_14527914100060_0001_m_000000_0
2016-01-14 17:10:10,352 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(179)) - saved output of task 'attempt_14527914100060_0001_m_000000_0' to file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-01-14 17:10:10,353 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10,353 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452791410006_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:10:10,353 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:10:10,353 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:10:10,354 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10,354 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EEF2BF2FCFDB401893D0E9AEA2C3213A, mem on close (mb), free: 272, total: 392, max: 672
2016-01-14 17:10:10 Completed running task attempt: attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10,355 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452791410006_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:10:10,356 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:10:10,356 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=EEF2BF2FCFDB401893D0E9AEA2C3213A, taskAttemptId=attempt_1452791410006_0001_1_00_000000_0, startTime=1452791410251, finishTime=1452791410356, timeTaken=105, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452791410338, Process_Duration=16, Process_End_Time=1452791410354, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 17:10:10,356 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791410006_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:10:10,357 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10,357 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:10:10,357 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:10:10,357 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:TASK_FINISHED]: vertexName=EEF2BF2FCFDB401893D0E9AEA2C3213A, taskId=task_1452791410006_0001_1_00_000000, startTime=1452791410251, finishTime=1452791410357, timeTaken=106, status=SUCCEEDED, successfulAttemptID=attempt_1452791410006_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452791410338, Process_Duration=16, Process_End_Time=1452791410354, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 17:10:10,357 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791410006_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:10:10,358 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A] : 1
2016-01-14 17:10:10,358 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,360 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:10:10,360 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:VERTEX_FINISHED]: vertexName=EEF2BF2FCFDB401893D0E9AEA2C3213A, vertexId=vertex_1452791410006_0001_1_00, initRequestedTime=1452791410203, initedTime=1452791410226, startRequestedTime=1452791410227, startedTime=1452791410227, finishTime=1452791410358, timeTaken=131, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452791410338, Process_Duration=16, Process_End_Time=1452791410354, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13, vertexStats=firstTaskStartTime=1452791410251, firstTasksToStart=[ task_1452791410006_0001_1_00_000000 ], lastTaskFinishTime=1452791410356, lastTasksToFinish=[ task_1452791410006_0001_1_00_000000 ], minTaskDuration=105, maxTaskDuration=105, avgTaskDuration=105.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452791410006_0001_1_00_000000 ], longestDurationTasks=[ task_1452791410006_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:10:10,360 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:10:10,361 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410006_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:10:10,361 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452791410006_0001_00_000001, stoppedTime=1452791410361, exitStatus=0
2016-01-14 17:10:10,361 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:10:10,361 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410006_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:10:10,361 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:10:10,361 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452791410006_0001_1
2016-01-14 17:10:10,363 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452791410006_0001_1
2016-01-14 17:10:10,363 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 76CCFAF056B3434C9390E0852F23EECE for vertex: vertex_1452791410006_0001_1_00 [EEF2BF2FCFDB401893D0E9AEA2C3213A]
2016-01-14 17:10:10,363 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452791410338, Process_Duration=16, Process_End_Time=1452791410354, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=13, Tuples_Written=13]]
2016-01-14 17:10:10,364 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:10:10,364 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:10,364 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791410006_0001_00_000001
2016-01-14 17:10:10,365 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452791410006_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:10:10,365 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791410006_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:10:10,365 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452791410006_0001_00_000001, Exiting
2016-01-14 17:10:10,365 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452791410006_0001_00_000001
2016-01-14 17:10:10,365 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452791410006_0001_00_000001
2016-01-14 17:10:10,367 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452791410006_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:10:10,368 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452791410006_0001_00_000001 completed successfully
2016-01-14 17:10:10,373 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452791410006_0001_1, queueSize=0
2016-01-14 17:10:10,374 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:10:10,374 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410006_0001_1][Event:DAG_FINISHED]: dagId=dag_1452791410006_0001_1, startTime=1452791410201, finishTime=1452791410372, timeTaken=171, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=366, FILE_BYTES_WRITTEN=464, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452791410338, Process_Duration=16, Process_End_Time=1452791410354, Read_Duration=1, Tuples_Read=13, Tuples_Written=13, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=13, Tuples_Written=13
2016-01-14 17:10:10,374 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452791410006_0001_1 finished with state: SUCCEEDED
2016-01-14 17:10:10,375 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791410006_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:10:10,375 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452791410006_0001_00_000001
2016-01-14 17:10:10,375 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410006_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:10:10 Completed Dag: dag_1452791410006_0001_1
2016-01-14 17:10:10,376 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452791410006_0001_1, dagState=SUCCEEDED
2016-01-14 17:10:10,377 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791410006_0001_1_post
2016-01-14 17:10:10,377 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:10,377 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:10:10,382 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...4CEC3436992DC815A763608D2, applicationId=application_1452791410006_0001
2016-01-14 17:10:10,384 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:10:10,384 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:10:10,384 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:10:10,384 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:10:10,384 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:10:10,385 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:10:10,385 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:10:10,385 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:10:10,386 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:10:10,386 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:10:10,386 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:10:10,387 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:10:10,387 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:10:10,391 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/A57B7A785DD246298F21124584BD5435/F5E4EC526C2F4AD29C5C343705DA784F/.tez/application_1452791410006_0001
2016-01-14 17:10:10,392 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.410
2016-01-14 17:10:10,522 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall2
2016-01-14 17:10:10,522 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeaderFieldsAll/headerfieldsall1
2016-01-14 17:10:10,547 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:10:10,547 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:10:10,585 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 17:10:10,599 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 17:10:10,600 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:10,601 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:10,601 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:10:10,622 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt
2016-01-14 17:10:10,623 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header
2016-01-14 17:10:10,634 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 17:10:10,635 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:10,635 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-01-14 17:10:10,635 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 17:10:10,635 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 17:10:10,635 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 17:10:10,636 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...latform/testHeader/header
2016-01-14 17:10:10,636 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:10:10,650 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 17:10:10,655 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:10,656 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:10:10,656 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:10:10,666 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684/.tez/application_1452791410656_0001 doesn't exist and is created
2016-01-14 17:10:10,683 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:10:10,683 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:10,684 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684/.tez/application_1452791410656_0001
2016-01-14 17:10:10,687 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452791410656_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:10,699 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:10:10,700 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:10:10,702 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:10:10,703 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:10:10,703 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684/.tez/application_1452791410656_0001/localmode-log-dir
2016-01-14 17:10:10,703 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684/.tez/application_1452791410656_0001/localmode-log-dir/history.txt.appattempt_1452791410656_0001_000000, maxErrors=10
2016-01-14 17:10:10,704 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:10:10,704 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452791410656_0001_000000, appSubmitTime=1452791410687, launchTime=1452791410687
2016-01-14 17:10:10,712 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:10:10,712 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:45237
2016-01-14 17:10:10,714 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:10:10,716 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:10:10,717 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:10:10,719 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:10:10,720 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452791410656_0001_000000, startTime=1452791410720
2016-01-14 17:10:10,720 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:10:10,720 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:10:10,784 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:10:10,784 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:10:10,784 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452791410656_0001, dagName=[FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684] pipe/(1/1) ...latform/testHeader/header
2016-01-14 17:10:10,801 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684] pipe/(1/1) ...latform/testHeader/header
2016-01-14 17:10:10,802 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452791410656_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684/.tez/application_1452791410656_0001/localmode-log-dir/dag_1452791410656_0001_1.dot
2016-01-14 17:10:10,803 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684/.tez/application_1452791410656_0001/localmode-log-dir/dag_1452791410656_0001_1-tez-dag.pb.txt
2016-01-14 17:10:10,813 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791410656_0001_1
2016-01-14 17:10:10,813 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:10,814 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684] pipe/(1/1) ...latform/testHeader/header
2016-01-14 17:10:10 Running Dag: dag_1452791410656_0001_1
2016-01-14 17:10:10,827 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:10:10,827 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452791410656_0001_1, submitTime=1452791410801
2016-01-14 17:10:10,828 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex DC0A4D4E47CA482F958C855BA63760C9
2016-01-14 17:10:10,828 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:10:10,829 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:10:10,830 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452791410656_0001_1, initTime=1452791410828
2016-01-14 17:10:10,830 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791410656_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:10:10,830 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:DAG_STARTED]: dagID=dag_1452791410656_0001_1, startTime=1452791410830
2016-01-14 17:10:10,831 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:10:10,831 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791410656_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:10:10,831 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: DC0A4D4E47CA482F958C855BA63760C9 : {26C855F1B612450F8BCC6EB017D237EC={InputName=26C855F1B612450F8BCC6EB017D237EC}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:10:10,831 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 26C855F1B612450F8BCC6EB017D237EC, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:10:10,831 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,830 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:10:10,832 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452791410656_0001, dagName=[FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684] pipe/(1/1) ...latform/testHeader/header
2016-01-14 17:10:10,831 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,832 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,832 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]. Starting root input initializers: 1
2016-01-14 17:10:10,833 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:10:10,833 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 26C855F1B612450F8BCC6EB017D237EC on vertex vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,835 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:10:10,835 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 26C855F1B612450F8BCC6EB017D237EC asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:10:10,836 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:10:10,837 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:10:10,838 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 408
2016-01-14 17:10:10,839 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 26C855F1B612450F8BCC6EB017D237EC on vertex vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,839 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:10,839 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {26C855F1B612450F8BCC6EB017D237EC=forAllWorkUnits=true, update=[1]}
2016-01-14 17:10:10,840 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9] parallelism set to 1
2016-01-14 17:10:10,840 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:10,840 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452791410656_0001_1_00, eventCount=1
2016-01-14 17:10:10,840 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,842 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=A3E56F132AF04C41BE8063DF3B66CEAF, vertexId=vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:10:10,842 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=A3E56F132AF04C41BE8063DF3B66CEAF, vertexId=vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,844 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=A3E56F132AF04C41BE8063DF3B66CEAF, vertexName=DC0A4D4E47CA482F958C855BA63760C9, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:10:10,844 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=A3E56F132AF04C41BE8063DF3B66CEAF, vertexId=vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,846 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:10:10,846 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:VERTEX_INITIALIZED]: vertexName=DC0A4D4E47CA482F958C855BA63760C9, vertexId=vertex_1452791410656_0001_1_00, initRequestedTime=1452791410831, initedTime=1452791410846, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:10:10,846 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9] with distanceFromRoot: 0
2016-01-14 17:10:10,846 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:10:10,847 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in DC0A4D4E47CA482F958C855BA63760C9
2016-01-14 17:10:10,847 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,848 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:10:10,848 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452791410656_0001_1_00, startRequestedTime=1452791410847, startedTime=1452791410847
2016-01-14 17:10:10,848 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:10:10,849 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:10:10,849 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:TASK_STARTED]: vertexName=DC0A4D4E47CA482F958C855BA63760C9, taskId=task_1452791410656_0001_1_00_000000, scheduledTime=1452791410849, launchTime=1452791410849
2016-01-14 17:10:10,850 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791410656_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:10:10,850 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,850 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684] pipe/(1/1) ...latform/testHeader/header, VertexName: DC0A4D4E47CA482F958C855BA63760C9, VertexParallelism: 1, TaskAttemptID:attempt_1452791410656_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=26C855F1B612450F8BCC6EB017D237EC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A3E56F132AF04C41BE8063DF3B66CEAF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:10,851 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791410656_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:10:10,851 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:10:10,852 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:10:10,852 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452791410656_0001, with dag id: dag_1452791410656_0001_1
2016-01-14 17:10:10,853 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:10:10,853 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:10:10,854 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452791410656_0001_00_000001
2016-01-14 17:10:10,854 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410656_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:10:10,855 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452791410656_0001_00_000001
2016-01-14 17:10:10,857 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:10:10,858 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410656_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:10:10,859 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452791410656_0001_00_000001, launchTime=1452791410858
2016-01-14 17:10:10,859 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:10:10,859 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791410656_0001_00_000001
2016-01-14 17:10:10,861 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452791410656_0001_1_00_000000_0] to container: [container_1452791410656_0001_00_000001]
2016-01-14 17:10:10,862 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410656_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:10:10,862 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452791410656_0001_00_000001 given task: attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10,862 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452791410656_0001_1_00_000000_0] started. Is using containerId: [container_1452791410656_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:10:10,863 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=DC0A4D4E47CA482F958C855BA63760C9, taskAttemptId=attempt_1452791410656_0001_1_00_000000_0, startTime=1452791410862, containerId=container_1452791410656_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452791410656_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:10:10,863 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791410656_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:10:10,863 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791410656_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:10:10,862 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791410656_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10,863 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:10:10 Starting to run new task attempt: attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10,864 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10,864 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:10,864 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:10:10,864 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:10:10,865 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:10:10,865 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:10:10,865 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:10:10,865 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684] pipe/(1/1) ...latform/testHeader/header, VertexName: DC0A4D4E47CA482F958C855BA63760C9, VertexParallelism: 1, TaskAttemptID:attempt_1452791410656_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=26C855F1B612450F8BCC6EB017D237EC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A3E56F132AF04C41BE8063DF3B66CEAF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:10,865 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:10:10,866 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10,866 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:10:10,866 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:10,867 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:10,867 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=26C855F1B612450F8BCC6EB017D237EC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:10:10,868 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452791410656_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:10:10,867 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=A3E56F132AF04C41BE8063DF3B66CEAF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:10:10,870 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:10:10,870 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: A3E56F132AF04C41BE8063DF3B66CEAF
2016-01-14 17:10:10,870 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:10:10,871 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: A3E56F132AF04C41BE8063DF3B66CEAF
2016-01-14 17:10:10,870 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:10:10,870 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:10:10,872 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 26C855F1B612450F8BCC6EB017D237EC
2016-01-14 17:10:10,875 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 26C855F1B612450F8BCC6EB017D237EC
2016-01-14 17:10:10,877 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:10:10,877 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 26C855F1B612450F8BCC6EB017D237EC
2016-01-14 17:10:10,878 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 26C855F1B612450F8BCC6EB017D237EC
2016-01-14 17:10:10,883 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: DC0A4D4E47CA482F958C855BA63760C9, ordinal: 0
2016-01-14 17:10:10,883 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DC0A4D4E47CA482F958C855BA63760C9, mem on start (mb), free: 190, total: 392, max: 672
2016-01-14 17:10:10,883 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:10,883 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:10:10,883 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:10:10,883 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: A3E56F132AF04C41BE8063DF3B66CEAF
2016-01-14 17:10:10,883 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:10:10,883 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:10:10,884 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:10:10,884 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:10:10,884 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:10,884 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:10:10,885 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:10,885 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:10:10,885 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:10:10,885 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, A3E56F132AF04C41BE8063DF3B66CEAF, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:10:10,885 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 26C855F1B612450F8BCC6EB017D237EC, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:10:10,886 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:10:10,886 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 26C855F1B612450F8BCC6EB017D237EC being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:10:10,886 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:10:10,886 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:10:10,886 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 26C855F1B612450F8BCC6EB017D237EC
2016-01-14 17:10:10,887 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:10,887 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 26C855F1B612450F8BCC6EB017D237EC
2016-01-14 17:10:10,888 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:10:10,888 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10,888 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:10:10,890 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7550658c
2016-01-14 17:10:10,891 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7550658c
2016-01-14 17:10:10,891 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:10:10,891 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:10:10,894 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:10,894 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"] streamed: true, id: 26C855F1B612450F8BCC6EB017D237EC
2016-01-14 17:10:10,894 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"], id: A3E56F132AF04C41BE8063DF3B66CEAF
2016-01-14 17:10:10,895 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testHeader/header"]
2016-01-14 17:10:10,895 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited.txt"]
2016-01-14 17:10:10,895 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:10,895 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: DC0A4D4E47CA482F958C855BA63760C9, all 1 inputs ready in: 00:00:00.000
2016-01-14 17:10:10,898 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:10:10,898 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:10:10,899 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10,899 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452791410656_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:10:10,900 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10,900 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DC0A4D4E47CA482F958C855BA63760C9, mem on close (mb), free: 189, total: 392, max: 672
2016-01-14 17:10:10 Completed running task attempt: attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10,901 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452791410656_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 17:10:10,903 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12][cascading.flow.SliceCounters Process_Begin_Time=1452791410896, Process_Duration=4, Process_End_Time=1452791410900, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=11, Tuples_Written=11]]
2016-01-14 17:10:10,903 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:10:10,903 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 17:10:10,903 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=DC0A4D4E47CA482F958C855BA63760C9, taskAttemptId=attempt_1452791410656_0001_1_00_000000_0, startTime=1452791410862, finishTime=1452791410902, timeTaken=40, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791410896, Process_Duration=4, Process_End_Time=1452791410900, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 17:10:10,903 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791410656_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 17:10:10,905 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:10,905 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10,905 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791410656_0001_00_000001
2016-01-14 17:10:10,906 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:10:10,906 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:TASK_FINISHED]: vertexName=DC0A4D4E47CA482F958C855BA63760C9, taskId=task_1452791410656_0001_1_00_000000, startTime=1452791410862, finishTime=1452791410905, timeTaken=43, status=SUCCEEDED, successfulAttemptID=attempt_1452791410656_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791410896, Process_Duration=4, Process_End_Time=1452791410900, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 17:10:10,906 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:10:10,906 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791410656_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 17:10:10,907 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9] : 1
2016-01-14 17:10:10,907 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,908 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:10:10,909 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:VERTEX_FINISHED]: vertexName=DC0A4D4E47CA482F958C855BA63760C9, vertexId=vertex_1452791410656_0001_1_00, initRequestedTime=1452791410831, initedTime=1452791410846, startRequestedTime=1452791410847, startedTime=1452791410847, finishTime=1452791410907, timeTaken=60, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791410896, Process_Duration=4, Process_End_Time=1452791410900, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11, vertexStats=firstTaskStartTime=1452791410862, firstTasksToStart=[ task_1452791410656_0001_1_00_000000 ], lastTaskFinishTime=1452791410902, lastTasksToFinish=[ task_1452791410656_0001_1_00_000000 ], minTaskDuration=40, maxTaskDuration=40, avgTaskDuration=40.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452791410656_0001_1_00_000000 ], longestDurationTasks=[ task_1452791410656_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 17:10:10,909 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 17:10:10,909 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410656_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 17:10:10,909 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:10:10,909 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452791410656_0001_00_000001, stoppedTime=1452791410909, exitStatus=0
2016-01-14 17:10:10,910 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410656_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:10:10,910 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 17:10:10,910 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452791410656_0001_1
2016-01-14 17:10:10,910 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452791410656_0001_1
2016-01-14 17:10:10,911 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: A3E56F132AF04C41BE8063DF3B66CEAF for vertex: vertex_1452791410656_0001_1_00 [DC0A4D4E47CA482F958C855BA63760C9]
2016-01-14 17:10:10,916 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452791410656_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 17:10:10,916 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791410656_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 17:10:10,916 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452791410656_0001_00_000001, Exiting
2016-01-14 17:10:10,916 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452791410656_0001_00_000001
2016-01-14 17:10:10,916 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452791410656_0001_00_000001
2016-01-14 17:10:10,921 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452791410656_0001_1, queueSize=0
2016-01-14 17:10:10,921 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:10:10,921 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791410656_0001_1][Event:DAG_FINISHED]: dagId=dag_1452791410656_0001_1, startTime=1452791410830, finishTime=1452791410919, timeTaken=89, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=297, FILE_BYTES_WRITTEN=206, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=411041792, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=12, cascading.flow.SliceCounters, Process_Begin_Time=1452791410896, Process_Duration=4, Process_End_Time=1452791410900, Read_Duration=0, Tuples_Read=11, Tuples_Written=11, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=11, Tuples_Written=11
2016-01-14 17:10:10,922 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452791410656_0001_1 finished with state: SUCCEEDED
2016-01-14 17:10:10,922 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452791410656_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 17:10:10,922 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791410656_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:10:10,922 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452791410656_0001_00_000001 completed successfully
2016-01-14 17:10:10,923 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452791410656_0001_00_000001
2016-01-14 17:10:10 Completed Dag: dag_1452791410656_0001_1
2016-01-14 17:10:10,923 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452791410656_0001_1, dagState=SUCCEEDED
2016-01-14 17:10:10,923 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791410656_0001_1_post
2016-01-14 17:10:10,923 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:10,923 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:10:10,923 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791410656_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:10:10,930 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...latform/testHeader/header, applicationId=application_1452791410656_0001
2016-01-14 17:10:10,932 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:10:10,932 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:10:10,932 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:10:10,932 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:10:10,932 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:10:10,933 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:10:10,933 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:10:10,934 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:10:10,934 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:10:10,934 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:10:10,935 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:10:10,935 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:10:10,935 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:10:10,939 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/FD0018D0B89340EB83723A1DE772298C/A9AC2A1A02C249B79B9ADA9E937E2684/.tez/application_1452791410656_0001
2016-01-14 17:10:10,940 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.306
2016-01-14 17:10:10,976 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testHeader/header
2016-01-14 17:10:11,012 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 17:10:11,012 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 17:10:11,056 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 17:10:11,059 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 17:10:11,060 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:11,060 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 17:10:11,061 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 17:10:11,078 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt
2016-01-14 17:10:11,079 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic
2016-01-14 17:10:11,089 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting
2016-01-14 17:10:11,090 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 17:10:11,090 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-01-14 17:10:11,090 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  parallel execution of steps is enabled: false
2016-01-14 17:10:11,090 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  executing total steps: 1
2016-01-14 17:10:11,090 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  allocating management threads: 1
2016-01-14 17:10:11,092 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] starting step: (1/1) ...t/strict-nondeterministic
2016-01-14 17:10:11,092 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [pipe] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 17:10:11,107 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] tez session mode enabled: true
2016-01-14 17:10:11,112 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:11,113 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 17:10:11,113 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 17:10:11,122 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42/.tez/application_1452791411113_0001 doesn't exist and is created
2016-01-14 17:10:11,140 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 17:10:11,141 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 17:10:11,141 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42/.tez/application_1452791411113_0001
2016-01-14 17:10:11,145 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452791411113_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 17:10:11,163 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 17:10:11,164 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 17:10:11,166 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 17:10:11,167 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 17:10:11,167 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42/.tez/application_1452791411113_0001/localmode-log-dir
2016-01-14 17:10:11,167 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42/.tez/application_1452791411113_0001/localmode-log-dir/history.txt.appattempt_1452791411113_0001_000000, maxErrors=10
2016-01-14 17:10:11,167 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 17:10:11,168 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452791411113_0001_000000, appSubmitTime=1452791411144, launchTime=1452791411144
2016-01-14 17:10:11,173 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 17:10:11,174 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 17:10:11,176 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 17:10:11,176 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 17:10:11,178 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:43520
2016-01-14 17:10:11,196 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 17:10:11,199 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452791411113_0001_000000, startTime=1452791411199
2016-01-14 17:10:11,199 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 17:10:11,199 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 17:10:11,219 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 17:10:11,219 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 17:10:11,241 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 17:10:11,241 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 17:10:11,241 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452791411113_0001, dagName=[CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 17:10:11,259 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 17:10:11,260 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452791411113_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42/.tez/application_1452791411113_0001/localmode-log-dir/dag_1452791411113_0001_1.dot
2016-01-14 17:10:11,261 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42/.tez/application_1452791411113_0001/localmode-log-dir/dag_1452791411113_0001_1-tez-dag.pb.txt
2016-01-14 17:10:11,268 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791411113_0001_1
2016-01-14 17:10:11,268 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:11,268 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 17:10:11 Running Dag: dag_1452791411113_0001_1
2016-01-14 17:10:11,282 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452791411113_0001_1, submitTime=1452791411259
2016-01-14 17:10:11,282 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 17:10:11,283 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D7A14FCF118949269F823430C2D62AEF
2016-01-14 17:10:11,283 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 17:10:11,284 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 17:10:11,284 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452791411113_0001_1, initTime=1452791411282
2016-01-14 17:10:11,285 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791411113_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 17:10:11,285 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:DAG_STARTED]: dagID=dag_1452791411113_0001_1, startTime=1452791411285
2016-01-14 17:10:11,285 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 17:10:11,285 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 17:10:11,286 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791411113_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 17:10:11,286 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D7A14FCF118949269F823430C2D62AEF : {08D08A6ECCC84AF796B394B9A54A8DC6={InputName=08D08A6ECCC84AF796B394B9A54A8DC6}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 17:10:11,286 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 08D08A6ECCC84AF796B394B9A54A8DC6, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 17:10:11,286 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,286 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,286 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,287 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]. Starting root input initializers: 1
2016-01-14 17:10:11,287 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 17:10:11,288 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452791411113_0001, dagName=[CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42] pipe/(1/1) ...t/strict-nondeterministic
2016-01-14 17:10:11,288 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 08D08A6ECCC84AF796B394B9A54A8DC6 on vertex vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,289 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 17:10:11,289 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 08D08A6ECCC84AF796B394B9A54A8DC6 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 17:10:11,290 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 17:10:11,290 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 17:10:11,291 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 432
2016-01-14 17:10:11,291 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 08D08A6ECCC84AF796B394B9A54A8DC6 on vertex vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,292 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:11,292 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {08D08A6ECCC84AF796B394B9A54A8DC6=forAllWorkUnits=true, update=[1]}
2016-01-14 17:10:11,292 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] parallelism set to 1
2016-01-14 17:10:11,292 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 17:10:11,293 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452791411113_0001_1_00, eventCount=1
2016-01-14 17:10:11,293 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,293 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=BE7C3C61F40641C2A109674D42DB2738, vertexId=vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 17:10:11,293 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=BE7C3C61F40641C2A109674D42DB2738, vertexId=vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,294 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=BE7C3C61F40641C2A109674D42DB2738, vertexName=D7A14FCF118949269F823430C2D62AEF, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 17:10:11,295 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=BE7C3C61F40641C2A109674D42DB2738, vertexId=vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,296 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 17:10:11,296 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D7A14FCF118949269F823430C2D62AEF, vertexId=vertex_1452791411113_0001_1_00, initRequestedTime=1452791411286, initedTime=1452791411296, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 17:10:11,296 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] with distanceFromRoot: 0
2016-01-14 17:10:11,296 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 17:10:11,297 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D7A14FCF118949269F823430C2D62AEF
2016-01-14 17:10:11,297 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,297 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 17:10:11,297 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452791411113_0001_1_00, startRequestedTime=1452791411297, startedTime=1452791411297
2016-01-14 17:10:11,298 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] transitioned from INITED to RUNNING due to event V_START
2016-01-14 17:10:11,298 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 17:10:11,298 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:TASK_STARTED]: vertexName=D7A14FCF118949269F823430C2D62AEF, taskId=task_1452791411113_0001_1_00_000000, scheduledTime=1452791411298, launchTime=1452791411298
2016-01-14 17:10:11,298 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791411113_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 17:10:11,299 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,299 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42] pipe/(1/1) ...t/strict-nondeterministic, VertexName: D7A14FCF118949269F823430C2D62AEF, VertexParallelism: 1, TaskAttemptID:attempt_1452791411113_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=08D08A6ECCC84AF796B394B9A54A8DC6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=BE7C3C61F40641C2A109674D42DB2738, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:11,299 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791411113_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 17:10:11,299 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 17:10:11,300 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 17:10:11,302 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 17:10:11,302 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 17:10:11,303 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452791411113_0001_00_000001
2016-01-14 17:10:11,303 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791411113_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 17:10:11,305 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452791411113_0001_00_000001
2016-01-14 17:10:11,305 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(145)) - DAGAppMaster metrics system already initialized!
2016-01-14 17:10:11,306 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791411113_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 17:10:11,306 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 17:10:11,307 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452791411113_0001_00_000001, launchTime=1452791411306
2016-01-14 17:10:11,307 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452791411113_0001_00_000001
2016-01-14 17:10:11,308 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452791411113_0001_1_00_000000_0] to container: [container_1452791411113_0001_00_000001]
2016-01-14 17:10:11,308 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791411113_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 17:10:11,308 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452791411113_0001_00_000001 given task: attempt_1452791411113_0001_1_00_000000_0
2016-01-14 17:10:11,308 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452791411113_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452791411113_0001_1_00_000000_0
2016-01-14 17:10:11,309 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452791411113_0001_1_00_000000_0] started. Is using containerId: [container_1452791411113_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 17:10:11,309 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D7A14FCF118949269F823430C2D62AEF, taskAttemptId=attempt_1452791411113_0001_1_00_000000_0, startTime=1452791411308, containerId=container_1452791411113_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452791411113_0001_00_000001/teamcity, completedLogs=
2016-01-14 17:10:11,309 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 17:10:11,309 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791411113_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 17:10:11 Starting to run new task attempt: attempt_1452791411113_0001_1_00_000000_0
2016-01-14 17:10:11,309 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791411113_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 17:10:11,309 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452791411113_0001_1_00_000000_0
2016-01-14 17:10:11,310 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:11,310 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 17:10:11,310 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 17:10:11,310 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 17:10:11,310 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 17:10:11,310 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 17:10:11,311 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42] pipe/(1/1) ...t/strict-nondeterministic, VertexName: D7A14FCF118949269F823430C2D62AEF, VertexParallelism: 1, TaskAttemptID:attempt_1452791411113_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=08D08A6ECCC84AF796B394B9A54A8DC6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=BE7C3C61F40641C2A109674D42DB2738, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 17:10:11,311 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 17:10:11,311 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452791411113_0001_1_00_000000_0
2016-01-14 17:10:11,311 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 17:10:11,311 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:11,315 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=08D08A6ECCC84AF796B394B9A54A8DC6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 17:10:11,316 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 17:10:11,316 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 08D08A6ECCC84AF796B394B9A54A8DC6
2016-01-14 17:10:11,316 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 08D08A6ECCC84AF796B394B9A54A8DC6
2016-01-14 17:10:11,318 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:11,318 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=BE7C3C61F40641C2A109674D42DB2738, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 17:10:11,318 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 17:10:11,319 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: BE7C3C61F40641C2A109674D42DB2738
2016-01-14 17:10:11,319 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 17:10:11,319 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: BE7C3C61F40641C2A109674D42DB2738
2016-01-14 17:10:11,320 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 17:10:11,320 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 08D08A6ECCC84AF796B394B9A54A8DC6
2016-01-14 17:10:11,321 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 08D08A6ECCC84AF796B394B9A54A8DC6
2016-01-14 17:10:11,321 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 17:10:11,323 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452791411113_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 17:10:11,326 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] submitted tez dag to app master: application_1452791411113_0001, with dag id: dag_1452791411113_0001_1
2016-01-14 17:10:11,333 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D7A14FCF118949269F823430C2D62AEF, ordinal: 0
2016-01-14 17:10:11,333 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D7A14FCF118949269F823430C2D62AEF, mem on start (mb), free: 331, total: 384, max: 672
2016-01-14 17:10:11,333 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 17:10:11,334 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 17:10:11,334 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 17:10:11,336 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 17:10:11,336 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: BE7C3C61F40641C2A109674D42DB2738
2016-01-14 17:10:11,337 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 17:10:11,337 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 17:10:11,337 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 17:10:11,337 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:11,337 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 17:10:11,338 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 17:10:11,338 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 17:10:11,338 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 17:10:11,339 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 08D08A6ECCC84AF796B394B9A54A8DC6, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 17:10:11,339 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, BE7C3C61F40641C2A109674D42DB2738, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 17:10:11,339 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 17:10:11,339 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 08D08A6ECCC84AF796B394B9A54A8DC6 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 17:10:11,339 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 08D08A6ECCC84AF796B394B9A54A8DC6
2016-01-14 17:10:11,340 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:11,340 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 17:10:11,340 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 17:10:11,340 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 08D08A6ECCC84AF796B394B9A54A8DC6
2016-01-14 17:10:11,340 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 17:10:11,341 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452791411113_0001_1_00_000000_0
2016-01-14 17:10:11,343 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 17:10:11,344 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@75fc45f9
2016-01-14 17:10:11,344 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 17:10:11,344 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"] streamed: true, id: 08D08A6ECCC84AF796B394B9A54A8DC6
2016-01-14 17:10:11,345 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"], id: BE7C3C61F40641C2A109674D42DB2738
2016-01-14 17:10:11,345 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output/hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic"]
2016-01-14 17:10:11,345 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@75fc45f9
2016-01-14 17:10:11,345 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 17:10:11,346 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 17:10:11,345 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/classes/test/data/delimited-extra-field.txt"]
2016-01-14 17:10:11,347 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 17:10:11,348 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D7A14FCF118949269F823430C2D62AEF, all 1 inputs ready in: 00:00:00.001
2016-01-14 17:10:11,350 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
2016-01-14 17:10:11,356 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
2016-01-14 17:10:11,360 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 17:10:11,361 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 17:10:11,361 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452791411113_0001_1_00_000000_0
2016-01-14 17:10:11,362 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452791411113_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 17:10:11,362 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452791411113_0001_1_00_000000_0
cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
2016-01-14 17:10:11,370 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 17:10:11,370 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D7A14FCF118949269F823430C2D62AEF, taskAttemptId=attempt_1452791411113_0001_1_00_000000_0, startTime=1452791411308, finishTime=1452791411369, timeTaken=61, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=135, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6, cascading.flow.SliceCounters, Process_Begin_Time=1452791411348, Process_Duration=14, Process_End_Time=1452791411362, Read_Duration=0, Tuples_Read=6, Tuples_Written=6, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=6, Tuples_Written=6
2016-01-14 17:10:11,371 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791411113_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 17:10:11,371 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452791411113_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 17:10:11,371 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:TASK_FINISHED]: vertexName=D7A14FCF118949269F823430C2D62AEF, taskId=task_1452791411113_0001_1_00_000000, startTime=1452791411308, finishTime=1452791411371, timeTaken=63, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
], counters=Counters: 0
2016-01-14 17:10:11,372 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452791411113_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 17:10:11,372 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] : 1
2016-01-14 17:10:11,372 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] because task failed: task_1452791411113_0001_1_00_000000
2016-01-14 17:10:11,373 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] due to trigger: OWN_TASK_FAILURE
2016-01-14 17:10:11,373 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 17:10:11,373 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,373 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 17:10:11,374 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 17:10:11,375 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=BE7C3C61F40641C2A109674D42DB2738, vertexId=vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,381 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 17:10:11,381 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:VERTEX_FINISHED]: vertexName=D7A14FCF118949269F823430C2D62AEF, vertexId=vertex_1452791411113_0001_1_00, initRequestedTime=1452791411286, initedTime=1452791411296, startRequestedTime=1452791411297, startedTime=1452791411297, finishTime=1452791411380, timeTaken=83, status=FAILED, diagnostics=Task failed, taskId=task_1452791411113_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452791411308, firstTasksToStart=[ task_1452791411113_0001_1_00_000000 ], lastTaskFinishTime=1452791411369, lastTasksToFinish=[ task_1452791411113_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 17:10:11,382 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 17:10:11,382 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=314, FILE_BYTES_WRITTEN=135, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=6][cascading.flow.SliceCounters Process_Begin_Time=1452791411348, Process_Duration=14, Process_End_Time=1452791411362, Read_Duration=0, Tuples_Read=6, Tuples_Written=6, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=6, Tuples_Written=6]]
2016-01-14 17:10:11,383 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D7A14FCF118949269F823430C2D62AEF, mem on close (mb), free: 327, total: 384, max: 672
2016-01-14 17:10:11,383 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=D7A14FCF118949269F823430C2D62AEF, index=0
2016-01-14 17:10:11,385 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=D7A14FCF118949269F823430C2D62AEF, sourceVertex=08D08A6ECCC84AF796B394B9A54A8DC6
2016-01-14 17:10:11,385 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=D7A14FCF118949269F823430C2D62AEF, sourceVertex=BE7C3C61F40641C2A109674D42DB2738
2016-01-14 17:10:11,385 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 17:10:11,385 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452791411113_0001_00_000001
2016-01-14 17:10:11,386 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452791411113_0001_00_000001, stoppedTime=1452791411384, exitStatus=0
2016-01-14 17:10:11,386 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452791411113_0001_00_000001
2016-01-14 17:10:11,386 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791411113_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 17:10:11,391 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452791411113_0001_1_00_000000_0 failed: true container: container_1452791411113_0001_00_000001 numFailedTAs: 0
2016-01-14 17:10:11,392 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452791411113_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 17:10:11,392 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452791411113_0001_00_000001 completed but with errors
2016-01-14 17:10:11,393 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 17:10:11,393 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 17:10:11,393 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452791411113_0001_1
2016-01-14 17:10:11,393 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: BE7C3C61F40641C2A109674D42DB2738 for vertex: vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF]
2016-01-14 17:10:11,394 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452791411113_0001_1, queueSize=0
2016-01-14 17:10:11,394 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 17:10:11,394 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452791411113_0001_1][Event:DAG_FINISHED]: dagId=dag_1452791411113_0001_1, startTime=1452791411285, finishTime=1452791411394, timeTaken=109, status=FAILED, diagnostics=Vertex failed, vertexName=D7A14FCF118949269F823430C2D62AEF, vertexId=vertex_1452791411113_0001_1_00, diagnostics=[Task failed, taskId=task_1452791411113_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: unable to read from input identifier: 'unknown'
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:152)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:84)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1015)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:166)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:139)
	... 16 more
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452791411113_0001_1_00 [D7A14FCF118949269F823430C2D62AEF] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 17:10:11,395 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452791411113_0001_1 finished with state: FAILED
2016-01-14 17:10:11,395 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452791411113_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 17:10:11,395 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452791411113_0001_00_000001
2016-01-14 17:10:11,396 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452791411113_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 17:10:11,396 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452791411113_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 17:10:11 Completed Dag: dag_1452791411113_0001_1
2016-01-14 17:10:11,397 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452791411113_0001_1, dagState=FAILED
2016-01-14 17:10:11,397 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452791411113_0001_1_post
2016-01-14 17:10:11,397 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 17:10:11,397 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 17:10:11,397 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452791411113_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 17:10:11,400 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...t/strict-nondeterministic, applicationId=application_1452791411113_0001
2016-01-14 17:10:11,402 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 17:10:11,402 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 17:10:11,403 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 17:10:11,403 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 17:10:11,403 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 17:10:11,403 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 17:10:11,404 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 17:10:11,404 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 17:10:11,404 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 17:10:11,404 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 17:10:11,405 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 17:10:11,405 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 17:10:11,405 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 17:10:11,412 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/tmp/.staging/CBE5C0FF470E4F0E80FA3335E8FA685A/A89C7646E3424C8FAE16A927B3C17C42/.tez/application_1452791411113_0001
2016-01-14 17:10:11,412 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopping all jobs
2016-01-14 17:10:11,412 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopping: (1/1) ...t/strict-nondeterministic
2016-01-14 17:10:11,413 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe] stopped all jobs
2016-01-14 17:10:11,414 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [pipe]  completed in: 00:00.324
2016-01-14 17:10:11,414 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.5.x-tez-0.6.x/build/test/output//hadoop2-tez/textdelimitedplatform/testStrict/strict-nondeterministic

Standard error

2016-01-14 17:10:05 Running Dag: dag_1452791404584_0001_1
2016-01-14 17:10:05 Starting to run new task attempt: attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:06 Completed running task attempt: attempt_1452791404584_0001_1_00_000000_0
2016-01-14 17:10:06 Completed Dag: dag_1452791404584_0001_1
2016-01-14 17:10:06 Running Dag: dag_1452791406583_0001_1
2016-01-14 17:10:06 Starting to run new task attempt: attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06 Completed running task attempt: attempt_1452791406583_0001_1_00_000000_0
2016-01-14 17:10:06 Completed Dag: dag_1452791406583_0001_1
2016-01-14 17:10:07 Running Dag: dag_1452791407361_0001_1
2016-01-14 17:10:07 Starting to run new task attempt: attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07 Completed running task attempt: attempt_1452791407361_0001_1_00_000000_0
2016-01-14 17:10:07 Completed Dag: dag_1452791407361_0001_1
2016-01-14 17:10:08 Running Dag: dag_1452791408024_0001_1
2016-01-14 17:10:08 Starting to run new task attempt: attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08 Completed running task attempt: attempt_1452791408024_0001_1_00_000000_0
2016-01-14 17:10:08 Completed Dag: dag_1452791408024_0001_1
2016-01-14 17:10:08 Running Dag: dag_1452791408531_0001_1
2016-01-14 17:10:08 Starting to run new task attempt: attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08 Completed running task attempt: attempt_1452791408531_0001_1_00_000000_0
2016-01-14 17:10:08 Completed Dag: dag_1452791408531_0001_1
2016-01-14 17:10:09 Running Dag: dag_1452791409249_0001_1
2016-01-14 17:10:09 Starting to run new task attempt: attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09 Completed running task attempt: attempt_1452791409249_0001_1_00_000000_0
2016-01-14 17:10:09 Completed Dag: dag_1452791409249_0001_1
2016-01-14 17:10:10 Running Dag: dag_1452791410006_0001_1
2016-01-14 17:10:10 Starting to run new task attempt: attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10 Completed running task attempt: attempt_1452791410006_0001_1_00_000000_0
2016-01-14 17:10:10 Completed Dag: dag_1452791410006_0001_1
2016-01-14 17:10:10 Running Dag: dag_1452791410656_0001_1
2016-01-14 17:10:10 Starting to run new task attempt: attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10 Completed running task attempt: attempt_1452791410656_0001_1_00_000000_0
2016-01-14 17:10:10 Completed Dag: dag_1452791410656_0001_1
2016-01-14 17:10:11 Running Dag: dag_1452791411113_0001_1
2016-01-14 17:10:11 Starting to run new task attempt: attempt_1452791411113_0001_1_00_000000_0
2016-01-14 17:10:11 Completed Dag: dag_1452791411113_0001_1