2016-01-14 18:31:49,204 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 18:31:49,229 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.detail.EveryEveryPipeAssemblyPlatformTest, with platform: hadoop2-tez
2016-01-14 18:31:49,674 INFO tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-01-14 18:31:50,133 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 18:31:50,412 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 18:31:50,573 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:50,574 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:50,659 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: A41C5AD857C940CC95372F7B2F0CE5DB
2016-01-14 18:31:50,879 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.075
2016-01-14 18:31:50,893 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.090
2016-01-14 18:31:50,894 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:50,895 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:50,896 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:51,066 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:51,069 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1
2016-01-14 18:31:51,260 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 18:31:51,264 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:51,265 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:51,265 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"]
2016-01-14 18:31:51,265 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:51,266 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:51,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:51,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 18:31:51,268 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:51,288 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:51,451 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:51,458 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:51,458 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:51,516 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40/.tez/application_1452796311458_0001 doesn't exist and is created
2016-01-14 18:31:51,579 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:51,580 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:51,581 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40/.tez/application_1452796311458_0001
2016-01-14 18:31:51,626 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796311458_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:51,680 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-01-14 18:31:51,681 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-01-14 18:31:51,681 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:51,702 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:51,720 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:51,743 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:51,747 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:51,751 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40/.tez/application_1452796311458_0001/localmode-log-dir
2016-01-14 18:31:51,751 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40/.tez/application_1452796311458_0001/localmode-log-dir/history.txt.appattempt_1452796311458_0001_000000, maxErrors=10
2016-01-14 18:31:51,751 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:51,754 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796311458_0001_000000, appSubmitTime=1452796311612, launchTime=1452796311625
2016-01-14 18:31:51,759 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:51,760 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:51,761 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:51,761 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:51,782 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 18:31:51,782 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 18:31:51,782 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:51,824 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:60188
2016-01-14 18:31:51,852 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:51,882 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 18:31:51,882 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 18:31:51,883 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:51,928 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:51,929 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796311458_0001_000000, startTime=1452796311927
2016-01-14 18:31:51,929 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:51,983 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:51,999 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:51,999 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452796311458_0001, dagName=[20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 18:31:52,214 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 18:31:52,312 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796311458_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40/.tez/application_1452796311458_0001/localmode-log-dir/dag_1452796311458_0001_1.dot
2016-01-14 18:31:52,315 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40/.tez/application_1452796311458_0001/localmode-log-dir/dag_1452796311458_0001_1-tez-dag.pb.txt
2016-01-14 18:31:52,413 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796311458_0001_1
2016-01-14 18:31:52,414 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:52,414 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 18:31:52 Running Dag: dag_1452796311458_0001_1
2016-01-14 18:31:52,440 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:52,440 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796311458_0001_1, submitTime=1452796312215
2016-01-14 18:31:52,473 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex ED2F8ED2E1794C648D519388CFDA33A0
2016-01-14 18:31:52,474 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:52,476 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:52,478 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796311458_0001_1, initTime=1452796312441
2016-01-14 18:31:52,478 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796311458_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:52,480 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:DAG_STARTED]: dagID=dag_1452796311458_0001_1, startTime=1452796312479
2016-01-14 18:31:52,481 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:52,482 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796311458_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:52,484 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:52,483 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: ED2F8ED2E1794C648D519388CFDA33A0 : {C8C653BAE2B8454AB7A500A0AD8BD224={InputName=C8C653BAE2B8454AB7A500A0AD8BD224}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:52,484 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: C8C653BAE2B8454AB7A500A0AD8BD224, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:52,484 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:52,494 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452796311458_0001, dagName=[20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 18:31:52,503 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:52,503 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:52,507 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]. Starting root input initializers: 1
2016-01-14 18:31:52,516 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: C8C653BAE2B8454AB7A500A0AD8BD224 on vertex vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:52,538 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:52,542 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796311458_0001, with dag id: dag_1452796311458_0001_1
2016-01-14 18:31:52,544 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:52,547 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input C8C653BAE2B8454AB7A500A0AD8BD224 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:52,549 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:52,554 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:52,596 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:52,599 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: C8C653BAE2B8454AB7A500A0AD8BD224 on vertex vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:52,601 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:52,601 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {C8C653BAE2B8454AB7A500A0AD8BD224=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:52,622 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0] parallelism set to 1
2016-01-14 18:31:52,622 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:52,631 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796311458_0001_1_00, eventCount=1
2016-01-14 18:31:52,633 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:52,634 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=403D9BAA8EA347C99376EE4E99AD3B1C, vertexId=vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:52,637 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=403D9BAA8EA347C99376EE4E99AD3B1C, vertexId=vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:52,658 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=403D9BAA8EA347C99376EE4E99AD3B1C, vertexName=ED2F8ED2E1794C648D519388CFDA33A0, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:52,670 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=403D9BAA8EA347C99376EE4E99AD3B1C, vertexId=vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:52,673 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:52,674 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:VERTEX_INITIALIZED]: vertexName=ED2F8ED2E1794C648D519388CFDA33A0, vertexId=vertex_1452796311458_0001_1_00, initRequestedTime=1452796312483, initedTime=1452796312672, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:52,675 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0] with distanceFromRoot: 0
2016-01-14 18:31:52,675 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:52,677 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in ED2F8ED2E1794C648D519388CFDA33A0
2016-01-14 18:31:52,678 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:52,679 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:52,679 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796311458_0001_1_00, startRequestedTime=1452796312676, startedTime=1452796312676
2016-01-14 18:31:52,680 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:52,704 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:52,704 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:TASK_STARTED]: vertexName=ED2F8ED2E1794C648D519388CFDA33A0, taskId=task_1452796311458_0001_1_00_000000, scheduledTime=1452796312703, launchTime=1452796312703
2016-01-14 18:31:52,705 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796311458_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:52,707 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:52,710 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1, VertexName: ED2F8ED2E1794C648D519388CFDA33A0, VertexParallelism: 1, TaskAttemptID:attempt_1452796311458_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C8C653BAE2B8454AB7A500A0AD8BD224, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=403D9BAA8EA347C99376EE4E99AD3B1C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:52,712 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796311458_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:52,713 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:52,755 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:52,760 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:52,761 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:52,765 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796311458_0001_00_000001
2016-01-14 18:31:52,765 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796311458_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:52,780 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796311458_0001_00_000001
2016-01-14 18:31:52,780 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:52,787 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796311458_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:52,787 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:52,789 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796311458_0001_00_000001, launchTime=1452796312787
2016-01-14 18:31:52,792 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796311458_0001_00_000001
2016-01-14 18:31:52,795 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796311458_0001_1_00_000000_0] to container: [container_1452796311458_0001_00_000001]
2016-01-14 18:31:52,795 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796311458_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:52,798 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796311458_0001_00_000001 given task: attempt_1452796311458_0001_1_00_000000_0
2016-01-14 18:31:52,798 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796311458_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796311458_0001_1_00_000000_0
2016-01-14 18:31:52,800 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796311458_0001_1_00_000000_0] started. Is using containerId: [container_1452796311458_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:52 Starting to run new task attempt: attempt_1452796311458_0001_1_00_000000_0
2016-01-14 18:31:52,802 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796311458_0001_1_00_000000_0
2016-01-14 18:31:52,802 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:52,803 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:52,803 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=ED2F8ED2E1794C648D519388CFDA33A0, taskAttemptId=attempt_1452796311458_0001_1_00_000000_0, startTime=1452796312798, containerId=container_1452796311458_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796311458_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:52,804 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796311458_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:52,805 INFO counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-01-14 18:31:52,804 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:52,806 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:52,807 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:52,809 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796311458_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:52,810 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:52,832 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:52,832 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1, VertexName: ED2F8ED2E1794C648D519388CFDA33A0, VertexParallelism: 1, TaskAttemptID:attempt_1452796311458_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C8C653BAE2B8454AB7A500A0AD8BD224, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=403D9BAA8EA347C99376EE4E99AD3B1C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:52,835 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:52,839 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796311458_0001_1_00_000000_0
2016-01-14 18:31:52,840 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:52,840 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:52,842 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796311458_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:52,846 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=C8C653BAE2B8454AB7A500A0AD8BD224, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:52,847 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:52,847 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=403D9BAA8EA347C99376EE4E99AD3B1C, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:52,850 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:52,850 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:52,850 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 403D9BAA8EA347C99376EE4E99AD3B1C
2016-01-14 18:31:52,850 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:52,850 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: C8C653BAE2B8454AB7A500A0AD8BD224
2016-01-14 18:31:52,854 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 403D9BAA8EA347C99376EE4E99AD3B1C
2016-01-14 18:31:52,855 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: C8C653BAE2B8454AB7A500A0AD8BD224
2016-01-14 18:31:52,866 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:52,878 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:52,879 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: C8C653BAE2B8454AB7A500A0AD8BD224
2016-01-14 18:31:52,880 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: C8C653BAE2B8454AB7A500A0AD8BD224
2016-01-14 18:31:52,885 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: ED2F8ED2E1794C648D519388CFDA33A0, ordinal: 0
2016-01-14 18:31:52,886 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: ED2F8ED2E1794C648D519388CFDA33A0, mem on start (mb), free: 182, total: 281, max: 672
2016-01-14 18:31:52,886 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:52,886 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:52,887 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:52,900 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:52,901 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 403D9BAA8EA347C99376EE4E99AD3B1C
2016-01-14 18:31:52,901 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:52,902 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:52,909 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:52,910 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:52,910 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:52,910 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:52,910 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:52,911 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:52,911 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 403D9BAA8EA347C99376EE4E99AD3B1C, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:52,911 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, C8C653BAE2B8454AB7A500A0AD8BD224, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:52,911 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:52,913 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: C8C653BAE2B8454AB7A500A0AD8BD224 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:52,913 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:52,913 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:52,914 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: C8C653BAE2B8454AB7A500A0AD8BD224
2016-01-14 18:31:52,914 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:52,914 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: C8C653BAE2B8454AB7A500A0AD8BD224
2016-01-14 18:31:52,915 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:52,917 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796311458_0001_1_00_000000_0
2016-01-14 18:31:52,919 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:52,927 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2ce2cbc8
2016-01-14 18:31:52,937 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2ce2cbc8
2016-01-14 18:31:52,937 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:52,937 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:52,961 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:52,986 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: C8C653BAE2B8454AB7A500A0AD8BD224
2016-01-14 18:31:52,987 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"], id: 403D9BAA8EA347C99376EE4E99AD3B1C
2016-01-14 18:31:52,988 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"]
2016-01-14 18:31:52,991 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:52,991 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:52,993 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: ED2F8ED2E1794C648D519388CFDA33A0, all 1 inputs ready in: 00:00:00.002
2016-01-14 18:31:53,001 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:53,001 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:53,002 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796311458_0001_1_00_000000_0
2016-01-14 18:31:53,003 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796311458_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:53,004 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796311458_0001_1_00_000000_0
2016-01-14 18:31:53,005 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: ED2F8ED2E1794C648D519388CFDA33A0, mem on close (mb), free: 174, total: 281, max: 672
2016-01-14 18:31:53 Completed running task attempt: attempt_1452796311458_0001_1_00_000000_0
2016-01-14 18:31:53,011 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796311458_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:31:53,016 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796312993, Process_Duration=11, Process_End_Time=1452796313004, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:31:53,016 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:53,016 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:31:53,017 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:53,017 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796311458_0001_00_000001
2016-01-14 18:31:53,027 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=ED2F8ED2E1794C648D519388CFDA33A0, taskAttemptId=attempt_1452796311458_0001_1_00_000000_0, startTime=1452796312798, finishTime=1452796313012, timeTaken=214, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796312993, Process_Duration=11, Process_End_Time=1452796313004, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:53,028 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796311458_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:31:53,028 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:53,033 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796311458_0001_1_00_000000_0
2016-01-14 18:31:53,035 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:53,041 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:TASK_FINISHED]: vertexName=ED2F8ED2E1794C648D519388CFDA33A0, taskId=task_1452796311458_0001_1_00_000000, startTime=1452796312798, finishTime=1452796313034, timeTaken=236, status=SUCCEEDED, successfulAttemptID=attempt_1452796311458_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796312993, Process_Duration=11, Process_End_Time=1452796313004, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:53,044 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796311458_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:31:53,045 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796311458_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:31:53,046 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:53,047 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796311458_0001_00_000001, stoppedTime=1452796313046, exitStatus=0
2016-01-14 18:31:53,048 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796311458_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:31:53,049 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0] : 1
2016-01-14 18:31:53,050 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:53,051 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796311458_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:31:53,051 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796311458_0001_00_000001: 32 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:31:53,052 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796311458_0001_00_000001, Exiting
2016-01-14 18:31:53,052 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796311458_0001_00_000001
2016-01-14 18:31:53,052 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796311458_0001_00_000001
2016-01-14 18:31:53,055 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796311458_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:31:53,056 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796311458_0001_00_000001 completed successfully
2016-01-14 18:31:53,063 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:53,068 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:VERTEX_FINISHED]: vertexName=ED2F8ED2E1794C648D519388CFDA33A0, vertexId=vertex_1452796311458_0001_1_00, initRequestedTime=1452796312483, initedTime=1452796312672, startRequestedTime=1452796312676, startedTime=1452796312676, finishTime=1452796313050, timeTaken=374, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796312993, Process_Duration=11, Process_End_Time=1452796313004, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796312798, firstTasksToStart=[ task_1452796311458_0001_1_00_000000 ], lastTaskFinishTime=1452796313012, lastTasksToFinish=[ task_1452796311458_0001_1_00_000000 ], minTaskDuration=214, maxTaskDuration=214, avgTaskDuration=214.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796311458_0001_1_00_000000 ], longestDurationTasks=[ task_1452796311458_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:31:53,069 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:31:53,069 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796311458_0001_00_000001
2016-01-14 18:31:53,072 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796311458_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:31:53,073 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:31:53,073 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796311458_0001_1
2016-01-14 18:31:53,076 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796311458_0001_1
2016-01-14 18:31:53,076 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 403D9BAA8EA347C99376EE4E99AD3B1C for vertex: vertex_1452796311458_0001_1_00 [ED2F8ED2E1794C648D519388CFDA33A0]
2016-01-14 18:31:53,093 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796311458_0001_1, queueSize=0
2016-01-14 18:31:53,093 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:53,097 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796311458_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796311458_0001_1, startTime=1452796312479, finishTime=1452796313087, timeTaken=608, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796312993, Process_Duration=11, Process_End_Time=1452796313004, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:53,098 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796311458_0001_1 finished with state: SUCCEEDED
2016-01-14 18:31:53,099 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796311458_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:53 Completed Dag: dag_1452796311458_0001_1
2016-01-14 18:31:53,100 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796311458_0001_1, dagState=SUCCEEDED
2016-01-14 18:31:53,100 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796311458_0001_1_post
2016-01-14 18:31:53,100 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:53,101 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:53,112 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452796311458_0001
2016-01-14 18:31:53,117 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:53,117 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:53,117 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:53,117 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:53,118 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:53,119 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:53,123 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:53,124 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:53,124 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:53,124 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:53,125 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:53,125 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:53,126 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:53,132 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/20941EEF97B347018777FAFF3C8EAA05/A021EE50B7054567B49FB9E924438B40/.tez/application_1452796311458_0001
2016-01-14 18:31:53,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:01.868
2016-01-14 18:31:53,307 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_-1
2016-01-14 18:31:53,341 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:53,342 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:53,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-14 18:31:53,430 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.049
2016-01-14 18:31:53,430 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:53,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:53,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:53,453 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:53,454 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'
2016-01-14 18:31:53,481 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:53,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:53,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"]
2016-01-14 18:31:53,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:53,483 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:53,483 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:53,483 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 18:31:53,484 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:53,507 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:53,512 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:53,513 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:53,513 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:53,523 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C/.tez/application_1452796313513_0001 doesn't exist and is created
2016-01-14 18:31:53,543 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:53,543 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:53,545 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C/.tez/application_1452796313513_0001
2016-01-14 18:31:53,547 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796313513_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:53,564 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:53,565 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:53,567 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:53,567 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:53,567 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C/.tez/application_1452796313513_0001/localmode-log-dir
2016-01-14 18:31:53,568 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C/.tez/application_1452796313513_0001/localmode-log-dir/history.txt.appattempt_1452796313513_0001_000000, maxErrors=10
2016-01-14 18:31:53,568 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:53,568 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796313513_0001_000000, appSubmitTime=1452796313547, launchTime=1452796313547
2016-01-14 18:31:53,582 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:53,584 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:53,585 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:53,587 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:53,588 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:56528
2016-01-14 18:31:53,592 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:53,596 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:53,596 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796313513_0001_000000, startTime=1452796313595
2016-01-14 18:31:53,596 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:53,644 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:53,644 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:53,645 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452796313513_0001, dagName=[29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 18:31:53,673 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 18:31:53,678 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796313513_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C/.tez/application_1452796313513_0001/localmode-log-dir/dag_1452796313513_0001_1.dot
2016-01-14 18:31:53,681 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C/.tez/application_1452796313513_0001/localmode-log-dir/dag_1452796313513_0001_1-tez-dag.pb.txt
2016-01-14 18:31:53,721 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796313513_0001_1
2016-01-14 18:31:53,721 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:53,721 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 18:31:53 Running Dag: dag_1452796313513_0001_1
2016-01-14 18:31:53,734 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:53,735 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796313513_0001_1, submitTime=1452796313673
2016-01-14 18:31:53,736 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E7B217A453D349CDB2CC4F435059C955
2016-01-14 18:31:53,736 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:53,736 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:53,737 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796313513_0001_1, initTime=1452796313735
2016-01-14 18:31:53,737 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796313513_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:53,738 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:DAG_STARTED]: dagID=dag_1452796313513_0001_1, startTime=1452796313738
2016-01-14 18:31:53,738 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:53,738 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:53,739 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796313513_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:53,739 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E7B217A453D349CDB2CC4F435059C955 : {6296CB69CE9A4298AF15C9DB66644CD9={InputName=6296CB69CE9A4298AF15C9DB66644CD9}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:53,739 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 6296CB69CE9A4298AF15C9DB66644CD9, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:53,740 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,740 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,741 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,741 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]. Starting root input initializers: 1
2016-01-14 18:31:53,741 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:53,742 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452796313513_0001, dagName=[29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 18:31:53,743 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 6296CB69CE9A4298AF15C9DB66644CD9 on vertex vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,750 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:53,751 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 6296CB69CE9A4298AF15C9DB66644CD9 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:53,753 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:53,753 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:53,757 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:53,758 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 6296CB69CE9A4298AF15C9DB66644CD9 on vertex vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,759 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:53,759 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {6296CB69CE9A4298AF15C9DB66644CD9=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:53,760 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955] parallelism set to 1
2016-01-14 18:31:53,760 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:53,760 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796313513_0001_1_00, eventCount=1
2016-01-14 18:31:53,760 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,760 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=DBFF831CE0DF4D01AC2F04E74430BB27, vertexId=vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:53,761 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=DBFF831CE0DF4D01AC2F04E74430BB27, vertexId=vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,768 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=DBFF831CE0DF4D01AC2F04E74430BB27, vertexName=E7B217A453D349CDB2CC4F435059C955, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:53,768 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=DBFF831CE0DF4D01AC2F04E74430BB27, vertexId=vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,770 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:53,770 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E7B217A453D349CDB2CC4F435059C955, vertexId=vertex_1452796313513_0001_1_00, initRequestedTime=1452796313739, initedTime=1452796313770, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:53,772 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955] with distanceFromRoot: 0
2016-01-14 18:31:53,772 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:53,773 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E7B217A453D349CDB2CC4F435059C955
2016-01-14 18:31:53,773 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,774 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796313513_0001_1_00, startRequestedTime=1452796313773, startedTime=1452796313773
2016-01-14 18:31:53,774 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:53,774 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:53,776 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:53,776 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:TASK_STARTED]: vertexName=E7B217A453D349CDB2CC4F435059C955, taskId=task_1452796313513_0001_1_00_000000, scheduledTime=1452796313775, launchTime=1452796313775
2016-01-14 18:31:53,776 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796313513_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:53,777 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,777 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C] every.every/(1/1) ...ULTS.-1_'field2'_'field2', VertexName: E7B217A453D349CDB2CC4F435059C955, VertexParallelism: 1, TaskAttemptID:attempt_1452796313513_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6296CB69CE9A4298AF15C9DB66644CD9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=DBFF831CE0DF4D01AC2F04E74430BB27, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:53,778 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796313513_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:53,778 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796313513_0001, with dag id: dag_1452796313513_0001_1
2016-01-14 18:31:53,778 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:53,780 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:53,781 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:53,781 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:53,782 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796313513_0001_00_000001
2016-01-14 18:31:53,782 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796313513_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:53,785 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796313513_0001_00_000001
2016-01-14 18:31:53,785 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:53,786 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:53,787 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796313513_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:53,788 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796313513_0001_00_000001, launchTime=1452796313786
2016-01-14 18:31:53,788 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796313513_0001_00_000001
2016-01-14 18:31:53,789 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796313513_0001_1_00_000000_0] to container: [container_1452796313513_0001_00_000001]
2016-01-14 18:31:53,789 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796313513_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:53,790 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796313513_0001_1_00_000000_0] started. Is using containerId: [container_1452796313513_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:53,790 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E7B217A453D349CDB2CC4F435059C955, taskAttemptId=attempt_1452796313513_0001_1_00_000000_0, startTime=1452796313790, containerId=container_1452796313513_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796313513_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:53,790 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:53,790 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796313513_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:53,791 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796313513_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:53,791 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796313513_0001_00_000001 given task: attempt_1452796313513_0001_1_00_000000_0
2016-01-14 18:31:53,791 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796313513_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796313513_0001_1_00_000000_0
2016-01-14 18:31:53 Starting to run new task attempt: attempt_1452796313513_0001_1_00_000000_0
2016-01-14 18:31:53,792 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796313513_0001_1_00_000000_0
2016-01-14 18:31:53,792 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:53,792 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:53,792 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:53,792 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:53,793 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:53,793 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:53,793 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C] every.every/(1/1) ...ULTS.-1_'field2'_'field2', VertexName: E7B217A453D349CDB2CC4F435059C955, VertexParallelism: 1, TaskAttemptID:attempt_1452796313513_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6296CB69CE9A4298AF15C9DB66644CD9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=DBFF831CE0DF4D01AC2F04E74430BB27, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:53,794 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:53,794 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796313513_0001_1_00_000000_0
2016-01-14 18:31:53,796 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:53,800 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:53,800 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796313513_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:53,803 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:53,803 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=6296CB69CE9A4298AF15C9DB66644CD9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:53,803 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=DBFF831CE0DF4D01AC2F04E74430BB27, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:53,805 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:53,805 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 6296CB69CE9A4298AF15C9DB66644CD9
2016-01-14 18:31:53,806 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 6296CB69CE9A4298AF15C9DB66644CD9
2016-01-14 18:31:53,805 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:53,807 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: DBFF831CE0DF4D01AC2F04E74430BB27
2016-01-14 18:31:53,808 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:53,808 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: DBFF831CE0DF4D01AC2F04E74430BB27
2016-01-14 18:31:53,810 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:53,818 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:53,818 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 6296CB69CE9A4298AF15C9DB66644CD9
2016-01-14 18:31:53,818 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 6296CB69CE9A4298AF15C9DB66644CD9
2016-01-14 18:31:53,826 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E7B217A453D349CDB2CC4F435059C955, ordinal: 0
2016-01-14 18:31:53,827 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E7B217A453D349CDB2CC4F435059C955, mem on start (mb), free: 183, total: 281, max: 672
2016-01-14 18:31:53,827 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:53,827 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:53,827 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:53,831 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:53,831 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: DBFF831CE0DF4D01AC2F04E74430BB27
2016-01-14 18:31:53,831 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:53,832 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:53,832 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:53,832 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:53,834 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:53,834 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:53,835 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:53,835 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:53,835 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 6296CB69CE9A4298AF15C9DB66644CD9, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:53,835 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, DBFF831CE0DF4D01AC2F04E74430BB27, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:53,836 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:53,836 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 6296CB69CE9A4298AF15C9DB66644CD9
2016-01-14 18:31:53,836 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:53,836 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 6296CB69CE9A4298AF15C9DB66644CD9
2016-01-14 18:31:53,836 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 6296CB69CE9A4298AF15C9DB66644CD9 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:53,837 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:53,838 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:53,838 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:53,838 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796313513_0001_1_00_000000_0
2016-01-14 18:31:53,839 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:53,840 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@77e1ecbf
2016-01-14 18:31:53,842 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@77e1ecbf
2016-01-14 18:31:53,842 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:53,842 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:53,845 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:53,846 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 6296CB69CE9A4298AF15C9DB66644CD9
2016-01-14 18:31:53,846 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"], id: DBFF831CE0DF4D01AC2F04E74430BB27
2016-01-14 18:31:53,847 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"]
2016-01-14 18:31:53,847 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:53,847 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:53,848 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E7B217A453D349CDB2CC4F435059C955, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:31:53,850 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:53,851 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:53,852 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796313513_0001_1_00_000000_0
2016-01-14 18:31:53,852 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796313513_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:53,853 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796313513_0001_1_00_000000_0
2016-01-14 18:31:53,853 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E7B217A453D349CDB2CC4F435059C955, mem on close (mb), free: 180, total: 281, max: 672
2016-01-14 18:31:53 Completed running task attempt: attempt_1452796313513_0001_1_00_000000_0
2016-01-14 18:31:53,855 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796313513_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:31:53,856 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796313848, Process_Duration=5, Process_End_Time=1452796313853, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:31:53,856 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:53,856 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:31:53,857 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:53,857 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796313513_0001_00_000001
2016-01-14 18:31:53,857 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E7B217A453D349CDB2CC4F435059C955, taskAttemptId=attempt_1452796313513_0001_1_00_000000_0, startTime=1452796313790, finishTime=1452796313856, timeTaken=66, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796313848, Process_Duration=5, Process_End_Time=1452796313853, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:53,858 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796313513_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:31:53,858 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796313513_0001_1_00_000000_0
2016-01-14 18:31:53,858 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:53,859 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:53,859 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:TASK_FINISHED]: vertexName=E7B217A453D349CDB2CC4F435059C955, taskId=task_1452796313513_0001_1_00_000000, startTime=1452796313790, finishTime=1452796313858, timeTaken=68, status=SUCCEEDED, successfulAttemptID=attempt_1452796313513_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796313848, Process_Duration=5, Process_End_Time=1452796313853, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:53,860 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796313513_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:31:53,860 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955] : 1
2016-01-14 18:31:53,860 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,862 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:53,865 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:VERTEX_FINISHED]: vertexName=E7B217A453D349CDB2CC4F435059C955, vertexId=vertex_1452796313513_0001_1_00, initRequestedTime=1452796313739, initedTime=1452796313770, startRequestedTime=1452796313773, startedTime=1452796313773, finishTime=1452796313860, timeTaken=87, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796313848, Process_Duration=5, Process_End_Time=1452796313853, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796313790, firstTasksToStart=[ task_1452796313513_0001_1_00_000000 ], lastTaskFinishTime=1452796313856, lastTasksToFinish=[ task_1452796313513_0001_1_00_000000 ], minTaskDuration=66, maxTaskDuration=66, avgTaskDuration=66.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796313513_0001_1_00_000000 ], longestDurationTasks=[ task_1452796313513_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:31:53,865 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:31:53,865 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796313513_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:31:53,865 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:53,865 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796313513_0001_00_000001, stoppedTime=1452796313865, exitStatus=0
2016-01-14 18:31:53,866 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796313513_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:31:53,866 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:31:53,866 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796313513_0001_1
2016-01-14 18:31:53,867 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796313513_0001_1
2016-01-14 18:31:53,867 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: DBFF831CE0DF4D01AC2F04E74430BB27 for vertex: vertex_1452796313513_0001_1_00 [E7B217A453D349CDB2CC4F435059C955]
2016-01-14 18:31:53,870 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796313513_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:31:53,870 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796313513_0001_00_000001: 13 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:31:53,871 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796313513_0001_00_000001, Exiting
2016-01-14 18:31:53,871 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796313513_0001_00_000001
2016-01-14 18:31:53,871 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796313513_0001_00_000001
2016-01-14 18:31:53,873 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796313513_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:31:53,873 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796313513_0001_00_000001 completed successfully
2016-01-14 18:31:53,878 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796313513_0001_1, queueSize=0
2016-01-14 18:31:53,878 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:53,880 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796313513_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796313513_0001_1, startTime=1452796313738, finishTime=1452796313877, timeTaken=139, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796313848, Process_Duration=5, Process_End_Time=1452796313853, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:53,880 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796313513_0001_1 finished with state: SUCCEEDED
2016-01-14 18:31:53,880 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796313513_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:53,881 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796313513_0001_00_000001
2016-01-14 18:31:53,881 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796313513_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:31:53 Completed Dag: dag_1452796313513_0001_1
2016-01-14 18:31:53,885 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796313513_0001_1, dagState=SUCCEEDED
2016-01-14 18:31:53,885 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796313513_0001_1_post
2016-01-14 18:31:53,886 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:53,887 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:53,890 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452796313513_0001
2016-01-14 18:31:53,892 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:53,892 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:53,892 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:53,893 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:53,893 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:53,893 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:53,894 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:53,894 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:53,894 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:53,894 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:53,895 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:53,895 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:53,895 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:53,900 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/29AEB5307A904AF2A3DE71530C357E22/C3C4F301F21E48C6B878EBA0C7C3149C/.tez/application_1452796313513_0001
2016-01-14 18:31:53,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.420
2016-01-14 18:31:54,016 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_'field2'
2016-01-14 18:31:54,051 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:54,051 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:54,140 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-14 18:31:54,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.041
2016-01-14 18:31:54,158 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:54,159 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:54,159 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:54,181 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:54,182 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'
2016-01-14 18:31:54,213 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:54,213 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:54,213 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"]
2016-01-14 18:31:54,214 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:54,214 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:54,215 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:54,215 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 18:31:54,219 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:54,236 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:54,242 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:54,242 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:54,242 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:54,252 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7/.tez/application_1452796314242_0001 doesn't exist and is created
2016-01-14 18:31:54,270 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:54,271 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:54,271 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7/.tez/application_1452796314242_0001
2016-01-14 18:31:54,274 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796314242_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:54,289 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:54,290 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:54,293 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:54,293 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:54,293 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7/.tez/application_1452796314242_0001/localmode-log-dir
2016-01-14 18:31:54,295 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7/.tez/application_1452796314242_0001/localmode-log-dir/history.txt.appattempt_1452796314242_0001_000000, maxErrors=10
2016-01-14 18:31:54,295 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:54,295 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796314242_0001_000000, appSubmitTime=1452796314273, launchTime=1452796314274
2016-01-14 18:31:54,302 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:54,305 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:54,305 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:54,305 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:54,308 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:44889
2016-01-14 18:31:54,309 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:54,312 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:54,312 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796314242_0001_000000, startTime=1452796314312
2016-01-14 18:31:54,312 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:54,371 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:54,371 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:54,371 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452796314242_0001, dagName=[F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 18:31:54,395 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 18:31:54,397 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796314242_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7/.tez/application_1452796314242_0001/localmode-log-dir/dag_1452796314242_0001_1.dot
2016-01-14 18:31:54,398 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7/.tez/application_1452796314242_0001/localmode-log-dir/dag_1452796314242_0001_1-tez-dag.pb.txt
2016-01-14 18:31:54,425 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796314242_0001_1
2016-01-14 18:31:54,425 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:54,425 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 18:31:54 Running Dag: dag_1452796314242_0001_1
2016-01-14 18:31:54,437 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796314242_0001_1, submitTime=1452796314395
2016-01-14 18:31:54,437 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:54,438 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F0FE49304CC7409A893954C7047193CF
2016-01-14 18:31:54,438 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:54,438 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796314242_0001_1, initTime=1452796314437
2016-01-14 18:31:54,439 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796314242_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:54,438 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:54,440 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:DAG_STARTED]: dagID=dag_1452796314242_0001_1, startTime=1452796314440
2016-01-14 18:31:54,440 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:54,441 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452796314242_0001, dagName=[F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 18:31:54,441 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:54,441 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796314242_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:54,441 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F0FE49304CC7409A893954C7047193CF : {41CF40634B3C40DCA2818AF7C7A5DA00={InputName=41CF40634B3C40DCA2818AF7C7A5DA00}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:54,441 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 41CF40634B3C40DCA2818AF7C7A5DA00, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:54,442 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,442 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,442 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,442 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]. Starting root input initializers: 1
2016-01-14 18:31:54,442 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:54,443 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 41CF40634B3C40DCA2818AF7C7A5DA00 on vertex vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,445 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:54,445 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 41CF40634B3C40DCA2818AF7C7A5DA00 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:54,446 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:54,447 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:54,449 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:54,450 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 41CF40634B3C40DCA2818AF7C7A5DA00 on vertex vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,450 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:54,450 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {41CF40634B3C40DCA2818AF7C7A5DA00=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:54,451 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF] parallelism set to 1
2016-01-14 18:31:54,451 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:54,451 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796314242_0001_1_00, eventCount=1
2016-01-14 18:31:54,452 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,452 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=62C1C300D1E1405598D246FFE98F4E05, vertexId=vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:54,452 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=62C1C300D1E1405598D246FFE98F4E05, vertexId=vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,454 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=62C1C300D1E1405598D246FFE98F4E05, vertexName=F0FE49304CC7409A893954C7047193CF, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:54,454 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=62C1C300D1E1405598D246FFE98F4E05, vertexId=vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,456 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:54,456 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F0FE49304CC7409A893954C7047193CF, vertexId=vertex_1452796314242_0001_1_00, initRequestedTime=1452796314441, initedTime=1452796314455, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:54,457 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF] with distanceFromRoot: 0
2016-01-14 18:31:54,457 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:54,458 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F0FE49304CC7409A893954C7047193CF
2016-01-14 18:31:54,458 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,458 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:54,459 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796314242_0001_1_00, startRequestedTime=1452796314457, startedTime=1452796314457
2016-01-14 18:31:54,459 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:54,460 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:54,460 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:TASK_STARTED]: vertexName=F0FE49304CC7409A893954C7047193CF, taskId=task_1452796314242_0001_1_00_000000, scheduledTime=1452796314459, launchTime=1452796314459
2016-01-14 18:31:54,461 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796314242_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:54,461 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,462 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7] every.every/(1/1) ...SULTS.-1_'field2'_'field', VertexName: F0FE49304CC7409A893954C7047193CF, VertexParallelism: 1, TaskAttemptID:attempt_1452796314242_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=41CF40634B3C40DCA2818AF7C7A5DA00, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=62C1C300D1E1405598D246FFE98F4E05, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:54,462 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796314242_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:54,462 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:54,464 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:54,469 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:54,469 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:54,470 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796314242_0001_00_000001
2016-01-14 18:31:54,470 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314242_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:54,472 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796314242_0001_00_000001
2016-01-14 18:31:54,472 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:54,473 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314242_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:54,474 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:54,475 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796314242_0001_00_000001, launchTime=1452796314474
2016-01-14 18:31:54,475 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796314242_0001_00_000001
2016-01-14 18:31:54,478 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796314242_0001_1_00_000000_0] to container: [container_1452796314242_0001_00_000001]
2016-01-14 18:31:54,478 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314242_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:54,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796314242_0001, with dag id: dag_1452796314242_0001_1
2016-01-14 18:31:54,480 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796314242_0001_1_00_000000_0] started. Is using containerId: [container_1452796314242_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:54,480 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F0FE49304CC7409A893954C7047193CF, taskAttemptId=attempt_1452796314242_0001_1_00_000000_0, startTime=1452796314478, containerId=container_1452796314242_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796314242_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:54,480 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:54,480 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796314242_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:54,482 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796314242_0001_00_000001 given task: attempt_1452796314242_0001_1_00_000000_0
2016-01-14 18:31:54,482 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796314242_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796314242_0001_1_00_000000_0
2016-01-14 18:31:54 Starting to run new task attempt: attempt_1452796314242_0001_1_00_000000_0
2016-01-14 18:31:54,483 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796314242_0001_1_00_000000_0
2016-01-14 18:31:54,483 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:54,483 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:54,483 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:54,483 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:54,483 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:54,483 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:54,483 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7] every.every/(1/1) ...SULTS.-1_'field2'_'field', VertexName: F0FE49304CC7409A893954C7047193CF, VertexParallelism: 1, TaskAttemptID:attempt_1452796314242_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=41CF40634B3C40DCA2818AF7C7A5DA00, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=62C1C300D1E1405598D246FFE98F4E05, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:54,484 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:54,484 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796314242_0001_1_00_000000_0
2016-01-14 18:31:54,486 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796314242_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:54,488 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:54,488 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:54,488 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796314242_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:54,489 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:54,489 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=41CF40634B3C40DCA2818AF7C7A5DA00, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:54,490 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=62C1C300D1E1405598D246FFE98F4E05, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:54,490 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:54,492 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:54,493 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 41CF40634B3C40DCA2818AF7C7A5DA00
2016-01-14 18:31:54,493 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 41CF40634B3C40DCA2818AF7C7A5DA00
2016-01-14 18:31:54,493 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 62C1C300D1E1405598D246FFE98F4E05
2016-01-14 18:31:54,494 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:54,494 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 62C1C300D1E1405598D246FFE98F4E05
2016-01-14 18:31:54,499 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:54,499 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 41CF40634B3C40DCA2818AF7C7A5DA00
2016-01-14 18:31:54,499 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 41CF40634B3C40DCA2818AF7C7A5DA00
2016-01-14 18:31:54,505 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:54,512 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:54,512 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 62C1C300D1E1405598D246FFE98F4E05
2016-01-14 18:31:54,516 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F0FE49304CC7409A893954C7047193CF, ordinal: 0
2016-01-14 18:31:54,516 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F0FE49304CC7409A893954C7047193CF, mem on start (mb), free: 298, total: 388, max: 672
2016-01-14 18:31:54,516 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:54,516 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:54,516 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:54,516 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:54,517 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:54,517 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:54,517 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:54,517 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:54,517 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:54,518 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:54,518 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:54,518 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 41CF40634B3C40DCA2818AF7C7A5DA00, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:54,518 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 62C1C300D1E1405598D246FFE98F4E05, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:54,518 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:54,518 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 41CF40634B3C40DCA2818AF7C7A5DA00 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:54,519 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 41CF40634B3C40DCA2818AF7C7A5DA00
2016-01-14 18:31:54,519 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:54,519 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 41CF40634B3C40DCA2818AF7C7A5DA00
2016-01-14 18:31:54,519 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:54,520 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:54,520 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:54,521 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796314242_0001_1_00_000000_0
2016-01-14 18:31:54,521 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:54,522 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@23897acf
2016-01-14 18:31:54,524 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@23897acf
2016-01-14 18:31:54,524 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:54,524 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:54,527 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:54,529 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 41CF40634B3C40DCA2818AF7C7A5DA00
2016-01-14 18:31:54,530 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"], id: 62C1C300D1E1405598D246FFE98F4E05
2016-01-14 18:31:54,530 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"]
2016-01-14 18:31:54,531 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:54,531 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:54,532 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F0FE49304CC7409A893954C7047193CF, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:31:54,535 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:54,536 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:54,536 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796314242_0001_1_00_000000_0
2016-01-14 18:31:54,537 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796314242_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:54,539 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796314242_0001_1_00_000000_0
2016-01-14 18:31:54,539 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F0FE49304CC7409A893954C7047193CF, mem on close (mb), free: 296, total: 388, max: 672
2016-01-14 18:31:54 Completed running task attempt: attempt_1452796314242_0001_1_00_000000_0
2016-01-14 18:31:54,540 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796314242_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:31:54,542 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:54,543 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F0FE49304CC7409A893954C7047193CF, taskAttemptId=attempt_1452796314242_0001_1_00_000000_0, startTime=1452796314478, finishTime=1452796314542, timeTaken=64, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407371776, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796314532, Process_Duration=6, Process_End_Time=1452796314538, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:54,543 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796314242_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:31:54,543 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:54,544 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796314242_0001_1_00_000000_0
2016-01-14 18:31:54,544 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:54,546 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:TASK_FINISHED]: vertexName=F0FE49304CC7409A893954C7047193CF, taskId=task_1452796314242_0001_1_00_000000, startTime=1452796314478, finishTime=1452796314544, timeTaken=66, status=SUCCEEDED, successfulAttemptID=attempt_1452796314242_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407371776, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796314532, Process_Duration=6, Process_End_Time=1452796314538, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:54,546 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407371776, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796314532, Process_Duration=6, Process_End_Time=1452796314538, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:31:54,547 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796314242_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:31:54,547 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:31:54,547 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:54,548 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796314242_0001_00_000001
2016-01-14 18:31:54,548 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF] : 1
2016-01-14 18:31:54,548 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,549 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:54,550 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:VERTEX_FINISHED]: vertexName=F0FE49304CC7409A893954C7047193CF, vertexId=vertex_1452796314242_0001_1_00, initRequestedTime=1452796314441, initedTime=1452796314455, startRequestedTime=1452796314457, startedTime=1452796314457, finishTime=1452796314548, timeTaken=91, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407371776, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796314532, Process_Duration=6, Process_End_Time=1452796314538, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796314478, firstTasksToStart=[ task_1452796314242_0001_1_00_000000 ], lastTaskFinishTime=1452796314542, lastTasksToFinish=[ task_1452796314242_0001_1_00_000000 ], minTaskDuration=64, maxTaskDuration=64, avgTaskDuration=64.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796314242_0001_1_00_000000 ], longestDurationTasks=[ task_1452796314242_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:31:54,550 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:31:54,550 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314242_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:31:54,551 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796314242_0001_00_000001, stoppedTime=1452796314551, exitStatus=0
2016-01-14 18:31:54,551 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:54,553 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314242_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:31:54,553 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:31:54,555 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796314242_0001_1
2016-01-14 18:31:54,555 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796314242_0001_1
2016-01-14 18:31:54,556 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 62C1C300D1E1405598D246FFE98F4E05 for vertex: vertex_1452796314242_0001_1_00 [F0FE49304CC7409A893954C7047193CF]
2016-01-14 18:31:54,559 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796314242_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:31:54,559 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796314242_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:31:54,560 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796314242_0001_00_000001, Exiting
2016-01-14 18:31:54,560 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796314242_0001_00_000001
2016-01-14 18:31:54,560 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796314242_0001_00_000001
2016-01-14 18:31:54,563 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796314242_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:31:54,563 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796314242_0001_00_000001 completed successfully
2016-01-14 18:31:54,571 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796314242_0001_1, queueSize=0
2016-01-14 18:31:54,572 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:54,572 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314242_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796314242_0001_1, startTime=1452796314440, finishTime=1452796314570, timeTaken=130, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407371776, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796314532, Process_Duration=6, Process_End_Time=1452796314538, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:54,572 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796314242_0001_1 finished with state: SUCCEEDED
2016-01-14 18:31:54,572 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796314242_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:54,573 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314242_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:31:54 Completed Dag: dag_1452796314242_0001_1
2016-01-14 18:31:54,573 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796314242_0001_00_000001
2016-01-14 18:31:54,573 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796314242_0001_1, dagState=SUCCEEDED
2016-01-14 18:31:54,575 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796314242_0001_1_post
2016-01-14 18:31:54,575 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:54,575 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:54,583 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452796314242_0001
2016-01-14 18:31:54,586 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:54,586 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:54,586 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:54,587 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:54,587 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:54,588 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:54,588 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:54,589 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:54,589 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:54,589 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:54,589 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:54,590 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:54,590 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:54,596 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F0AFFF1414764349A62E8EA46FAEA617/C2AF8EACADB249328FB00E99ED70FDF7/.tez/application_1452796314242_0001
2016-01-14 18:31:54,597 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.384
2016-01-14 18:31:54,681 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_'field'
2016-01-14 18:31:54,709 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:54,710 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:54,762 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 18:31:54,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.036
2016-01-14 18:31:54,780 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:54,780 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:54,781 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:54,806 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:54,807 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS
2016-01-14 18:31:54,825 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:54,826 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:54,826 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"]
2016-01-14 18:31:54,826 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:54,826 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:54,827 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:54,828 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 18:31:54,829 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:54,847 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:54,852 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:54,852 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:54,852 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:54,861 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369/.tez/application_1452796314852_0001 doesn't exist and is created
2016-01-14 18:31:54,875 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:54,875 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:54,876 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369/.tez/application_1452796314852_0001
2016-01-14 18:31:54,878 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796314852_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:54,891 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:54,892 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:54,894 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:54,894 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:54,895 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369/.tez/application_1452796314852_0001/localmode-log-dir
2016-01-14 18:31:54,895 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369/.tez/application_1452796314852_0001/localmode-log-dir/history.txt.appattempt_1452796314852_0001_000000, maxErrors=10
2016-01-14 18:31:54,895 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:54,896 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796314852_0001_000000, appSubmitTime=1452796314877, launchTime=1452796314877
2016-01-14 18:31:54,901 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:54,905 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:39540
2016-01-14 18:31:54,906 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:54,907 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:54,908 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:54,911 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:54,913 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:54,913 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796314852_0001_000000, startTime=1452796314913
2016-01-14 18:31:54,914 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:54,975 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:54,976 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:54,976 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452796314852_0001, dagName=[5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 18:31:55,007 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 18:31:55,009 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796314852_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369/.tez/application_1452796314852_0001/localmode-log-dir/dag_1452796314852_0001_1.dot
2016-01-14 18:31:55,010 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369/.tez/application_1452796314852_0001/localmode-log-dir/dag_1452796314852_0001_1-tez-dag.pb.txt
2016-01-14 18:31:55,042 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796314852_0001_1
2016-01-14 18:31:55,042 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:55,043 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 18:31:55 Running Dag: dag_1452796314852_0001_1
2016-01-14 18:31:55,056 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:55,057 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796314852_0001_1, submitTime=1452796315007
2016-01-14 18:31:55,058 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A309E0221BA74CB4BA4AF2D02520C2CA
2016-01-14 18:31:55,058 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:55,059 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:55,060 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796314852_0001_1, initTime=1452796315058
2016-01-14 18:31:55,060 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796314852_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:55,061 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:DAG_STARTED]: dagID=dag_1452796314852_0001_1, startTime=1452796315061
2016-01-14 18:31:55,061 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:55,061 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796314852_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:55,061 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A309E0221BA74CB4BA4AF2D02520C2CA : {DCFE6E56830A452E80B8EBC8FD0D37C4={InputName=DCFE6E56830A452E80B8EBC8FD0D37C4}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:55,062 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: DCFE6E56830A452E80B8EBC8FD0D37C4, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:55,062 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,061 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:55,062 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,062 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,062 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]. Starting root input initializers: 1
2016-01-14 18:31:55,063 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:55,063 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: DCFE6E56830A452E80B8EBC8FD0D37C4 on vertex vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,063 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452796314852_0001, dagName=[5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 18:31:55,066 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:55,066 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input DCFE6E56830A452E80B8EBC8FD0D37C4 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:55,068 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:55,068 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:55,070 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:55,071 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: DCFE6E56830A452E80B8EBC8FD0D37C4 on vertex vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,071 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:55,071 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {DCFE6E56830A452E80B8EBC8FD0D37C4=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:55,071 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA] parallelism set to 1
2016-01-14 18:31:55,072 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:55,072 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796314852_0001_1_00, eventCount=1
2016-01-14 18:31:55,072 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,072 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=70FE92A465C84649B957C2210073F007, vertexId=vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:55,072 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=70FE92A465C84649B957C2210073F007, vertexId=vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,075 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=70FE92A465C84649B957C2210073F007, vertexName=A309E0221BA74CB4BA4AF2D02520C2CA, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:55,075 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=70FE92A465C84649B957C2210073F007, vertexId=vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,076 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A309E0221BA74CB4BA4AF2D02520C2CA, vertexId=vertex_1452796314852_0001_1_00, initRequestedTime=1452796315061, initedTime=1452796315076, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:55,076 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:55,076 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA] with distanceFromRoot: 0
2016-01-14 18:31:55,077 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:55,078 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A309E0221BA74CB4BA4AF2D02520C2CA
2016-01-14 18:31:55,078 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,078 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:55,078 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796314852_0001_1_00, startRequestedTime=1452796315078, startedTime=1452796315078
2016-01-14 18:31:55,079 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:55,079 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:55,079 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:TASK_STARTED]: vertexName=A309E0221BA74CB4BA4AF2D02520C2CA, taskId=task_1452796314852_0001_1_00_000000, scheduledTime=1452796315079, launchTime=1452796315079
2016-01-14 18:31:55,079 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796314852_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:55,080 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,080 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS, VertexName: A309E0221BA74CB4BA4AF2D02520C2CA, VertexParallelism: 1, TaskAttemptID:attempt_1452796314852_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=DCFE6E56830A452E80B8EBC8FD0D37C4, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=70FE92A465C84649B957C2210073F007, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:55,080 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796314852_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:55,081 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:55,082 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:55,082 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:55,083 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:55,083 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796314852_0001_00_000001
2016-01-14 18:31:55,083 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314852_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:55,086 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796314852_0001_00_000001
2016-01-14 18:31:55,087 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:55,088 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314852_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:55,088 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:55,089 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796314852_0001_00_000001, launchTime=1452796315088
2016-01-14 18:31:55,090 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796314852_0001_00_000001
2016-01-14 18:31:55,091 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796314852_0001_1_00_000000_0] to container: [container_1452796314852_0001_00_000001]
2016-01-14 18:31:55,091 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314852_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:55,091 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796314852_0001_00_000001 given task: attempt_1452796314852_0001_1_00_000000_0
2016-01-14 18:31:55,091 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796314852_0001_1_00_000000_0] started. Is using containerId: [container_1452796314852_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:55,091 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796314852_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796314852_0001_1_00_000000_0
2016-01-14 18:31:55,092 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A309E0221BA74CB4BA4AF2D02520C2CA, taskAttemptId=attempt_1452796314852_0001_1_00_000000_0, startTime=1452796315091, containerId=container_1452796314852_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796314852_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:55,092 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:55,092 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796314852_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:55,092 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796314852_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:55 Starting to run new task attempt: attempt_1452796314852_0001_1_00_000000_0
2016-01-14 18:31:55,094 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796314852_0001_1_00_000000_0
2016-01-14 18:31:55,094 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:55,094 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:55,094 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:55,095 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:55,095 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:55,095 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:55,096 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS, VertexName: A309E0221BA74CB4BA4AF2D02520C2CA, VertexParallelism: 1, TaskAttemptID:attempt_1452796314852_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=DCFE6E56830A452E80B8EBC8FD0D37C4, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=70FE92A465C84649B957C2210073F007, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:55,096 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:55,097 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796314852_0001_1_00_000000_0
2016-01-14 18:31:55,098 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:55,098 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:55,099 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:55,100 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=70FE92A465C84649B957C2210073F007, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:55,101 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:55,102 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 70FE92A465C84649B957C2210073F007
2016-01-14 18:31:55,102 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:55,102 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 70FE92A465C84649B957C2210073F007
2016-01-14 18:31:55,100 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796314852_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:55,105 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:55,106 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=DCFE6E56830A452E80B8EBC8FD0D37C4, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:55,107 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:55,107 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: DCFE6E56830A452E80B8EBC8FD0D37C4
2016-01-14 18:31:55,108 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: DCFE6E56830A452E80B8EBC8FD0D37C4
2016-01-14 18:31:55,114 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:55,114 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: DCFE6E56830A452E80B8EBC8FD0D37C4
2016-01-14 18:31:55,115 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: DCFE6E56830A452E80B8EBC8FD0D37C4
2016-01-14 18:31:55,118 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796314852_0001, with dag id: dag_1452796314852_0001_1
2016-01-14 18:31:55,123 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:55,123 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 70FE92A465C84649B957C2210073F007
2016-01-14 18:31:55,124 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A309E0221BA74CB4BA4AF2D02520C2CA, ordinal: 0
2016-01-14 18:31:55,124 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A309E0221BA74CB4BA4AF2D02520C2CA, mem on start (mb), free: 192, total: 388, max: 672
2016-01-14 18:31:55,125 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:55,125 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:55,125 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:55,125 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:55,125 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:55,126 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:55,126 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:55,127 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:55,127 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:55,127 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:55,128 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:55,128 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 70FE92A465C84649B957C2210073F007, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:55,128 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, DCFE6E56830A452E80B8EBC8FD0D37C4, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:55,129 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:55,129 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: DCFE6E56830A452E80B8EBC8FD0D37C4 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:55,129 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: DCFE6E56830A452E80B8EBC8FD0D37C4
2016-01-14 18:31:55,129 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:55,129 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: DCFE6E56830A452E80B8EBC8FD0D37C4
2016-01-14 18:31:55,129 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:55,130 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:55,130 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:55,131 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796314852_0001_1_00_000000_0
2016-01-14 18:31:55,132 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:55,133 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@192ffd75
2016-01-14 18:31:55,134 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@192ffd75
2016-01-14 18:31:55,135 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:55,135 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:55,136 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:55,136 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: DCFE6E56830A452E80B8EBC8FD0D37C4
2016-01-14 18:31:55,137 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"], id: 70FE92A465C84649B957C2210073F007
2016-01-14 18:31:55,137 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"]
2016-01-14 18:31:55,137 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:55,137 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:55,138 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A309E0221BA74CB4BA4AF2D02520C2CA, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:31:55,140 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:55,140 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:55,141 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796314852_0001_1_00_000000_0
2016-01-14 18:31:55,141 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796314852_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:55,142 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796314852_0001_1_00_000000_0
2016-01-14 18:31:55,142 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A309E0221BA74CB4BA4AF2D02520C2CA, mem on close (mb), free: 190, total: 388, max: 672
2016-01-14 18:31:55 Completed running task attempt: attempt_1452796314852_0001_1_00_000000_0
2016-01-14 18:31:55,143 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796314852_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:31:55,144 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407371776, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796315138, Process_Duration=4, Process_End_Time=1452796315142, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:31:55,146 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A309E0221BA74CB4BA4AF2D02520C2CA, taskAttemptId=attempt_1452796314852_0001_1_00_000000_0, startTime=1452796315091, finishTime=1452796315144, timeTaken=53, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407371776, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796315138, Process_Duration=4, Process_End_Time=1452796315142, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:55,145 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:55,146 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:31:55,147 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:55,147 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796314852_0001_00_000001
2016-01-14 18:31:55,146 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796314852_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:31:55,148 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796314852_0001_1_00_000000_0
2016-01-14 18:31:55,148 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:55,150 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:55,150 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:TASK_FINISHED]: vertexName=A309E0221BA74CB4BA4AF2D02520C2CA, taskId=task_1452796314852_0001_1_00_000000, startTime=1452796315091, finishTime=1452796315148, timeTaken=57, status=SUCCEEDED, successfulAttemptID=attempt_1452796314852_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407371776, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796315138, Process_Duration=4, Process_End_Time=1452796315142, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:55,150 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796314852_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:31:55,150 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA] : 1
2016-01-14 18:31:55,150 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,151 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:55,152 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:VERTEX_FINISHED]: vertexName=A309E0221BA74CB4BA4AF2D02520C2CA, vertexId=vertex_1452796314852_0001_1_00, initRequestedTime=1452796315061, initedTime=1452796315076, startRequestedTime=1452796315078, startedTime=1452796315078, finishTime=1452796315151, timeTaken=73, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407371776, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796315138, Process_Duration=4, Process_End_Time=1452796315142, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796315091, firstTasksToStart=[ task_1452796314852_0001_1_00_000000 ], lastTaskFinishTime=1452796315144, lastTasksToFinish=[ task_1452796314852_0001_1_00_000000 ], minTaskDuration=53, maxTaskDuration=53, avgTaskDuration=53.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796314852_0001_1_00_000000 ], longestDurationTasks=[ task_1452796314852_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:31:55,153 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:31:55,153 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314852_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:31:55,153 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796314852_0001_00_000001, stoppedTime=1452796315153, exitStatus=0
2016-01-14 18:31:55,153 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:55,154 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314852_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:31:55,154 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:31:55,154 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796314852_0001_1
2016-01-14 18:31:55,154 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796314852_0001_1
2016-01-14 18:31:55,154 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 70FE92A465C84649B957C2210073F007 for vertex: vertex_1452796314852_0001_1_00 [A309E0221BA74CB4BA4AF2D02520C2CA]
2016-01-14 18:31:55,158 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796314852_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:31:55,158 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796314852_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:31:55,159 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796314852_0001_00_000001, Exiting
2016-01-14 18:31:55,159 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796314852_0001_00_000001
2016-01-14 18:31:55,159 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796314852_0001_00_000001
2016-01-14 18:31:55,161 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796314852_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:31:55,161 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796314852_0001_00_000001 completed successfully
2016-01-14 18:31:55,167 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796314852_0001_1, queueSize=0
2016-01-14 18:31:55,167 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:55,167 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796314852_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796314852_0001_1, startTime=1452796315061, finishTime=1452796315165, timeTaken=104, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407371776, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796315138, Process_Duration=4, Process_End_Time=1452796315142, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:55,168 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796314852_0001_1 finished with state: SUCCEEDED
2016-01-14 18:31:55,168 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796314852_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:55,169 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796314852_0001_00_000001
2016-01-14 18:31:55,169 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796314852_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:31:55 Completed Dag: dag_1452796314852_0001_1
2016-01-14 18:31:55,171 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796314852_0001_1, dagState=SUCCEEDED
2016-01-14 18:31:55,171 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796314852_0001_1_post
2016-01-14 18:31:55,171 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:55,172 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:55,178 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452796314852_0001
2016-01-14 18:31:55,181 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:55,181 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:55,181 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:55,181 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:55,181 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:55,182 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:55,182 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:55,183 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:55,183 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:55,184 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:55,184 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:55,185 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:55,185 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:55,191 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5769194593984EC1AE6F0CA6A802E11A/A91E4618573D4ED9BDF043D0D5ABB369/.tez/application_1452796314852_0001
2016-01-14 18:31:55,192 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.367
2016-01-14 18:31:55,299 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_RESULTS
2016-01-14 18:31:55,344 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:55,345 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:55,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 18:31:55,441 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 18:31:55,441 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:55,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:55,442 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:55,460 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:55,461 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL
2016-01-14 18:31:55,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:55,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:55,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"]
2016-01-14 18:31:55,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:55,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:55,474 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:55,475 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 18:31:55,475 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:55,499 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:55,504 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:55,504 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:55,505 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:55,515 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189/.tez/application_1452796315504_0001 doesn't exist and is created
2016-01-14 18:31:55,530 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:55,530 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:55,531 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189/.tez/application_1452796315504_0001
2016-01-14 18:31:55,533 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796315504_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:55,547 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:55,548 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:55,550 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:55,550 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:55,550 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189/.tez/application_1452796315504_0001/localmode-log-dir
2016-01-14 18:31:55,551 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189/.tez/application_1452796315504_0001/localmode-log-dir/history.txt.appattempt_1452796315504_0001_000000, maxErrors=10
2016-01-14 18:31:55,551 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:55,551 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796315504_0001_000000, appSubmitTime=1452796315533, launchTime=1452796315533
2016-01-14 18:31:55,557 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:55,560 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:55,560 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:55,560 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:55,562 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:41366
2016-01-14 18:31:55,567 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:55,570 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796315504_0001_000000, startTime=1452796315570
2016-01-14 18:31:55,570 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:55,570 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:55,631 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:55,631 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:55,631 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452796315504_0001, dagName=[EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 18:31:55,664 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 18:31:55,666 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796315504_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189/.tez/application_1452796315504_0001/localmode-log-dir/dag_1452796315504_0001_1.dot
2016-01-14 18:31:55,667 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189/.tez/application_1452796315504_0001/localmode-log-dir/dag_1452796315504_0001_1-tez-dag.pb.txt
2016-01-14 18:31:55,690 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796315504_0001_1
2016-01-14 18:31:55,690 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:55,691 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 18:31:55 Running Dag: dag_1452796315504_0001_1
2016-01-14 18:31:55,704 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796315504_0001_1, submitTime=1452796315664
2016-01-14 18:31:55,704 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:55,705 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AFD3148F76424164897322683CC245A9
2016-01-14 18:31:55,705 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:55,705 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796315504_0001_1, initTime=1452796315704
2016-01-14 18:31:55,707 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796315504_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:55,707 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:55,708 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:DAG_STARTED]: dagID=dag_1452796315504_0001_1, startTime=1452796315708
2016-01-14 18:31:55,708 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:55,708 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:55,709 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796315504_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:55,709 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452796315504_0001, dagName=[EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 18:31:55,709 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AFD3148F76424164897322683CC245A9 : {B7446316B7E043B8A36B1F0350133AE0={InputName=B7446316B7E043B8A36B1F0350133AE0}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:55,709 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: B7446316B7E043B8A36B1F0350133AE0, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:55,709 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,709 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,710 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,710 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]. Starting root input initializers: 1
2016-01-14 18:31:55,710 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:55,712 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: B7446316B7E043B8A36B1F0350133AE0 on vertex vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,715 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:55,715 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input B7446316B7E043B8A36B1F0350133AE0 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:55,717 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:55,718 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:55,721 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:55,721 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: B7446316B7E043B8A36B1F0350133AE0 on vertex vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,722 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:55,722 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {B7446316B7E043B8A36B1F0350133AE0=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:55,722 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9] parallelism set to 1
2016-01-14 18:31:55,723 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:55,723 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796315504_0001_1_00, eventCount=1
2016-01-14 18:31:55,723 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,723 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=662C62649171499586AB5A738CB5590E, vertexId=vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:55,723 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=662C62649171499586AB5A738CB5590E, vertexId=vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,727 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=662C62649171499586AB5A738CB5590E, vertexName=AFD3148F76424164897322683CC245A9, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:55,727 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=662C62649171499586AB5A738CB5590E, vertexId=vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,730 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AFD3148F76424164897322683CC245A9, vertexId=vertex_1452796315504_0001_1_00, initRequestedTime=1452796315709, initedTime=1452796315729, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:55,730 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9] with distanceFromRoot: 0
2016-01-14 18:31:55,730 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:55,731 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:55,731 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AFD3148F76424164897322683CC245A9
2016-01-14 18:31:55,732 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,732 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:55,732 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796315504_0001_1_00, startRequestedTime=1452796315731, startedTime=1452796315731
2016-01-14 18:31:55,733 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:55,733 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:55,734 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:TASK_STARTED]: vertexName=AFD3148F76424164897322683CC245A9, taskId=task_1452796315504_0001_1_00_000000, scheduledTime=1452796315733, launchTime=1452796315733
2016-01-14 18:31:55,734 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796315504_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:55,735 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,738 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL, VertexName: AFD3148F76424164897322683CC245A9, VertexParallelism: 1, TaskAttemptID:attempt_1452796315504_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B7446316B7E043B8A36B1F0350133AE0, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=662C62649171499586AB5A738CB5590E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:55,738 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796315504_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:55,740 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:55,742 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:55,743 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:55,743 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:55,744 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796315504_0001_00_000001
2016-01-14 18:31:55,744 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796315504_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:55,748 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796315504_0001, with dag id: dag_1452796315504_0001_1
2016-01-14 18:31:55,750 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796315504_0001_00_000001
2016-01-14 18:31:55,750 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:55,751 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:55,752 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796315504_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:55,753 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796315504_0001_00_000001, launchTime=1452796315751
2016-01-14 18:31:55,753 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796315504_0001_00_000001
2016-01-14 18:31:55,756 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796315504_0001_1_00_000000_0] to container: [container_1452796315504_0001_00_000001]
2016-01-14 18:31:55,757 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796315504_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:55,758 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796315504_0001_00_000001 given task: attempt_1452796315504_0001_1_00_000000_0
2016-01-14 18:31:55,758 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796315504_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796315504_0001_1_00_000000_0
2016-01-14 18:31:55 Starting to run new task attempt: attempt_1452796315504_0001_1_00_000000_0
2016-01-14 18:31:55,759 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796315504_0001_1_00_000000_0] started. Is using containerId: [container_1452796315504_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:55,760 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796315504_0001_1_00_000000_0
2016-01-14 18:31:55,762 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:55,762 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AFD3148F76424164897322683CC245A9, taskAttemptId=attempt_1452796315504_0001_1_00_000000_0, startTime=1452796315758, containerId=container_1452796315504_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796315504_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:55,762 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:55,762 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796315504_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:55,763 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796315504_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:55,762 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:55,763 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:55,763 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:55,764 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:55,764 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:55,764 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL, VertexName: AFD3148F76424164897322683CC245A9, VertexParallelism: 1, TaskAttemptID:attempt_1452796315504_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B7446316B7E043B8A36B1F0350133AE0, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=662C62649171499586AB5A738CB5590E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:55,764 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:55,765 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796315504_0001_1_00_000000_0
2016-01-14 18:31:55,768 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:55,769 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:55,770 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:55,774 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=662C62649171499586AB5A738CB5590E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:55,774 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796315504_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:55,774 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:55,775 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 662C62649171499586AB5A738CB5590E
2016-01-14 18:31:55,775 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:55,776 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 662C62649171499586AB5A738CB5590E
2016-01-14 18:31:55,775 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=B7446316B7E043B8A36B1F0350133AE0, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:55,779 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:55,779 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:55,783 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: B7446316B7E043B8A36B1F0350133AE0
2016-01-14 18:31:55,784 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: B7446316B7E043B8A36B1F0350133AE0
2016-01-14 18:31:55,797 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:55,797 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: B7446316B7E043B8A36B1F0350133AE0
2016-01-14 18:31:55,797 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: B7446316B7E043B8A36B1F0350133AE0
2016-01-14 18:31:55,802 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AFD3148F76424164897322683CC245A9, ordinal: 0
2016-01-14 18:31:55,802 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AFD3148F76424164897322683CC245A9, mem on start (mb), free: 296, total: 383, max: 672
2016-01-14 18:31:55,803 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:55,803 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:55,805 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:55,805 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:55,805 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 662C62649171499586AB5A738CB5590E
2016-01-14 18:31:55,806 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:55,806 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:55,806 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:55,807 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:55,807 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:55,807 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:55,807 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:55,809 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:55,810 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 662C62649171499586AB5A738CB5590E, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:55,810 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, B7446316B7E043B8A36B1F0350133AE0, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:55,811 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:55,812 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: B7446316B7E043B8A36B1F0350133AE0
2016-01-14 18:31:55,812 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:55,812 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: B7446316B7E043B8A36B1F0350133AE0
2016-01-14 18:31:55,813 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: B7446316B7E043B8A36B1F0350133AE0 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:55,813 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:55,814 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:55,814 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:55,815 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796315504_0001_1_00_000000_0
2016-01-14 18:31:55,820 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:55,821 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: B7446316B7E043B8A36B1F0350133AE0
2016-01-14 18:31:55,822 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"], id: 662C62649171499586AB5A738CB5590E
2016-01-14 18:31:55,823 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"]
2016-01-14 18:31:55,824 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:55,824 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:55,825 INFO input.MRInput (MRInput.java:checkAndAwaitRecordReaderInitialization(597)) - Awaiting RecordReader initialization
2016-01-14 18:31:55,825 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:55,826 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@414f0e6e
2016-01-14 18:31:55,828 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@414f0e6e
2016-01-14 18:31:55,828 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:55,829 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:55,829 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AFD3148F76424164897322683CC245A9, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:31:55,833 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:55,834 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:55,834 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796315504_0001_1_00_000000_0
2016-01-14 18:31:55,835 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796315504_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:55,838 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796315504_0001_1_00_000000_0
2016-01-14 18:31:55,838 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AFD3148F76424164897322683CC245A9, mem on close (mb), free: 295, total: 383, max: 672
2016-01-14 18:31:55 Completed running task attempt: attempt_1452796315504_0001_1_00_000000_0
2016-01-14 18:31:55,840 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796315504_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:31:55,842 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:55,842 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AFD3148F76424164897322683CC245A9, taskAttemptId=attempt_1452796315504_0001_1_00_000000_0, startTime=1452796315758, finishTime=1452796315841, timeTaken=83, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402128896, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796315830, Process_Duration=8, Process_End_Time=1452796315838, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:55,842 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796315504_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:31:55,842 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796315504_0001_1_00_000000_0
2016-01-14 18:31:55,843 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:55,844 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:TASK_FINISHED]: vertexName=AFD3148F76424164897322683CC245A9, taskId=task_1452796315504_0001_1_00_000000, startTime=1452796315758, finishTime=1452796315843, timeTaken=85, status=SUCCEEDED, successfulAttemptID=attempt_1452796315504_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402128896, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796315830, Process_Duration=8, Process_End_Time=1452796315838, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:55,844 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796315504_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:31:55,844 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9] : 1
2016-01-14 18:31:55,845 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,846 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:55,847 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:55,850 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:VERTEX_FINISHED]: vertexName=AFD3148F76424164897322683CC245A9, vertexId=vertex_1452796315504_0001_1_00, initRequestedTime=1452796315709, initedTime=1452796315729, startRequestedTime=1452796315731, startedTime=1452796315731, finishTime=1452796315845, timeTaken=114, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402128896, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796315830, Process_Duration=8, Process_End_Time=1452796315838, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796315758, firstTasksToStart=[ task_1452796315504_0001_1_00_000000 ], lastTaskFinishTime=1452796315841, lastTasksToFinish=[ task_1452796315504_0001_1_00_000000 ], minTaskDuration=83, maxTaskDuration=83, avgTaskDuration=83.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796315504_0001_1_00_000000 ], longestDurationTasks=[ task_1452796315504_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:31:55,850 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:31:55,851 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402128896, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796315830, Process_Duration=8, Process_End_Time=1452796315838, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:31:55,851 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796315504_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:31:55,853 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:31:55,854 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:55,854 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796315504_0001_00_000001, stoppedTime=1452796315853, exitStatus=0
2016-01-14 18:31:55,854 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:55,854 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796315504_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:31:55,855 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:31:55,855 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796315504_0001_1
2016-01-14 18:31:55,855 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796315504_0001_00_000001
2016-01-14 18:31:55,856 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796315504_0001_1
2016-01-14 18:31:55,857 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 662C62649171499586AB5A738CB5590E for vertex: vertex_1452796315504_0001_1_00 [AFD3148F76424164897322683CC245A9]
2016-01-14 18:31:55,859 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796315504_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:31:55,859 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796315504_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:31:55,860 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796315504_0001_00_000001, Exiting
2016-01-14 18:31:55,860 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796315504_0001_00_000001
2016-01-14 18:31:55,860 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796315504_0001_00_000001
2016-01-14 18:31:55,863 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796315504_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:31:55,864 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796315504_0001_00_000001 completed successfully
2016-01-14 18:31:55,872 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796315504_0001_1, queueSize=0
2016-01-14 18:31:55,872 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:55,873 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796315504_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796315504_0001_1, startTime=1452796315708, finishTime=1452796315870, timeTaken=162, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402128896, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796315830, Process_Duration=8, Process_End_Time=1452796315838, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:55,873 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796315504_0001_1 finished with state: SUCCEEDED
2016-01-14 18:31:55,873 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796315504_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:55,875 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796315504_0001_00_000001
2016-01-14 18:31:55,875 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796315504_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:31:55 Completed Dag: dag_1452796315504_0001_1
2016-01-14 18:31:55,878 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796315504_0001_1, dagState=SUCCEEDED
2016-01-14 18:31:55,879 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796315504_0001_1_post
2016-01-14 18:31:55,880 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:55,880 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:55,886 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452796315504_0001
2016-01-14 18:31:55,889 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:55,889 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:55,889 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:55,890 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:55,890 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:55,891 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:55,891 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:55,892 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:55,892 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:55,892 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:55,893 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:55,894 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:55,895 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:55,900 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/EFC858F886B84CD9AC152F7190612291/F1021DCE34B246C7A54896F8401C5189/.tez/application_1452796315504_0001
2016-01-14 18:31:55,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.427
2016-01-14 18:31:56,015 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_ALL
2016-01-14 18:31:56,054 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:56,054 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:56,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 18:31:56,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 18:31:56,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:56,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:56,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:56,145 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:56,146 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1
2016-01-14 18:31:56,159 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:56,159 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:56,159 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"]
2016-01-14 18:31:56,160 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:56,160 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:56,160 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:56,162 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 18:31:56,162 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:56,179 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:56,185 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:56,185 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:56,185 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:56,197 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807/.tez/application_1452796316185_0001 doesn't exist and is created
2016-01-14 18:31:56,219 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:56,220 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:56,221 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807/.tez/application_1452796316185_0001
2016-01-14 18:31:56,225 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796316185_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:56,245 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:56,247 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:56,250 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:56,250 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:56,251 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807/.tez/application_1452796316185_0001/localmode-log-dir
2016-01-14 18:31:56,251 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807/.tez/application_1452796316185_0001/localmode-log-dir/history.txt.appattempt_1452796316185_0001_000000, maxErrors=10
2016-01-14 18:31:56,253 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:56,253 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796316185_0001_000000, appSubmitTime=1452796316224, launchTime=1452796316225
2016-01-14 18:31:56,259 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:56,263 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:56,264 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:56,266 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:56,269 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:36157
2016-01-14 18:31:56,270 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:56,274 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796316185_0001_000000, startTime=1452796316274
2016-01-14 18:31:56,274 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:56,274 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:56,321 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:56,321 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:56,321 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452796316185_0001, dagName=[970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 18:31:56,347 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 18:31:56,348 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796316185_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807/.tez/application_1452796316185_0001/localmode-log-dir/dag_1452796316185_0001_1.dot
2016-01-14 18:31:56,349 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807/.tez/application_1452796316185_0001/localmode-log-dir/dag_1452796316185_0001_1-tez-dag.pb.txt
2016-01-14 18:31:56,367 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796316185_0001_1
2016-01-14 18:31:56,367 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:56,367 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 18:31:56 Running Dag: dag_1452796316185_0001_1
2016-01-14 18:31:56,378 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:56,379 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796316185_0001_1, submitTime=1452796316347
2016-01-14 18:31:56,379 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BE4281A3EE2A442EB92CDEAB3FFDE61E
2016-01-14 18:31:56,380 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:56,380 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:56,381 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796316185_0001_1, initTime=1452796316379
2016-01-14 18:31:56,382 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796316185_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:56,383 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:DAG_STARTED]: dagID=dag_1452796316185_0001_1, startTime=1452796316382
2016-01-14 18:31:56,383 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:56,383 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796316185_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:56,383 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BE4281A3EE2A442EB92CDEAB3FFDE61E : {A1F64A3010314FB7ABFBDF63EAF2EEBC={InputName=A1F64A3010314FB7ABFBDF63EAF2EEBC}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:56,383 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: A1F64A3010314FB7ABFBDF63EAF2EEBC, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:56,383 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,383 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,383 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,384 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]. Starting root input initializers: 1
2016-01-14 18:31:56,384 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452796316185_0001, dagName=[970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 18:31:56,383 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:56,384 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:56,384 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: A1F64A3010314FB7ABFBDF63EAF2EEBC on vertex vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,386 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:56,386 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input A1F64A3010314FB7ABFBDF63EAF2EEBC asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:56,388 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:56,388 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:56,390 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:56,391 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: A1F64A3010314FB7ABFBDF63EAF2EEBC on vertex vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,391 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:56,392 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {A1F64A3010314FB7ABFBDF63EAF2EEBC=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:56,392 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E] parallelism set to 1
2016-01-14 18:31:56,392 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:56,392 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796316185_0001_1_00, eventCount=1
2016-01-14 18:31:56,393 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,393 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=45295902E0F748E9A44FDC3604F8A046, vertexId=vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:56,393 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=45295902E0F748E9A44FDC3604F8A046, vertexId=vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,396 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=45295902E0F748E9A44FDC3604F8A046, vertexName=BE4281A3EE2A442EB92CDEAB3FFDE61E, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:56,396 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=45295902E0F748E9A44FDC3604F8A046, vertexId=vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,397 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:56,399 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BE4281A3EE2A442EB92CDEAB3FFDE61E, vertexId=vertex_1452796316185_0001_1_00, initRequestedTime=1452796316383, initedTime=1452796316397, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:56,399 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E] with distanceFromRoot: 0
2016-01-14 18:31:56,400 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:56,400 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BE4281A3EE2A442EB92CDEAB3FFDE61E
2016-01-14 18:31:56,400 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,401 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:56,401 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796316185_0001_1_00, startRequestedTime=1452796316400, startedTime=1452796316400
2016-01-14 18:31:56,401 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:56,402 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:56,402 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:TASK_STARTED]: vertexName=BE4281A3EE2A442EB92CDEAB3FFDE61E, taskId=task_1452796316185_0001_1_00_000000, scheduledTime=1452796316402, launchTime=1452796316402
2016-01-14 18:31:56,403 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796316185_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:56,403 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,404 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, VertexName: BE4281A3EE2A442EB92CDEAB3FFDE61E, VertexParallelism: 1, TaskAttemptID:attempt_1452796316185_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A1F64A3010314FB7ABFBDF63EAF2EEBC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=45295902E0F748E9A44FDC3604F8A046, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:56,404 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796316185_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:56,405 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:56,406 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:56,407 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:56,407 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:56,411 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796316185_0001_00_000001
2016-01-14 18:31:56,412 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316185_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:56,412 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796316185_0001, with dag id: dag_1452796316185_0001_1
2016-01-14 18:31:56,415 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796316185_0001_00_000001
2016-01-14 18:31:56,415 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:56,420 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:56,420 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316185_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:56,420 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796316185_0001_00_000001, launchTime=1452796316420
2016-01-14 18:31:56,421 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796316185_0001_00_000001
2016-01-14 18:31:56,423 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796316185_0001_1_00_000000_0] to container: [container_1452796316185_0001_00_000001]
2016-01-14 18:31:56,423 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316185_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:56,423 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796316185_0001_00_000001 given task: attempt_1452796316185_0001_1_00_000000_0
2016-01-14 18:31:56,423 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796316185_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796316185_0001_1_00_000000_0
2016-01-14 18:31:56,425 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796316185_0001_1_00_000000_0] started. Is using containerId: [container_1452796316185_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:56 Starting to run new task attempt: attempt_1452796316185_0001_1_00_000000_0
2016-01-14 18:31:56,425 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796316185_0001_1_00_000000_0
2016-01-14 18:31:56,425 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:56,425 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:56,425 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:56,425 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:56,426 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BE4281A3EE2A442EB92CDEAB3FFDE61E, taskAttemptId=attempt_1452796316185_0001_1_00_000000_0, startTime=1452796316423, containerId=container_1452796316185_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796316185_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:56,426 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796316185_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:56,426 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796316185_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:56,426 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:56,426 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:56,427 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:56,427 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, VertexName: BE4281A3EE2A442EB92CDEAB3FFDE61E, VertexParallelism: 1, TaskAttemptID:attempt_1452796316185_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A1F64A3010314FB7ABFBDF63EAF2EEBC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=45295902E0F748E9A44FDC3604F8A046, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:56,427 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:56,429 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796316185_0001_1_00_000000_0
2016-01-14 18:31:56,430 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:56,430 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:56,431 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=A1F64A3010314FB7ABFBDF63EAF2EEBC, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:56,432 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:56,432 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:56,433 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796316185_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:56,434 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=45295902E0F748E9A44FDC3604F8A046, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:56,435 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:56,436 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: A1F64A3010314FB7ABFBDF63EAF2EEBC
2016-01-14 18:31:56,436 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:56,438 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 45295902E0F748E9A44FDC3604F8A046
2016-01-14 18:31:56,438 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:56,438 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 45295902E0F748E9A44FDC3604F8A046
2016-01-14 18:31:56,440 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: A1F64A3010314FB7ABFBDF63EAF2EEBC
2016-01-14 18:31:56,450 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BE4281A3EE2A442EB92CDEAB3FFDE61E, ordinal: 0
2016-01-14 18:31:56,450 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BE4281A3EE2A442EB92CDEAB3FFDE61E, mem on start (mb), free: 197, total: 383, max: 672
2016-01-14 18:31:56,451 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:56,451 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:56,451 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:56,451 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: A1F64A3010314FB7ABFBDF63EAF2EEBC
2016-01-14 18:31:56,452 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: A1F64A3010314FB7ABFBDF63EAF2EEBC
2016-01-14 18:31:56,453 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:56,454 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:56,455 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 45295902E0F748E9A44FDC3604F8A046
2016-01-14 18:31:56,455 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:56,456 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:56,456 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:56,457 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:56,457 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:56,458 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:56,458 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:56,459 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:56,459 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 45295902E0F748E9A44FDC3604F8A046, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:56,460 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, A1F64A3010314FB7ABFBDF63EAF2EEBC, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:56,460 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:56,461 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: A1F64A3010314FB7ABFBDF63EAF2EEBC being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:56,461 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: A1F64A3010314FB7ABFBDF63EAF2EEBC
2016-01-14 18:31:56,461 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:56,461 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: A1F64A3010314FB7ABFBDF63EAF2EEBC
2016-01-14 18:31:56,462 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:56,463 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:56,463 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:56,464 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796316185_0001_1_00_000000_0
2016-01-14 18:31:56,467 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:56,468 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:56,469 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: A1F64A3010314FB7ABFBDF63EAF2EEBC
2016-01-14 18:31:56,469 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"], id: 45295902E0F748E9A44FDC3604F8A046
2016-01-14 18:31:56,471 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"]
2016-01-14 18:31:56,471 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:56,472 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:56,469 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7c888145
2016-01-14 18:31:56,473 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7c888145
2016-01-14 18:31:56,473 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:56,474 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:56,474 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BE4281A3EE2A442EB92CDEAB3FFDE61E, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:31:56,478 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:56,478 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:56,479 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796316185_0001_1_00_000000_0
2016-01-14 18:31:56,479 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796316185_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:56,480 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796316185_0001_1_00_000000_0
2016-01-14 18:31:56,481 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BE4281A3EE2A442EB92CDEAB3FFDE61E, mem on close (mb), free: 195, total: 383, max: 672
2016-01-14 18:31:56 Completed running task attempt: attempt_1452796316185_0001_1_00_000000_0
2016-01-14 18:31:56,483 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796316185_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:31:56,485 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:56,485 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BE4281A3EE2A442EB92CDEAB3FFDE61E, taskAttemptId=attempt_1452796316185_0001_1_00_000000_0, startTime=1452796316423, finishTime=1452796316484, timeTaken=61, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402128896, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796316474, Process_Duration=6, Process_End_Time=1452796316480, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:56,485 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796316185_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:31:56,485 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796316185_0001_1_00_000000_0
2016-01-14 18:31:56,486 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:56,489 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:56,489 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:TASK_FINISHED]: vertexName=BE4281A3EE2A442EB92CDEAB3FFDE61E, taskId=task_1452796316185_0001_1_00_000000, startTime=1452796316423, finishTime=1452796316485, timeTaken=62, status=SUCCEEDED, successfulAttemptID=attempt_1452796316185_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402128896, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796316474, Process_Duration=6, Process_End_Time=1452796316480, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:56,490 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796316185_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:31:56,490 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E] : 1
2016-01-14 18:31:56,490 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,492 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:56,493 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:VERTEX_FINISHED]: vertexName=BE4281A3EE2A442EB92CDEAB3FFDE61E, vertexId=vertex_1452796316185_0001_1_00, initRequestedTime=1452796316383, initedTime=1452796316397, startRequestedTime=1452796316400, startedTime=1452796316400, finishTime=1452796316490, timeTaken=90, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402128896, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796316474, Process_Duration=6, Process_End_Time=1452796316480, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796316423, firstTasksToStart=[ task_1452796316185_0001_1_00_000000 ], lastTaskFinishTime=1452796316484, lastTasksToFinish=[ task_1452796316185_0001_1_00_000000 ], minTaskDuration=61, maxTaskDuration=61, avgTaskDuration=61.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796316185_0001_1_00_000000 ], longestDurationTasks=[ task_1452796316185_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:31:56,493 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:31:56,494 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402128896, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796316474, Process_Duration=6, Process_End_Time=1452796316480, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:31:56,494 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316185_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:31:56,495 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:56,495 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796316185_0001_00_000001, stoppedTime=1452796316495, exitStatus=0
2016-01-14 18:31:56,496 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316185_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:31:56,496 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:31:56,496 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796316185_0001_1
2016-01-14 18:31:56,497 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796316185_0001_1
2016-01-14 18:31:56,497 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 45295902E0F748E9A44FDC3604F8A046 for vertex: vertex_1452796316185_0001_1_00 [BE4281A3EE2A442EB92CDEAB3FFDE61E]
2016-01-14 18:31:56,497 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:31:56,497 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:56,500 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796316185_0001_00_000001
2016-01-14 18:31:56,501 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796316185_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:31:56,501 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796316185_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:31:56,502 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796316185_0001_00_000001, Exiting
2016-01-14 18:31:56,502 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796316185_0001_00_000001
2016-01-14 18:31:56,502 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796316185_0001_00_000001
2016-01-14 18:31:56,506 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796316185_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:31:56,506 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796316185_0001_00_000001 completed successfully
2016-01-14 18:31:56,513 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796316185_0001_1, queueSize=0
2016-01-14 18:31:56,513 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:56,514 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316185_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796316185_0001_1, startTime=1452796316382, finishTime=1452796316511, timeTaken=129, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402128896, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796316474, Process_Duration=6, Process_End_Time=1452796316480, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:56,514 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796316185_0001_1 finished with state: SUCCEEDED
2016-01-14 18:31:56,515 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796316185_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:56,515 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796316185_0001_00_000001
2016-01-14 18:31:56,516 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316185_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:31:56 Completed Dag: dag_1452796316185_0001_1
2016-01-14 18:31:56,517 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796316185_0001_1, dagState=SUCCEEDED
2016-01-14 18:31:56,517 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796316185_0001_1_post
2016-01-14 18:31:56,518 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:56,518 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:56,524 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452796316185_0001
2016-01-14 18:31:56,526 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:56,526 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:56,526 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:56,527 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:56,527 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:56,528 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:56,529 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:56,529 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:56,529 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:56,530 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:56,530 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:56,530 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:56,531 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:56,536 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/970E4A6A1EBF41B0B8B76CED31EFF7F6/E327D4A5E818459B94AF9D163A2BD807/.tez/application_1452796316185_0001
2016-01-14 18:31:56,537 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.378
2016-01-14 18:31:56,629 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_-1
2016-01-14 18:31:56,656 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:56,657 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:56,694 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.006
2016-01-14 18:31:56,698 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.010
2016-01-14 18:31:56,699 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:31:56,699 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:31:56,700 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_'field2'
2016-01-14 18:31:56,726 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:56,727 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:56,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 18:31:56,803 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 18:31:56,803 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:56,804 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:56,804 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:56,820 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:56,821 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'
2016-01-14 18:31:56,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:56,833 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:56,833 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"]
2016-01-14 18:31:56,833 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:56,834 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:56,834 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:56,835 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 18:31:56,835 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:56,850 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:56,855 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:56,855 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:56,855 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:56,864 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB/.tez/application_1452796316855_0001 doesn't exist and is created
2016-01-14 18:31:56,878 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:56,878 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:56,879 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB/.tez/application_1452796316855_0001
2016-01-14 18:31:56,881 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796316855_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:56,894 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:56,895 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:56,896 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:56,897 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:56,897 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB/.tez/application_1452796316855_0001/localmode-log-dir
2016-01-14 18:31:56,897 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB/.tez/application_1452796316855_0001/localmode-log-dir/history.txt.appattempt_1452796316855_0001_000000, maxErrors=10
2016-01-14 18:31:56,897 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:56,898 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796316855_0001_000000, appSubmitTime=1452796316881, launchTime=1452796316881
2016-01-14 18:31:56,902 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:56,903 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:56,904 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:56,905 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:56,908 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:60572
2016-01-14 18:31:56,911 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:56,913 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796316855_0001_000000, startTime=1452796316913
2016-01-14 18:31:56,913 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:56,913 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:56,979 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:56,979 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:56,979 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452796316855_0001, dagName=[D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 18:31:56,998 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 18:31:57,000 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796316855_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB/.tez/application_1452796316855_0001/localmode-log-dir/dag_1452796316855_0001_1.dot
2016-01-14 18:31:57,001 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB/.tez/application_1452796316855_0001/localmode-log-dir/dag_1452796316855_0001_1-tez-dag.pb.txt
2016-01-14 18:31:57,010 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796316855_0001_1
2016-01-14 18:31:57,011 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:57,011 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 18:31:57 Running Dag: dag_1452796316855_0001_1
2016-01-14 18:31:57,022 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:57,022 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796316855_0001_1, submitTime=1452796316998
2016-01-14 18:31:57,022 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D1894DB1B18E480BB91E4EDBA0F43FD9
2016-01-14 18:31:57,023 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:57,023 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796316855_0001_1, initTime=1452796317022
2016-01-14 18:31:57,023 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796316855_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:57,025 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:57,025 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:DAG_STARTED]: dagID=dag_1452796316855_0001_1, startTime=1452796317025
2016-01-14 18:31:57,026 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:57,026 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796316855_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:57,026 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D1894DB1B18E480BB91E4EDBA0F43FD9 : {8D465EEB1C5B44A7AFAF274E5DC539CE={InputName=8D465EEB1C5B44A7AFAF274E5DC539CE}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:57,026 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8D465EEB1C5B44A7AFAF274E5DC539CE, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:57,026 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,026 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:57,026 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,027 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,027 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452796316855_0001, dagName=[D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 18:31:57,027 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]. Starting root input initializers: 1
2016-01-14 18:31:57,028 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:57,030 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8D465EEB1C5B44A7AFAF274E5DC539CE on vertex vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,035 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:57,035 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8D465EEB1C5B44A7AFAF274E5DC539CE asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:57,037 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:57,037 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:57,039 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:57,040 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8D465EEB1C5B44A7AFAF274E5DC539CE on vertex vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,040 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:57,040 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8D465EEB1C5B44A7AFAF274E5DC539CE=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:57,040 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9] parallelism set to 1
2016-01-14 18:31:57,040 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:57,041 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796316855_0001_1_00, eventCount=1
2016-01-14 18:31:57,041 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,041 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=1ED2CBE5BBC24C38B80D5E451AC7865F, vertexId=vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:57,041 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=1ED2CBE5BBC24C38B80D5E451AC7865F, vertexId=vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,043 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=1ED2CBE5BBC24C38B80D5E451AC7865F, vertexName=D1894DB1B18E480BB91E4EDBA0F43FD9, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:57,043 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=1ED2CBE5BBC24C38B80D5E451AC7865F, vertexId=vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,044 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:57,044 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D1894DB1B18E480BB91E4EDBA0F43FD9, vertexId=vertex_1452796316855_0001_1_00, initRequestedTime=1452796317026, initedTime=1452796317044, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:57,045 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9] with distanceFromRoot: 0
2016-01-14 18:31:57,045 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:57,045 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D1894DB1B18E480BB91E4EDBA0F43FD9
2016-01-14 18:31:57,045 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,046 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:57,046 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796316855_0001_1_00, startRequestedTime=1452796317045, startedTime=1452796317045
2016-01-14 18:31:57,046 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:57,047 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:57,047 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:TASK_STARTED]: vertexName=D1894DB1B18E480BB91E4EDBA0F43FD9, taskId=task_1452796316855_0001_1_00_000000, scheduledTime=1452796317047, launchTime=1452796317047
2016-01-14 18:31:57,047 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796316855_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:57,047 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,048 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field', VertexName: D1894DB1B18E480BB91E4EDBA0F43FD9, VertexParallelism: 1, TaskAttemptID:attempt_1452796316855_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8D465EEB1C5B44A7AFAF274E5DC539CE, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1ED2CBE5BBC24C38B80D5E451AC7865F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:57,048 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796316855_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:57,048 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:57,049 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:57,050 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:57,050 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:57,051 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796316855_0001_00_000001
2016-01-14 18:31:57,051 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316855_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:57,052 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796316855_0001_00_000001
2016-01-14 18:31:57,052 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:57,053 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316855_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:57,053 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:57,053 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796316855_0001_00_000001, launchTime=1452796317053
2016-01-14 18:31:57,054 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796316855_0001_00_000001
2016-01-14 18:31:57,055 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796316855_0001, with dag id: dag_1452796316855_0001_1
2016-01-14 18:31:57,055 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796316855_0001_1_00_000000_0] to container: [container_1452796316855_0001_00_000001]
2016-01-14 18:31:57,055 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316855_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:57,056 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796316855_0001_00_000001 given task: attempt_1452796316855_0001_1_00_000000_0
2016-01-14 18:31:57,056 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796316855_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796316855_0001_1_00_000000_0
2016-01-14 18:31:57,056 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796316855_0001_1_00_000000_0] started. Is using containerId: [container_1452796316855_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:57,057 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:57 Starting to run new task attempt: attempt_1452796316855_0001_1_00_000000_0
2016-01-14 18:31:57,057 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796316855_0001_1_00_000000_0
2016-01-14 18:31:57,057 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:57,057 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D1894DB1B18E480BB91E4EDBA0F43FD9, taskAttemptId=attempt_1452796316855_0001_1_00_000000_0, startTime=1452796317056, containerId=container_1452796316855_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796316855_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:57,057 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796316855_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:57,057 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:57,058 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796316855_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:57,058 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:57,058 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:57,058 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:57,059 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:57,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field', VertexName: D1894DB1B18E480BB91E4EDBA0F43FD9, VertexParallelism: 1, TaskAttemptID:attempt_1452796316855_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8D465EEB1C5B44A7AFAF274E5DC539CE, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1ED2CBE5BBC24C38B80D5E451AC7865F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:57,059 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:57,061 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796316855_0001_1_00_000000_0
2016-01-14 18:31:57,061 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:57,061 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:57,062 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:57,062 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=8D465EEB1C5B44A7AFAF274E5DC539CE, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:57,065 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=1ED2CBE5BBC24C38B80D5E451AC7865F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:57,069 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:57,068 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:57,069 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 8D465EEB1C5B44A7AFAF274E5DC539CE
2016-01-14 18:31:57,069 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 8D465EEB1C5B44A7AFAF274E5DC539CE
2016-01-14 18:31:57,070 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:57,068 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796316855_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:57,071 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 1ED2CBE5BBC24C38B80D5E451AC7865F
2016-01-14 18:31:57,071 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:57,072 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 1ED2CBE5BBC24C38B80D5E451AC7865F
2016-01-14 18:31:57,072 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:57,073 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 8D465EEB1C5B44A7AFAF274E5DC539CE
2016-01-14 18:31:57,073 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 8D465EEB1C5B44A7AFAF274E5DC539CE
2016-01-14 18:31:57,083 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:57,083 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 1ED2CBE5BBC24C38B80D5E451AC7865F
2016-01-14 18:31:57,087 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D1894DB1B18E480BB91E4EDBA0F43FD9, ordinal: 0
2016-01-14 18:31:57,088 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D1894DB1B18E480BB91E4EDBA0F43FD9, mem on start (mb), free: 297, total: 386, max: 672
2016-01-14 18:31:57,088 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:57,088 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:57,088 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:57,088 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:57,088 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:57,088 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:57,089 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:57,089 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:57,089 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:57,089 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:57,089 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:57,089 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 8D465EEB1C5B44A7AFAF274E5DC539CE, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:57,089 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 1ED2CBE5BBC24C38B80D5E451AC7865F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:57,089 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:57,089 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 8D465EEB1C5B44A7AFAF274E5DC539CE being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:57,089 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 8D465EEB1C5B44A7AFAF274E5DC539CE
2016-01-14 18:31:57,090 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:57,089 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:57,090 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:57,090 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 8D465EEB1C5B44A7AFAF274E5DC539CE
2016-01-14 18:31:57,091 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:57,091 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796316855_0001_1_00_000000_0
2016-01-14 18:31:57,091 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:57,092 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4de4f698
2016-01-14 18:31:57,094 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4de4f698
2016-01-14 18:31:57,094 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:57,094 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:57,096 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:57,096 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 8D465EEB1C5B44A7AFAF274E5DC539CE
2016-01-14 18:31:57,096 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"], id: 1ED2CBE5BBC24C38B80D5E451AC7865F
2016-01-14 18:31:57,096 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"]
2016-01-14 18:31:57,097 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:57,097 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:57,097 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D1894DB1B18E480BB91E4EDBA0F43FD9, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:31:57,099 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:57,100 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:57,100 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796316855_0001_1_00_000000_0
2016-01-14 18:31:57,100 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796316855_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:57,101 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796316855_0001_1_00_000000_0
2016-01-14 18:31:57,101 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D1894DB1B18E480BB91E4EDBA0F43FD9, mem on close (mb), free: 295, total: 386, max: 672
2016-01-14 18:31:57 Completed running task attempt: attempt_1452796316855_0001_1_00_000000_0
2016-01-14 18:31:57,102 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796316855_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:31:57,103 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796317097, Process_Duration=4, Process_End_Time=1452796317101, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:31:57,104 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D1894DB1B18E480BB91E4EDBA0F43FD9, taskAttemptId=attempt_1452796316855_0001_1_00_000000_0, startTime=1452796317056, finishTime=1452796317103, timeTaken=47, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796317097, Process_Duration=4, Process_End_Time=1452796317101, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:57,104 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796316855_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:31:57,104 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:31:57,104 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:57,104 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:57,104 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796316855_0001_1_00_000000_0
2016-01-14 18:31:57,106 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:57,106 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796316855_0001_00_000001
2016-01-14 18:31:57,107 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:TASK_FINISHED]: vertexName=D1894DB1B18E480BB91E4EDBA0F43FD9, taskId=task_1452796316855_0001_1_00_000000, startTime=1452796317056, finishTime=1452796317106, timeTaken=50, status=SUCCEEDED, successfulAttemptID=attempt_1452796316855_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796317097, Process_Duration=4, Process_End_Time=1452796317101, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:57,107 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796316855_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:31:57,107 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9] : 1
2016-01-14 18:31:57,107 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,108 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:57,109 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:57,110 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:VERTEX_FINISHED]: vertexName=D1894DB1B18E480BB91E4EDBA0F43FD9, vertexId=vertex_1452796316855_0001_1_00, initRequestedTime=1452796317026, initedTime=1452796317044, startRequestedTime=1452796317045, startedTime=1452796317045, finishTime=1452796317108, timeTaken=63, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796317097, Process_Duration=4, Process_End_Time=1452796317101, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796317056, firstTasksToStart=[ task_1452796316855_0001_1_00_000000 ], lastTaskFinishTime=1452796317103, lastTasksToFinish=[ task_1452796316855_0001_1_00_000000 ], minTaskDuration=47, maxTaskDuration=47, avgTaskDuration=47.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796316855_0001_1_00_000000 ], longestDurationTasks=[ task_1452796316855_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:31:57,110 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:31:57,111 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316855_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:31:57,111 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796316855_0001_00_000001, stoppedTime=1452796317111, exitStatus=0
2016-01-14 18:31:57,111 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:57,111 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316855_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:31:57,111 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:31:57,111 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796316855_0001_1
2016-01-14 18:31:57,112 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796316855_0001_1
2016-01-14 18:31:57,112 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 1ED2CBE5BBC24C38B80D5E451AC7865F for vertex: vertex_1452796316855_0001_1_00 [D1894DB1B18E480BB91E4EDBA0F43FD9]
2016-01-14 18:31:57,117 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796316855_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:31:57,117 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796316855_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:31:57,117 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796316855_0001_00_000001, Exiting
2016-01-14 18:31:57,118 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796316855_0001_00_000001
2016-01-14 18:31:57,118 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796316855_0001_00_000001
2016-01-14 18:31:57,119 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796316855_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:31:57,120 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796316855_0001_00_000001 completed successfully
2016-01-14 18:31:57,120 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796316855_0001_1, queueSize=0
2016-01-14 18:31:57,120 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:57,121 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796316855_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796316855_0001_1, startTime=1452796317025, finishTime=1452796317118, timeTaken=93, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796317097, Process_Duration=4, Process_End_Time=1452796317101, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:57,121 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796316855_0001_1 finished with state: SUCCEEDED
2016-01-14 18:31:57,122 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796316855_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:57,122 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796316855_0001_00_000001
2016-01-14 18:31:57,122 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796316855_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:31:57 Completed Dag: dag_1452796316855_0001_1
2016-01-14 18:31:57,123 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796316855_0001_1, dagState=SUCCEEDED
2016-01-14 18:31:57,123 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796316855_0001_1_post
2016-01-14 18:31:57,123 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:57,123 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:57,130 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452796316855_0001
2016-01-14 18:31:57,132 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:57,133 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:57,133 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:57,133 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:57,133 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:57,134 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:57,135 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:57,135 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:57,135 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:57,136 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:57,137 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:57,137 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:57,137 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:57,143 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/D14EE956E77A423A89E7A4C920C8DDA8/DDAAF97D35FC4010BA91C5A85683B4BB/.tez/application_1452796316855_0001
2016-01-14 18:31:57,144 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.312
2016-01-14 18:31:57,230 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_'field'
2016-01-14 18:31:57,264 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:57,264 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:57,309 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 18:31:57,317 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-14 18:31:57,318 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:57,318 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:57,319 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:57,335 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:57,336 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS
2016-01-14 18:31:57,348 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:57,348 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:57,348 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"]
2016-01-14 18:31:57,348 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:57,349 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:57,349 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:57,349 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 18:31:57,350 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:57,366 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:57,370 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:57,370 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:57,371 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:57,380 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5/.tez/application_1452796317370_0001 doesn't exist and is created
2016-01-14 18:31:57,394 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:57,394 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:57,395 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5/.tez/application_1452796317370_0001
2016-01-14 18:31:57,398 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796317370_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:57,410 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:57,411 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:57,413 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:57,413 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:57,414 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5/.tez/application_1452796317370_0001/localmode-log-dir
2016-01-14 18:31:57,414 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5/.tez/application_1452796317370_0001/localmode-log-dir/history.txt.appattempt_1452796317370_0001_000000, maxErrors=10
2016-01-14 18:31:57,414 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:57,415 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796317370_0001_000000, appSubmitTime=1452796317397, launchTime=1452796317397
2016-01-14 18:31:57,420 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:57,422 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:57,423 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:57,424 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:57,425 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:54115
2016-01-14 18:31:57,428 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:57,431 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796317370_0001_000000, startTime=1452796317430
2016-01-14 18:31:57,431 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:57,431 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:57,495 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:57,495 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:57,495 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452796317370_0001, dagName=[8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 18:31:57,514 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 18:31:57,515 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796317370_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5/.tez/application_1452796317370_0001/localmode-log-dir/dag_1452796317370_0001_1.dot
2016-01-14 18:31:57,516 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5/.tez/application_1452796317370_0001/localmode-log-dir/dag_1452796317370_0001_1-tez-dag.pb.txt
2016-01-14 18:31:57,527 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796317370_0001_1
2016-01-14 18:31:57,528 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:57,528 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 18:31:57 Running Dag: dag_1452796317370_0001_1
2016-01-14 18:31:57,537 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796317370_0001_1, submitTime=1452796317514
2016-01-14 18:31:57,537 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:57,537 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C201FB18E34540BAB4002B185651C286
2016-01-14 18:31:57,538 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:57,539 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796317370_0001_1, initTime=1452796317537
2016-01-14 18:31:57,539 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:57,539 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796317370_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:57,540 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:57,541 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:DAG_STARTED]: dagID=dag_1452796317370_0001_1, startTime=1452796317540
2016-01-14 18:31:57,541 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:57,541 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796317370_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:57,541 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C201FB18E34540BAB4002B185651C286 : {AEC135E8108B40F782068E60FE07A520={InputName=AEC135E8108B40F782068E60FE07A520}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:57,541 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452796317370_0001, dagName=[8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 18:31:57,541 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: AEC135E8108B40F782068E60FE07A520, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:57,542 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,542 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,542 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,542 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]. Starting root input initializers: 1
2016-01-14 18:31:57,543 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:57,543 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: AEC135E8108B40F782068E60FE07A520 on vertex vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,545 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:57,546 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input AEC135E8108B40F782068E60FE07A520 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:57,547 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:57,547 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:57,549 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:57,550 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: AEC135E8108B40F782068E60FE07A520 on vertex vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,551 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:57,551 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {AEC135E8108B40F782068E60FE07A520=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:57,551 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286] parallelism set to 1
2016-01-14 18:31:57,551 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:57,551 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796317370_0001_1_00, eventCount=1
2016-01-14 18:31:57,552 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,552 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=AE156D1DED1D447EAA242A660CD5D0E1, vertexId=vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:57,552 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=AE156D1DED1D447EAA242A660CD5D0E1, vertexId=vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,554 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=AE156D1DED1D447EAA242A660CD5D0E1, vertexName=C201FB18E34540BAB4002B185651C286, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:57,554 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=AE156D1DED1D447EAA242A660CD5D0E1, vertexId=vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,555 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:57,555 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C201FB18E34540BAB4002B185651C286, vertexId=vertex_1452796317370_0001_1_00, initRequestedTime=1452796317541, initedTime=1452796317555, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:57,556 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286] with distanceFromRoot: 0
2016-01-14 18:31:57,556 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:57,556 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C201FB18E34540BAB4002B185651C286
2016-01-14 18:31:57,557 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,557 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:57,557 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796317370_0001_1_00, startRequestedTime=1452796317556, startedTime=1452796317556
2016-01-14 18:31:57,558 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:57,558 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:57,558 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:TASK_STARTED]: vertexName=C201FB18E34540BAB4002B185651C286, taskId=task_1452796317370_0001_1_00_000000, scheduledTime=1452796317558, launchTime=1452796317558
2016-01-14 18:31:57,559 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796317370_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:57,559 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,559 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, VertexName: C201FB18E34540BAB4002B185651C286, VertexParallelism: 1, TaskAttemptID:attempt_1452796317370_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=AEC135E8108B40F782068E60FE07A520, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=AE156D1DED1D447EAA242A660CD5D0E1, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:57,560 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796317370_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:57,560 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:57,561 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:57,561 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:57,561 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:57,563 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796317370_0001_00_000001
2016-01-14 18:31:57,563 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317370_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:57,563 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796317370_0001, with dag id: dag_1452796317370_0001_1
2016-01-14 18:31:57,566 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796317370_0001_00_000001
2016-01-14 18:31:57,566 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:57,567 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317370_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:57,567 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:57,568 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796317370_0001_00_000001, launchTime=1452796317567
2016-01-14 18:31:57,568 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796317370_0001_00_000001
2016-01-14 18:31:57,569 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796317370_0001_1_00_000000_0] to container: [container_1452796317370_0001_00_000001]
2016-01-14 18:31:57,570 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317370_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:57,570 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796317370_0001_00_000001 given task: attempt_1452796317370_0001_1_00_000000_0
2016-01-14 18:31:57,571 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796317370_0001_1_00_000000_0] started. Is using containerId: [container_1452796317370_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:57,572 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:57,572 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C201FB18E34540BAB4002B185651C286, taskAttemptId=attempt_1452796317370_0001_1_00_000000_0, startTime=1452796317570, containerId=container_1452796317370_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796317370_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:57,573 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796317370_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:57,573 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796317370_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:57,573 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796317370_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796317370_0001_1_00_000000_0
2016-01-14 18:31:57 Starting to run new task attempt: attempt_1452796317370_0001_1_00_000000_0
2016-01-14 18:31:57,574 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796317370_0001_1_00_000000_0
2016-01-14 18:31:57,574 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:57,574 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:57,574 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:57,574 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:57,574 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:57,575 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:57,575 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, VertexName: C201FB18E34540BAB4002B185651C286, VertexParallelism: 1, TaskAttemptID:attempt_1452796317370_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=AEC135E8108B40F782068E60FE07A520, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=AE156D1DED1D447EAA242A660CD5D0E1, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:57,575 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:57,576 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796317370_0001_1_00_000000_0
2016-01-14 18:31:57,576 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:57,576 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:57,578 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=AEC135E8108B40F782068E60FE07A520, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:57,581 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=AE156D1DED1D447EAA242A660CD5D0E1, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:57,578 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:57,583 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:57,584 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: AE156D1DED1D447EAA242A660CD5D0E1
2016-01-14 18:31:57,585 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:57,585 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: AE156D1DED1D447EAA242A660CD5D0E1
2016-01-14 18:31:57,582 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796317370_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:57,586 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:57,592 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:57,592 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: AEC135E8108B40F782068E60FE07A520
2016-01-14 18:31:57,592 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: AEC135E8108B40F782068E60FE07A520
2016-01-14 18:31:57,599 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:57,599 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: AEC135E8108B40F782068E60FE07A520
2016-01-14 18:31:57,599 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: AEC135E8108B40F782068E60FE07A520
2016-01-14 18:31:57,602 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:57,603 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: AE156D1DED1D447EAA242A660CD5D0E1
2016-01-14 18:31:57,605 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C201FB18E34540BAB4002B185651C286, ordinal: 0
2016-01-14 18:31:57,605 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C201FB18E34540BAB4002B185651C286, mem on start (mb), free: 201, total: 386, max: 672
2016-01-14 18:31:57,606 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:57,606 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:57,607 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:57,607 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:57,607 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:57,608 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:57,608 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:57,609 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:57,609 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:57,610 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:57,610 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:57,611 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, AE156D1DED1D447EAA242A660CD5D0E1, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:57,611 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, AEC135E8108B40F782068E60FE07A520, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:57,612 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:57,612 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: AEC135E8108B40F782068E60FE07A520 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:57,612 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: AEC135E8108B40F782068E60FE07A520
2016-01-14 18:31:57,613 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:57,613 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: AEC135E8108B40F782068E60FE07A520
2016-01-14 18:31:57,614 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:57,614 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:57,614 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:57,615 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796317370_0001_1_00_000000_0
2016-01-14 18:31:57,615 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:57,617 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@6a3b300c
2016-01-14 18:31:57,618 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@6a3b300c
2016-01-14 18:31:57,618 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:57,619 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:57,622 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:57,622 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: AEC135E8108B40F782068E60FE07A520
2016-01-14 18:31:57,623 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"], id: AE156D1DED1D447EAA242A660CD5D0E1
2016-01-14 18:31:57,623 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"]
2016-01-14 18:31:57,623 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:57,623 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:57,624 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C201FB18E34540BAB4002B185651C286, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:31:57,627 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:57,627 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:57,628 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796317370_0001_1_00_000000_0
2016-01-14 18:31:57,628 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796317370_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:57,629 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796317370_0001_1_00_000000_0
2016-01-14 18:31:57,629 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C201FB18E34540BAB4002B185651C286, mem on close (mb), free: 199, total: 386, max: 672
2016-01-14 18:31:57 Completed running task attempt: attempt_1452796317370_0001_1_00_000000_0
2016-01-14 18:31:57,630 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796317370_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:31:57,631 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796317624, Process_Duration=5, Process_End_Time=1452796317629, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:31:57,631 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C201FB18E34540BAB4002B185651C286, taskAttemptId=attempt_1452796317370_0001_1_00_000000_0, startTime=1452796317570, finishTime=1452796317631, timeTaken=61, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796317624, Process_Duration=5, Process_End_Time=1452796317629, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:57,631 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:57,631 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796317370_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:31:57,632 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:57,632 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796317370_0001_1_00_000000_0
2016-01-14 18:31:57,632 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:31:57,633 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:57,634 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:57,634 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:TASK_FINISHED]: vertexName=C201FB18E34540BAB4002B185651C286, taskId=task_1452796317370_0001_1_00_000000, startTime=1452796317570, finishTime=1452796317632, timeTaken=62, status=SUCCEEDED, successfulAttemptID=attempt_1452796317370_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796317624, Process_Duration=5, Process_End_Time=1452796317629, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:57,635 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796317370_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:31:57,635 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286] : 1
2016-01-14 18:31:57,635 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796317370_0001_00_000001
2016-01-14 18:31:57,635 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,637 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:57,637 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:VERTEX_FINISHED]: vertexName=C201FB18E34540BAB4002B185651C286, vertexId=vertex_1452796317370_0001_1_00, initRequestedTime=1452796317541, initedTime=1452796317555, startRequestedTime=1452796317556, startedTime=1452796317556, finishTime=1452796317635, timeTaken=79, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796317624, Process_Duration=5, Process_End_Time=1452796317629, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796317570, firstTasksToStart=[ task_1452796317370_0001_1_00_000000 ], lastTaskFinishTime=1452796317631, lastTasksToFinish=[ task_1452796317370_0001_1_00_000000 ], minTaskDuration=61, maxTaskDuration=61, avgTaskDuration=61.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796317370_0001_1_00_000000 ], longestDurationTasks=[ task_1452796317370_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:31:57,637 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:31:57,637 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317370_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:31:57,638 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796317370_0001_00_000001, stoppedTime=1452796317638, exitStatus=0
2016-01-14 18:31:57,638 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:57,638 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317370_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:31:57,638 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:31:57,638 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796317370_0001_1
2016-01-14 18:31:57,639 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796317370_0001_1
2016-01-14 18:31:57,639 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: AE156D1DED1D447EAA242A660CD5D0E1 for vertex: vertex_1452796317370_0001_1_00 [C201FB18E34540BAB4002B185651C286]
2016-01-14 18:31:57,646 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796317370_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:31:57,646 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796317370_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:31:57,646 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796317370_0001_00_000001, Exiting
2016-01-14 18:31:57,646 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796317370_0001_00_000001
2016-01-14 18:31:57,646 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796317370_0001_00_000001
2016-01-14 18:31:57,648 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796317370_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:31:57,648 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796317370_0001_00_000001 completed successfully
2016-01-14 18:31:57,649 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796317370_0001_1, queueSize=0
2016-01-14 18:31:57,649 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:57,649 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317370_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796317370_0001_1, startTime=1452796317540, finishTime=1452796317646, timeTaken=106, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796317624, Process_Duration=5, Process_End_Time=1452796317629, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:57,649 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796317370_0001_1 finished with state: SUCCEEDED
2016-01-14 18:31:57,649 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796317370_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:57,650 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317370_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:31:57,650 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796317370_0001_00_000001
2016-01-14 18:31:57 Completed Dag: dag_1452796317370_0001_1
2016-01-14 18:31:57,653 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796317370_0001_1, dagState=SUCCEEDED
2016-01-14 18:31:57,654 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796317370_0001_1_post
2016-01-14 18:31:57,655 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:57,655 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:57,657 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452796317370_0001
2016-01-14 18:31:57,659 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:57,659 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:57,659 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:57,659 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:57,659 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:57,660 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:57,660 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:57,660 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:57,661 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:57,662 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:57,662 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:57,662 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:57,662 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:57,668 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/8CAB4B156E0D4EED9342D3FB70CDBAED/BA0372177EFE40C991B458759CFE14E5/.tez/application_1452796317370_0001
2016-01-14 18:31:57,668 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.320
2016-01-14 18:31:57,750 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_RESULTS
2016-01-14 18:31:57,776 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:57,776 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:57,824 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 18:31:57,840 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-01-14 18:31:57,841 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:57,841 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:57,842 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:57,869 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:57,870 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 18:31:57,886 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:57,886 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:57,886 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"]
2016-01-14 18:31:57,887 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:57,888 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:57,888 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:57,889 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 18:31:57,889 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:57,922 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:57,926 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:57,927 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:57,927 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:57,936 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2/.tez/application_1452796317927_0001 doesn't exist and is created
2016-01-14 18:31:57,950 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:57,950 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:57,951 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2/.tez/application_1452796317927_0001
2016-01-14 18:31:57,954 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796317927_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:57,973 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:57,974 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:57,976 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:57,976 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:57,977 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2/.tez/application_1452796317927_0001/localmode-log-dir
2016-01-14 18:31:57,977 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2/.tez/application_1452796317927_0001/localmode-log-dir/history.txt.appattempt_1452796317927_0001_000000, maxErrors=10
2016-01-14 18:31:57,977 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:57,977 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796317927_0001_000000, appSubmitTime=1452796317954, launchTime=1452796317954
2016-01-14 18:31:57,982 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:54645
2016-01-14 18:31:57,985 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:57,986 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:57,987 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:57,987 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:57,988 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:57,993 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796317927_0001_000000, startTime=1452796317993
2016-01-14 18:31:57,993 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:57,993 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:58,051 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:58,051 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:58,051 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452796317927_0001, dagName=[1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 18:31:58,070 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 18:31:58,071 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796317927_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2/.tez/application_1452796317927_0001/localmode-log-dir/dag_1452796317927_0001_1.dot
2016-01-14 18:31:58,072 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2/.tez/application_1452796317927_0001/localmode-log-dir/dag_1452796317927_0001_1-tez-dag.pb.txt
2016-01-14 18:31:58,079 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796317927_0001_1
2016-01-14 18:31:58,079 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:58,079 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 18:31:58 Running Dag: dag_1452796317927_0001_1
2016-01-14 18:31:58,091 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:58,091 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796317927_0001_1, submitTime=1452796318070
2016-01-14 18:31:58,091 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex EB5E51F58D55460E8BA9F6D32A9A0F1F
2016-01-14 18:31:58,092 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:58,092 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796317927_0001_1, initTime=1452796318091
2016-01-14 18:31:58,092 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796317927_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:58,092 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:58,093 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:DAG_STARTED]: dagID=dag_1452796317927_0001_1, startTime=1452796318093
2016-01-14 18:31:58,093 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:58,093 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796317927_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:58,094 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: EB5E51F58D55460E8BA9F6D32A9A0F1F : {3C912D60F78E42CB9239EA7047BC7247={InputName=3C912D60F78E42CB9239EA7047BC7247}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:58,094 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 3C912D60F78E42CB9239EA7047BC7247, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:58,094 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,094 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,094 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,093 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:58,094 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]. Starting root input initializers: 1
2016-01-14 18:31:58,095 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:58,095 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 3C912D60F78E42CB9239EA7047BC7247 on vertex vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,097 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452796317927_0001, dagName=[1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 18:31:58,097 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:58,098 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 3C912D60F78E42CB9239EA7047BC7247 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:58,098 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:58,099 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:58,101 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:58,101 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 3C912D60F78E42CB9239EA7047BC7247 on vertex vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,102 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:58,102 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {3C912D60F78E42CB9239EA7047BC7247=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:58,102 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F] parallelism set to 1
2016-01-14 18:31:58,102 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:58,103 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796317927_0001_1_00, eventCount=1
2016-01-14 18:31:58,103 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,103 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=943BB4B67CF547B8BD1D2E0E40939DF2, vertexId=vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:58,103 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=943BB4B67CF547B8BD1D2E0E40939DF2, vertexId=vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,105 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=943BB4B67CF547B8BD1D2E0E40939DF2, vertexName=EB5E51F58D55460E8BA9F6D32A9A0F1F, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:58,105 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=943BB4B67CF547B8BD1D2E0E40939DF2, vertexId=vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,106 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:58,106 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:VERTEX_INITIALIZED]: vertexName=EB5E51F58D55460E8BA9F6D32A9A0F1F, vertexId=vertex_1452796317927_0001_1_00, initRequestedTime=1452796318093, initedTime=1452796318106, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:58,107 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F] with distanceFromRoot: 0
2016-01-14 18:31:58,107 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:58,107 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in EB5E51F58D55460E8BA9F6D32A9A0F1F
2016-01-14 18:31:58,107 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,107 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796317927_0001_1_00, startRequestedTime=1452796318107, startedTime=1452796318107
2016-01-14 18:31:58,108 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:58,107 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:58,108 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:58,109 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:TASK_STARTED]: vertexName=EB5E51F58D55460E8BA9F6D32A9A0F1F, taskId=task_1452796317927_0001_1_00_000000, scheduledTime=1452796318108, launchTime=1452796318108
2016-01-14 18:31:58,109 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796317927_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:58,109 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,109 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, VertexName: EB5E51F58D55460E8BA9F6D32A9A0F1F, VertexParallelism: 1, TaskAttemptID:attempt_1452796317927_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3C912D60F78E42CB9239EA7047BC7247, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=943BB4B67CF547B8BD1D2E0E40939DF2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:58,109 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796317927_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:58,110 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:58,110 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:58,111 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:58,111 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:58,112 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796317927_0001_00_000001
2016-01-14 18:31:58,112 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317927_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:58,114 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796317927_0001_00_000001
2016-01-14 18:31:58,114 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:58,115 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317927_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:58,115 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:58,116 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796317927_0001_00_000001, launchTime=1452796318115
2016-01-14 18:31:58,116 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796317927_0001_00_000001
2016-01-14 18:31:58,117 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796317927_0001_1_00_000000_0] to container: [container_1452796317927_0001_00_000001]
2016-01-14 18:31:58,118 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317927_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:58,118 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796317927_0001_1_00_000000_0] started. Is using containerId: [container_1452796317927_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:58,119 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=EB5E51F58D55460E8BA9F6D32A9A0F1F, taskAttemptId=attempt_1452796317927_0001_1_00_000000_0, startTime=1452796318118, containerId=container_1452796317927_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796317927_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:58,119 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796317927_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:58,119 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796317927_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:58,119 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:58,120 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:31:58,120 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:31:58,121 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796317927_0001_00_000001 given task: attempt_1452796317927_0001_1_00_000000_0
2016-01-14 18:31:58,121 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796317927_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796317927_0001_1_00_000000_0
2016-01-14 18:31:58 Starting to run new task attempt: attempt_1452796317927_0001_1_00_000000_0
2016-01-14 18:31:58,122 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796317927_0001_1_00_000000_0
2016-01-14 18:31:58,122 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:58,122 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:58,122 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:58,122 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:58,122 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:58,123 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:58,123 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, VertexName: EB5E51F58D55460E8BA9F6D32A9A0F1F, VertexParallelism: 1, TaskAttemptID:attempt_1452796317927_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3C912D60F78E42CB9239EA7047BC7247, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=943BB4B67CF547B8BD1D2E0E40939DF2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:58,123 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:58,124 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796317927_0001_1_00_000000_0
2016-01-14 18:31:58,125 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:58,125 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:58,126 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=3C912D60F78E42CB9239EA7047BC7247, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:58,127 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:58,127 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 3C912D60F78E42CB9239EA7047BC7247
2016-01-14 18:31:58,127 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 3C912D60F78E42CB9239EA7047BC7247
2016-01-14 18:31:58,129 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:58,132 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796317927_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:58,131 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:58,133 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 3C912D60F78E42CB9239EA7047BC7247
2016-01-14 18:31:58,133 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=943BB4B67CF547B8BD1D2E0E40939DF2, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:58,134 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:58,134 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 943BB4B67CF547B8BD1D2E0E40939DF2
2016-01-14 18:31:58,134 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:58,134 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 943BB4B67CF547B8BD1D2E0E40939DF2
2016-01-14 18:31:58,133 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 3C912D60F78E42CB9239EA7047BC7247
2016-01-14 18:31:58,135 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:58,141 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796317927_0001, with dag id: dag_1452796317927_0001_1
2016-01-14 18:31:58,144 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: EB5E51F58D55460E8BA9F6D32A9A0F1F, ordinal: 0
2016-01-14 18:31:58,144 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EB5E51F58D55460E8BA9F6D32A9A0F1F, mem on start (mb), free: 317, total: 387, max: 672
2016-01-14 18:31:58,145 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:58,145 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:58,147 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:58,152 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:58,152 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 943BB4B67CF547B8BD1D2E0E40939DF2
2016-01-14 18:31:58,152 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:58,152 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:58,152 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:58,152 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:58,152 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:58,153 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:58,153 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:58,153 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:58,153 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 3C912D60F78E42CB9239EA7047BC7247, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:58,153 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 943BB4B67CF547B8BD1D2E0E40939DF2, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:58,153 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:58,153 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 3C912D60F78E42CB9239EA7047BC7247 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:58,153 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 3C912D60F78E42CB9239EA7047BC7247
2016-01-14 18:31:58,153 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:58,154 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 3C912D60F78E42CB9239EA7047BC7247
2016-01-14 18:31:58,153 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:58,154 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:58,154 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:58,155 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796317927_0001_1_00_000000_0
2016-01-14 18:31:58,155 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:58,155 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@8d6437a
2016-01-14 18:31:58,157 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@8d6437a
2016-01-14 18:31:58,157 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:58,157 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:58,158 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:58,159 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 3C912D60F78E42CB9239EA7047BC7247
2016-01-14 18:31:58,159 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"], id: 943BB4B67CF547B8BD1D2E0E40939DF2
2016-01-14 18:31:58,159 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"]
2016-01-14 18:31:58,160 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:58,160 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:58,160 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: EB5E51F58D55460E8BA9F6D32A9A0F1F, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:31:58,163 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:58,164 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:58,164 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796317927_0001_1_00_000000_0
2016-01-14 18:31:58,165 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796317927_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:58,165 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796317927_0001_1_00_000000_0
2016-01-14 18:31:58,166 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EB5E51F58D55460E8BA9F6D32A9A0F1F, mem on close (mb), free: 315, total: 387, max: 672
2016-01-14 18:31:58 Completed running task attempt: attempt_1452796317927_0001_1_00_000000_0
2016-01-14 18:31:58,167 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796317927_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:31:58,168 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796318160, Process_Duration=5, Process_End_Time=1452796318165, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:31:58,168 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:31:58,168 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=EB5E51F58D55460E8BA9F6D32A9A0F1F, taskAttemptId=attempt_1452796317927_0001_1_00_000000_0, startTime=1452796318118, finishTime=1452796318168, timeTaken=50, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796318160, Process_Duration=5, Process_End_Time=1452796318165, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:58,169 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:58,169 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796317927_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:31:58,169 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:58,169 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796317927_0001_00_000001
2016-01-14 18:31:58,169 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796317927_0001_1_00_000000_0
2016-01-14 18:31:58,171 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:TASK_FINISHED]: vertexName=EB5E51F58D55460E8BA9F6D32A9A0F1F, taskId=task_1452796317927_0001_1_00_000000, startTime=1452796318118, finishTime=1452796318170, timeTaken=52, status=SUCCEEDED, successfulAttemptID=attempt_1452796317927_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796318160, Process_Duration=5, Process_End_Time=1452796318165, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:58,171 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796317927_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:31:58,171 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F] : 1
2016-01-14 18:31:58,171 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,170 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:58,172 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:58,173 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:VERTEX_FINISHED]: vertexName=EB5E51F58D55460E8BA9F6D32A9A0F1F, vertexId=vertex_1452796317927_0001_1_00, initRequestedTime=1452796318093, initedTime=1452796318106, startRequestedTime=1452796318107, startedTime=1452796318107, finishTime=1452796318171, timeTaken=64, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796318160, Process_Duration=5, Process_End_Time=1452796318165, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796318118, firstTasksToStart=[ task_1452796317927_0001_1_00_000000 ], lastTaskFinishTime=1452796318168, lastTasksToFinish=[ task_1452796317927_0001_1_00_000000 ], minTaskDuration=50, maxTaskDuration=50, avgTaskDuration=50.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796317927_0001_1_00_000000 ], longestDurationTasks=[ task_1452796317927_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:31:58,174 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:31:58,174 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317927_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:31:58,174 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796317927_0001_00_000001, stoppedTime=1452796318174, exitStatus=0
2016-01-14 18:31:58,174 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317927_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:31:58,174 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:31:58,174 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796317927_0001_1
2016-01-14 18:31:58,174 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796317927_0001_1
2016-01-14 18:31:58,175 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 943BB4B67CF547B8BD1D2E0E40939DF2 for vertex: vertex_1452796317927_0001_1_00 [EB5E51F58D55460E8BA9F6D32A9A0F1F]
2016-01-14 18:31:58,175 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:58,176 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:58,180 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796317927_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:31:58,180 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796317927_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:31:58,180 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796317927_0001_00_000001, Exiting
2016-01-14 18:31:58,181 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796317927_0001_00_000001
2016-01-14 18:31:58,181 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796317927_0001_00_000001
2016-01-14 18:31:58,182 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796317927_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:31:58,183 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796317927_0001_00_000001 completed successfully
2016-01-14 18:31:58,185 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796317927_0001_1, queueSize=0
2016-01-14 18:31:58,185 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:58,185 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796317927_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796317927_0001_1, startTime=1452796318093, finishTime=1452796318184, timeTaken=91, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796318160, Process_Duration=5, Process_End_Time=1452796318165, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:31:58,185 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796317927_0001_1 finished with state: SUCCEEDED
2016-01-14 18:31:58,185 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796317927_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:58,186 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796317927_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:31:58,186 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796317927_0001_00_000001
2016-01-14 18:31:58 Completed Dag: dag_1452796317927_0001_1
2016-01-14 18:31:58,186 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796317927_0001_1, dagState=SUCCEEDED
2016-01-14 18:31:58,186 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796317927_0001_1_post
2016-01-14 18:31:58,186 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:58,186 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:58,193 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452796317927_0001
2016-01-14 18:31:58,195 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:58,195 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:58,195 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:58,195 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:58,196 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:58,196 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:58,196 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:58,197 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:58,197 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:58,198 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:58,198 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:58,198 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:58,198 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:58,205 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1D000BCCD726464DB800A516B8A4FA81/DF206034E92E4141B9A0A65F9CC3DEF2/.tez/application_1452796317927_0001
2016-01-14 18:31:58,206 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.319
2016-01-14 18:31:58,283 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 18:31:58,308 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:58,308 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:58,350 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 18:31:58,361 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 18:31:58,361 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:58,362 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:58,362 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:58,378 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:58,379 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1
2016-01-14 18:31:58,390 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:58,390 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:58,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"]
2016-01-14 18:31:58,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:58,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:58,391 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:58,392 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 18:31:58,392 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:58,408 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:58,412 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:58,412 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:58,412 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:58,421 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B/.tez/application_1452796318412_0001 doesn't exist and is created
2016-01-14 18:31:58,435 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:58,435 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:58,436 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B/.tez/application_1452796318412_0001
2016-01-14 18:31:58,438 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796318412_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:58,449 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:58,450 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:58,452 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:58,452 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:58,452 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B/.tez/application_1452796318412_0001/localmode-log-dir
2016-01-14 18:31:58,452 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B/.tez/application_1452796318412_0001/localmode-log-dir/history.txt.appattempt_1452796318412_0001_000000, maxErrors=10
2016-01-14 18:31:58,453 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:58,453 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796318412_0001_000000, appSubmitTime=1452796318437, launchTime=1452796318437
2016-01-14 18:31:58,460 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:58,460 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:58,461 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:58,461 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:58,464 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:44765
2016-01-14 18:31:58,465 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:58,469 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796318412_0001_000000, startTime=1452796318469
2016-01-14 18:31:58,469 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:58,469 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:58,536 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:58,536 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:58,536 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452796318412_0001, dagName=[4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 18:31:58,557 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 18:31:58,558 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796318412_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B/.tez/application_1452796318412_0001/localmode-log-dir/dag_1452796318412_0001_1.dot
2016-01-14 18:31:58,559 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B/.tez/application_1452796318412_0001/localmode-log-dir/dag_1452796318412_0001_1-tez-dag.pb.txt
2016-01-14 18:31:58,565 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796318412_0001_1
2016-01-14 18:31:58,565 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:58,565 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 18:31:58 Running Dag: dag_1452796318412_0001_1
2016-01-14 18:31:58,575 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:58,575 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796318412_0001_1, submitTime=1452796318557
2016-01-14 18:31:58,576 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B9DC8E7296334E31B214378A5B859A43
2016-01-14 18:31:58,576 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:58,577 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:58,577 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796318412_0001_1, initTime=1452796318575
2016-01-14 18:31:58,577 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796318412_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:58,579 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:DAG_STARTED]: dagID=dag_1452796318412_0001_1, startTime=1452796318579
2016-01-14 18:31:58,579 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:58,579 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:58,579 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796318412_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:58,579 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B9DC8E7296334E31B214378A5B859A43 : {CB70111A612842A6AB01E84BCAB24886={InputName=CB70111A612842A6AB01E84BCAB24886}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:58,579 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: CB70111A612842A6AB01E84BCAB24886, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:58,580 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,580 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,580 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,580 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]. Starting root input initializers: 1
2016-01-14 18:31:58,581 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:58,581 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: CB70111A612842A6AB01E84BCAB24886 on vertex vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,582 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452796318412_0001, dagName=[4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 18:31:58,584 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:58,585 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input CB70111A612842A6AB01E84BCAB24886 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:58,587 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:58,587 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:58,588 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:58,589 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: CB70111A612842A6AB01E84BCAB24886 on vertex vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,589 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:58,589 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {CB70111A612842A6AB01E84BCAB24886=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:58,589 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] parallelism set to 1
2016-01-14 18:31:58,590 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:58,590 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796318412_0001_1_00, eventCount=1
2016-01-14 18:31:58,590 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,590 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=503DD8655ABD421FA8782D96F94F7319, vertexId=vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:58,590 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=503DD8655ABD421FA8782D96F94F7319, vertexId=vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,592 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=503DD8655ABD421FA8782D96F94F7319, vertexName=B9DC8E7296334E31B214378A5B859A43, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:58,592 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=503DD8655ABD421FA8782D96F94F7319, vertexId=vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,593 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:58,594 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B9DC8E7296334E31B214378A5B859A43, vertexId=vertex_1452796318412_0001_1_00, initRequestedTime=1452796318579, initedTime=1452796318593, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:58,594 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] with distanceFromRoot: 0
2016-01-14 18:31:58,594 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:58,594 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B9DC8E7296334E31B214378A5B859A43
2016-01-14 18:31:58,594 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,595 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:58,595 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796318412_0001_1_00, startRequestedTime=1452796318594, startedTime=1452796318594
2016-01-14 18:31:58,595 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:58,595 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:58,596 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:TASK_STARTED]: vertexName=B9DC8E7296334E31B214378A5B859A43, taskId=task_1452796318412_0001_1_00_000000, scheduledTime=1452796318595, launchTime=1452796318595
2016-01-14 18:31:58,596 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796318412_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:58,596 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,596 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1, VertexName: B9DC8E7296334E31B214378A5B859A43, VertexParallelism: 1, TaskAttemptID:attempt_1452796318412_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CB70111A612842A6AB01E84BCAB24886, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=503DD8655ABD421FA8782D96F94F7319, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:58,596 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796318412_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:58,597 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:58,600 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:58,601 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:58,601 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:58,602 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796318412_0001_00_000001
2016-01-14 18:31:58,602 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796318412_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:58,604 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796318412_0001_00_000001
2016-01-14 18:31:58,604 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:58,605 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796318412_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:58,605 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:58,605 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796318412_0001_00_000001, launchTime=1452796318604
2016-01-14 18:31:58,606 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796318412_0001_00_000001
2016-01-14 18:31:58,607 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796318412_0001_1_00_000000_0] to container: [container_1452796318412_0001_00_000001]
2016-01-14 18:31:58,608 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796318412_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:58,608 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796318412_0001_00_000001 given task: attempt_1452796318412_0001_1_00_000000_0
2016-01-14 18:31:58,608 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796318412_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796318412_0001_1_00_000000_0
2016-01-14 18:31:58,608 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796318412_0001_1_00_000000_0] started. Is using containerId: [container_1452796318412_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:58,609 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:58,609 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B9DC8E7296334E31B214378A5B859A43, taskAttemptId=attempt_1452796318412_0001_1_00_000000_0, startTime=1452796318608, containerId=container_1452796318412_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796318412_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:58,609 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796318412_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:58,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796318412_0001, with dag id: dag_1452796318412_0001_1
2016-01-14 18:31:58,610 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796318412_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:58 Starting to run new task attempt: attempt_1452796318412_0001_1_00_000000_0
2016-01-14 18:31:58,611 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796318412_0001_1_00_000000_0
2016-01-14 18:31:58,611 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:58,611 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:58,611 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:58,611 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:58,611 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:58,612 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:58,612 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1, VertexName: B9DC8E7296334E31B214378A5B859A43, VertexParallelism: 1, TaskAttemptID:attempt_1452796318412_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CB70111A612842A6AB01E84BCAB24886, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=503DD8655ABD421FA8782D96F94F7319, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:58,612 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:58,612 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796318412_0001_1_00_000000_0
2016-01-14 18:31:58,612 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:58,613 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:58,614 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:58,614 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=503DD8655ABD421FA8782D96F94F7319, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:58,614 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:58,615 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 503DD8655ABD421FA8782D96F94F7319
2016-01-14 18:31:58,615 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:58,616 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 503DD8655ABD421FA8782D96F94F7319
2016-01-14 18:31:58,620 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:58,621 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796318412_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:58,619 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=CB70111A612842A6AB01E84BCAB24886, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:58,621 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:58,622 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: CB70111A612842A6AB01E84BCAB24886
2016-01-14 18:31:58,622 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: CB70111A612842A6AB01E84BCAB24886
2016-01-14 18:31:58,627 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:58,627 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: CB70111A612842A6AB01E84BCAB24886
2016-01-14 18:31:58,628 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: CB70111A612842A6AB01E84BCAB24886
2016-01-14 18:31:58,631 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B9DC8E7296334E31B214378A5B859A43, ordinal: 0
2016-01-14 18:31:58,631 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B9DC8E7296334E31B214378A5B859A43, mem on start (mb), free: 222, total: 387, max: 672
2016-01-14 18:31:58,631 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:58,632 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:58,632 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:58,635 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:58,636 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 503DD8655ABD421FA8782D96F94F7319
2016-01-14 18:31:58,636 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:58,636 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:58,636 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:58,636 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:58,636 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:58,637 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:58,637 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:58,637 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:58,637 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 503DD8655ABD421FA8782D96F94F7319, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:58,637 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, CB70111A612842A6AB01E84BCAB24886, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:58,637 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:58,638 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: CB70111A612842A6AB01E84BCAB24886
2016-01-14 18:31:58,638 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:58,638 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: CB70111A612842A6AB01E84BCAB24886
2016-01-14 18:31:58,638 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: CB70111A612842A6AB01E84BCAB24886 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:58,638 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:58,638 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:58,638 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:58,639 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796318412_0001_1_00_000000_0
2016-01-14 18:31:58,640 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:58,641 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4e84958e
2016-01-14 18:31:58,642 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:58,642 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4e84958e
2016-01-14 18:31:58,642 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:58,642 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:58,642 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: CB70111A612842A6AB01E84BCAB24886
2016-01-14 18:31:58,643 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"], id: 503DD8655ABD421FA8782D96F94F7319
2016-01-14 18:31:58,643 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"]
2016-01-14 18:31:58,643 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:58,643 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:58,644 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B9DC8E7296334E31B214378A5B859A43, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:31:58,645 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:58,647 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:58,648 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:58,648 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:58,648 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:58,649 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796318412_0001_1_00_000000_0
2016-01-14 18:31:58,649 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796318412_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:58,650 INFO task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452796318412_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:58,661 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452796318644, Process_Duration=6, Process_End_Time=1452796318650, Read_Duration=0, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 18:31:58,661 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B9DC8E7296334E31B214378A5B859A43, mem on close (mb), free: 219, total: 387, max: 672
2016-01-14 18:31:58,661 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=B9DC8E7296334E31B214378A5B859A43, index=0
2016-01-14 18:31:58,662 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=B9DC8E7296334E31B214378A5B859A43, sourceVertex=CB70111A612842A6AB01E84BCAB24886
2016-01-14 18:31:58,662 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=B9DC8E7296334E31B214378A5B859A43, sourceVertex=503DD8655ABD421FA8782D96F94F7319
2016-01-14 18:31:58,662 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:58,663 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796318412_0001_00_000001
2016-01-14 18:31:58,663 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796318412_0001_00_000001
2016-01-14 18:31:58,663 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B9DC8E7296334E31B214378A5B859A43, taskAttemptId=attempt_1452796318412_0001_1_00_000000_0, startTime=1452796318608, finishTime=1452796318660, timeTaken=52, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452796318644, Process_Duration=6, Process_End_Time=1452796318650, Read_Duration=0, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 18:31:58,665 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796318412_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 18:31:58,665 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796318412_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 18:31:58,666 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452796318412_0001_00_000001 completed but with errors
2016-01-14 18:31:58,666 INFO impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452796318412_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 18:31:58,666 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:TASK_FINISHED]: vertexName=B9DC8E7296334E31B214378A5B859A43, taskId=task_1452796318412_0001_1_00_000000, startTime=1452796318608, finishTime=1452796318666, timeTaken=58, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 18:31:58,667 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:58,667 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796318412_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 18:31:58,667 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:58,669 INFO container.AMContainerImpl (AMContainerImpl.java:transition(686)) - Container container_1452796318412_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 18:31:58,669 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:58,669 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796318412_0001_00_000001, stoppedTime=1452796318669, exitStatus=1
2016-01-14 18:31:58,670 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796318412_0001_00_000001 transitioned from RUNNING to COMPLETED via event C_COMPLETED
2016-01-14 18:31:58,670 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] : 1
2016-01-14 18:31:58,670 INFO impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] because task failed: task_1452796318412_0001_1_00_000000
2016-01-14 18:31:58,671 INFO impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] due to trigger: OWN_TASK_FAILURE
2016-01-14 18:31:58,671 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 18:31:58,671 INFO impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,672 INFO impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=503DD8655ABD421FA8782D96F94F7319, vertexId=vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,677 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:58,678 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:VERTEX_FINISHED]: vertexName=B9DC8E7296334E31B214378A5B859A43, vertexId=vertex_1452796318412_0001_1_00, initRequestedTime=1452796318579, initedTime=1452796318593, startRequestedTime=1452796318594, startedTime=1452796318594, finishTime=1452796318676, timeTaken=82, status=FAILED, diagnostics=Task failed, taskId=task_1452796318412_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452796318608, firstTasksToStart=[ task_1452796318412_0001_1_00_000000 ], lastTaskFinishTime=1452796318660, lastTasksToFinish=[ task_1452796318412_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[ ], longestDurationTasks=[ ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 18:31:58,680 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 18:31:58,681 INFO node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452796318412_0001_1_00_000000_0 failed: true container: container_1452796318412_0001_00_000001 numFailedTAs: 0
2016-01-14 18:31:58,683 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796318412_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 18:31:58,683 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 18:31:58,684 INFO impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 18:31:58,684 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796318412_0001_1
2016-01-14 18:31:58,684 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 503DD8655ABD421FA8782D96F94F7319 for vertex: vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43]
2016-01-14 18:31:58,687 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796318412_0001_1, queueSize=0
2016-01-14 18:31:58,687 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:58,688 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318412_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796318412_0001_1, startTime=1452796318579, finishTime=1452796318686, timeTaken=107, status=FAILED, diagnostics=Vertex failed, vertexName=B9DC8E7296334E31B214378A5B859A43, vertexId=vertex_1452796318412_0001_1_00, diagnostics=[Task failed, taskId=task_1452796318412_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452796318412_0001_1_00 [B9DC8E7296334E31B214378A5B859A43] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 18:31:58,688 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796318412_0001_1 finished with state: FAILED
2016-01-14 18:31:58,688 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796318412_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:58 Completed Dag: dag_1452796318412_0001_1
2016-01-14 18:31:58,689 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796318412_0001_1, dagState=FAILED
2016-01-14 18:31:58,689 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796318412_0001_1_post
2016-01-14 18:31:58,689 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:58,689 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:58,698 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452796318412_0001
2016-01-14 18:31:58,701 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:58,701 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:58,701 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:58,701 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:58,701 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:58,702 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:58,702 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:58,703 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:58,703 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:58,703 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:58,704 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:58,704 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:58,704 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:58,709 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4E5E6214F54842E9BBD2BB542FF672C9/E63BB68737074C8AB4D6431CFA3BFA5B/.tez/application_1452796318412_0001
2016-01-14 18:31:58,709 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 18:31:58,710 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 18:31:58,711 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 18:31:58,711 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.321
2016-01-14 18:31:58,712 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_-1
2016-01-14 18:31:58,741 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:58,741 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:58,774 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.005
2016-01-14 18:31:58,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.009
2016-01-14 18:31:58,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:31:58,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:31:58,779 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_'field2'
2016-01-14 18:31:58,810 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:58,810 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:58,850 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.010
2016-01-14 18:31:58,861 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 18:31:58,862 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:58,862 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:58,862 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:58,886 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:58,887 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS
2016-01-14 18:31:58,894 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:31:58,895 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:31:58,902 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:58,902 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:58,903 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"]
2016-01-14 18:31:58,904 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:58,904 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:58,905 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:58,906 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 18:31:58,906 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:58,923 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:58,928 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:58,928 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:58,929 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:58,937 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F/.tez/application_1452796318928_0001 doesn't exist and is created
2016-01-14 18:31:58,955 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:58,955 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:58,955 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F/.tez/application_1452796318928_0001
2016-01-14 18:31:58,957 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796318928_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:58,969 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:58,972 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:58,974 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:58,974 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:58,974 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F/.tez/application_1452796318928_0001/localmode-log-dir
2016-01-14 18:31:58,974 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F/.tez/application_1452796318928_0001/localmode-log-dir/history.txt.appattempt_1452796318928_0001_000000, maxErrors=10
2016-01-14 18:31:58,975 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:58,975 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796318928_0001_000000, appSubmitTime=1452796318957, launchTime=1452796318957
2016-01-14 18:31:58,981 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:58,982 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:58,984 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:58,985 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:58,987 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:38314
2016-01-14 18:31:58,988 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:58,990 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796318928_0001_000000, startTime=1452796318990
2016-01-14 18:31:58,990 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:58,990 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:59,055 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:59,056 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:59,056 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452796318928_0001, dagName=[4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 18:31:59,091 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 18:31:59,092 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796318928_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F/.tez/application_1452796318928_0001/localmode-log-dir/dag_1452796318928_0001_1.dot
2016-01-14 18:31:59,093 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F/.tez/application_1452796318928_0001/localmode-log-dir/dag_1452796318928_0001_1-tez-dag.pb.txt
2016-01-14 18:31:59,099 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796318928_0001_1
2016-01-14 18:31:59,099 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:59,099 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 18:31:59 Running Dag: dag_1452796318928_0001_1
2016-01-14 18:31:59,109 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:59,109 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796318928_0001_1, submitTime=1452796319091
2016-01-14 18:31:59,110 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AC742140DF6F4137B6D50B98AEC309C4
2016-01-14 18:31:59,110 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:59,110 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:59,111 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796318928_0001_1, initTime=1452796319109
2016-01-14 18:31:59,111 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796318928_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:59,111 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:DAG_STARTED]: dagID=dag_1452796318928_0001_1, startTime=1452796319111
2016-01-14 18:31:59,111 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:59,111 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796318928_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:59,112 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AC742140DF6F4137B6D50B98AEC309C4 : {2B76EC8E62654280BD785D60813F6AED={InputName=2B76EC8E62654280BD785D60813F6AED}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:59,112 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 2B76EC8E62654280BD785D60813F6AED, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:59,112 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,112 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,112 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,112 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:59,112 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]. Starting root input initializers: 1
2016-01-14 18:31:59,113 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:59,114 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 2B76EC8E62654280BD785D60813F6AED on vertex vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,114 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452796318928_0001, dagName=[4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 18:31:59,116 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:59,117 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 2B76EC8E62654280BD785D60813F6AED asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:59,117 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:59,118 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:59,120 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:59,120 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 2B76EC8E62654280BD785D60813F6AED on vertex vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,120 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:59,120 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {2B76EC8E62654280BD785D60813F6AED=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:59,121 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] parallelism set to 1
2016-01-14 18:31:59,121 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:59,121 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796318928_0001_1_00, eventCount=1
2016-01-14 18:31:59,121 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,121 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6791AA86A5344622B1A64D3211A147C4, vertexId=vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:59,122 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6791AA86A5344622B1A64D3211A147C4, vertexId=vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,123 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6791AA86A5344622B1A64D3211A147C4, vertexName=AC742140DF6F4137B6D50B98AEC309C4, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:59,123 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6791AA86A5344622B1A64D3211A147C4, vertexId=vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,124 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AC742140DF6F4137B6D50B98AEC309C4, vertexId=vertex_1452796318928_0001_1_00, initRequestedTime=1452796319112, initedTime=1452796319124, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:59,124 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] with distanceFromRoot: 0
2016-01-14 18:31:59,124 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:59,125 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:59,125 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AC742140DF6F4137B6D50B98AEC309C4
2016-01-14 18:31:59,125 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,126 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796318928_0001_1_00, startRequestedTime=1452796319125, startedTime=1452796319125
2016-01-14 18:31:59,126 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:59,126 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:59,126 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:TASK_STARTED]: vertexName=AC742140DF6F4137B6D50B98AEC309C4, taskId=task_1452796318928_0001_1_00_000000, scheduledTime=1452796319126, launchTime=1452796319126
2016-01-14 18:31:59,126 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:59,127 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796318928_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:59,127 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,127 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS, VertexName: AC742140DF6F4137B6D50B98AEC309C4, VertexParallelism: 1, TaskAttemptID:attempt_1452796318928_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2B76EC8E62654280BD785D60813F6AED, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6791AA86A5344622B1A64D3211A147C4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:59,127 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796318928_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:59,128 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:59,128 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:59,129 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:59,129 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:59,129 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796318928_0001_00_000001
2016-01-14 18:31:59,129 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796318928_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:59,131 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796318928_0001_00_000001
2016-01-14 18:31:59,131 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:59,132 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796318928_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:59,132 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:59,133 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796318928_0001_00_000001, launchTime=1452796319132
2016-01-14 18:31:59,134 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796318928_0001_00_000001
2016-01-14 18:31:59,134 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796318928_0001_1_00_000000_0] to container: [container_1452796318928_0001_00_000001]
2016-01-14 18:31:59,135 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796318928_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:59,135 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796318928_0001_1_00_000000_0] started. Is using containerId: [container_1452796318928_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:59,135 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AC742140DF6F4137B6D50B98AEC309C4, taskAttemptId=attempt_1452796318928_0001_1_00_000000_0, startTime=1452796319135, containerId=container_1452796318928_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796318928_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:59,135 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:59,136 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796318928_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:59,136 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796318928_0001, with dag id: dag_1452796318928_0001_1
2016-01-14 18:31:59,136 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796318928_0001_00_000001 given task: attempt_1452796318928_0001_1_00_000000_0
2016-01-14 18:31:59,136 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796318928_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:59,137 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796318928_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796318928_0001_1_00_000000_0
2016-01-14 18:31:59 Starting to run new task attempt: attempt_1452796318928_0001_1_00_000000_0
2016-01-14 18:31:59,137 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796318928_0001_1_00_000000_0
2016-01-14 18:31:59,138 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:59,138 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:59,138 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:59,142 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:59,142 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:59,143 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:59,143 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS, VertexName: AC742140DF6F4137B6D50B98AEC309C4, VertexParallelism: 1, TaskAttemptID:attempt_1452796318928_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=2B76EC8E62654280BD785D60813F6AED, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6791AA86A5344622B1A64D3211A147C4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:59,144 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:59,145 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796318928_0001_1_00_000000_0
2016-01-14 18:31:59,145 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:59,145 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:59,147 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796318928_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:59,147 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:59,148 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=2B76EC8E62654280BD785D60813F6AED, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:59,148 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6791AA86A5344622B1A64D3211A147C4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:59,148 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:59,148 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:59,149 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6791AA86A5344622B1A64D3211A147C4
2016-01-14 18:31:59,149 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:59,149 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6791AA86A5344622B1A64D3211A147C4
2016-01-14 18:31:59,149 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 2B76EC8E62654280BD785D60813F6AED
2016-01-14 18:31:59,150 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 2B76EC8E62654280BD785D60813F6AED
2016-01-14 18:31:59,150 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:59,153 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:59,154 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 2B76EC8E62654280BD785D60813F6AED
2016-01-14 18:31:59,154 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 2B76EC8E62654280BD785D60813F6AED
2016-01-14 18:31:59,160 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:59,160 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6791AA86A5344622B1A64D3211A147C4
2016-01-14 18:31:59,161 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AC742140DF6F4137B6D50B98AEC309C4, ordinal: 0
2016-01-14 18:31:59,161 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AC742140DF6F4137B6D50B98AEC309C4, mem on start (mb), free: 329, total: 384, max: 672
2016-01-14 18:31:59,161 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:59,161 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:59,161 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:59,161 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:59,161 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:59,162 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:59,162 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:59,162 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:59,162 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:59,163 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:59,163 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:59,163 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6791AA86A5344622B1A64D3211A147C4, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:59,164 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 2B76EC8E62654280BD785D60813F6AED, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:59,164 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:59,164 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 2B76EC8E62654280BD785D60813F6AED
2016-01-14 18:31:59,164 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:59,164 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 2B76EC8E62654280BD785D60813F6AED
2016-01-14 18:31:59,165 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 2B76EC8E62654280BD785D60813F6AED being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:59,165 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:59,166 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:59,166 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:59,166 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796318928_0001_1_00_000000_0
2016-01-14 18:31:59,170 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:59,170 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:59,170 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 2B76EC8E62654280BD785D60813F6AED
2016-01-14 18:31:59,170 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"], id: 6791AA86A5344622B1A64D3211A147C4
2016-01-14 18:31:59,171 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"]
2016-01-14 18:31:59,171 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:59,171 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:59,171 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2c0a8c7a
2016-01-14 18:31:59,172 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2c0a8c7a
2016-01-14 18:31:59,173 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:59,174 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:59,175 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AC742140DF6F4137B6D50B98AEC309C4, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:31:59,175 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:59,176 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:59,177 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:59,177 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:59,178 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:59,178 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796318928_0001_1_00_000000_0
2016-01-14 18:31:59,178 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796318928_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:59,179 INFO task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452796318928_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:59,186 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452796319175, Process_Duration=4, Process_End_Time=1452796319179, Read_Duration=0, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 18:31:59,186 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:59,186 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AC742140DF6F4137B6D50B98AEC309C4, taskAttemptId=attempt_1452796318928_0001_1_00_000000_0, startTime=1452796319135, finishTime=1452796319186, timeTaken=51, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452796319175, Process_Duration=4, Process_End_Time=1452796319179, Read_Duration=0, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 18:31:59,187 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796318928_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 18:31:59,188 INFO impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452796318928_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 18:31:59,188 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:TASK_FINISHED]: vertexName=AC742140DF6F4137B6D50B98AEC309C4, taskId=task_1452796318928_0001_1_00_000000, startTime=1452796319135, finishTime=1452796319188, timeTaken=53, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 18:31:59,188 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796318928_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 18:31:59,188 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:59,188 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:59,186 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AC742140DF6F4137B6D50B98AEC309C4, mem on close (mb), free: 327, total: 384, max: 672
2016-01-14 18:31:59,188 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] : 1
2016-01-14 18:31:59,189 INFO impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] because task failed: task_1452796318928_0001_1_00_000000
2016-01-14 18:31:59,190 INFO impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] due to trigger: OWN_TASK_FAILURE
2016-01-14 18:31:59,190 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 18:31:59,190 INFO impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,190 INFO impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=6791AA86A5344622B1A64D3211A147C4, vertexId=vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,192 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:59,191 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=AC742140DF6F4137B6D50B98AEC309C4, index=0
2016-01-14 18:31:59,192 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:VERTEX_FINISHED]: vertexName=AC742140DF6F4137B6D50B98AEC309C4, vertexId=vertex_1452796318928_0001_1_00, initRequestedTime=1452796319112, initedTime=1452796319124, startRequestedTime=1452796319125, startedTime=1452796319125, finishTime=1452796319191, timeTaken=66, status=FAILED, diagnostics=Task failed, taskId=task_1452796318928_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452796319135, firstTasksToStart=[ task_1452796318928_0001_1_00_000000 ], lastTaskFinishTime=1452796319186, lastTasksToFinish=[ task_1452796318928_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[ ], longestDurationTasks=[ ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 18:31:59,193 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 18:31:59,194 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:59,194 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=AC742140DF6F4137B6D50B98AEC309C4, sourceVertex=2B76EC8E62654280BD785D60813F6AED
2016-01-14 18:31:59,194 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796318928_0001_00_000001, stoppedTime=1452796319194, exitStatus=0
2016-01-14 18:31:59,194 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796318928_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:31:59,194 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=AC742140DF6F4137B6D50B98AEC309C4, sourceVertex=6791AA86A5344622B1A64D3211A147C4
2016-01-14 18:31:59,195 INFO node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452796318928_0001_1_00_000000_0 failed: true container: container_1452796318928_0001_00_000001 numFailedTAs: 0
2016-01-14 18:31:59,195 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 18:31:59,195 INFO impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 18:31:59,195 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796318928_0001_1
2016-01-14 18:31:59,196 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 6791AA86A5344622B1A64D3211A147C4 for vertex: vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4]
2016-01-14 18:31:59,196 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796318928_0001_1, queueSize=0
2016-01-14 18:31:59,197 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796318928_0001_00_000001
2016-01-14 18:31:59,197 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796318928_0001_00_000001
2016-01-14 18:31:59,197 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:59,198 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796318928_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796318928_0001_1, startTime=1452796319111, finishTime=1452796319196, timeTaken=85, status=FAILED, diagnostics=Vertex failed, vertexName=AC742140DF6F4137B6D50B98AEC309C4, vertexId=vertex_1452796318928_0001_1_00, diagnostics=[Task failed, taskId=task_1452796318928_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452796318928_0001_1_00 [AC742140DF6F4137B6D50B98AEC309C4] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 18:31:59,199 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796318928_0001_1 finished with state: FAILED
2016-01-14 18:31:59,199 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796318928_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:59,199 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452796318928_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 18:31:59 Completed Dag: dag_1452796318928_0001_1
2016-01-14 18:31:59,200 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796318928_0001_1, dagState=FAILED
2016-01-14 18:31:59,200 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796318928_0001_1_post
2016-01-14 18:31:59,200 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:59,200 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:59,200 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796318928_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 18:31:59,201 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796318928_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 18:31:59,201 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452796318928_0001_00_000001 completed but with errors
2016-01-14 18:31:59,201 INFO container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452796318928_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 18:31:59,201 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796318928_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 18:31:59,201 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796318928_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 18:31:59,204 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452796318928_0001
2016-01-14 18:31:59,207 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:59,207 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:59,207 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:59,207 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:59,207 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:59,209 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:59,210 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:59,210 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:59,210 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:59,210 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:59,211 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:59,211 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:59,211 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:59,216 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4751C9100E2D496F89A78EA97F81A0F6/EEE8CACFC3D0437FA4CA5FFE4941986F/.tez/application_1452796318928_0001
2016-01-14 18:31:59,216 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 18:31:59,216 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 18:31:59,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 18:31:59,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.315
2016-01-14 18:31:59,217 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_RESULTS
2016-01-14 18:31:59,247 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:59,248 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:59,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 18:31:59,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-14 18:31:59,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:59,300 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:59,300 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:59,323 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:59,324 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL
2016-01-14 18:31:59,339 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:59,340 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:59,340 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"]
2016-01-14 18:31:59,340 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:59,341 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:59,341 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:59,342 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 18:31:59,342 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:59,363 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:59,367 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:59,368 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:59,368 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:59,377 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A/.tez/application_1452796319367_0001 doesn't exist and is created
2016-01-14 18:31:59,395 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:59,395 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:59,395 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A/.tez/application_1452796319367_0001
2016-01-14 18:31:59,398 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796319367_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:59,415 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:59,416 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:59,418 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:59,418 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:59,418 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A/.tez/application_1452796319367_0001/localmode-log-dir
2016-01-14 18:31:59,419 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A/.tez/application_1452796319367_0001/localmode-log-dir/history.txt.appattempt_1452796319367_0001_000000, maxErrors=10
2016-01-14 18:31:59,419 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:59,419 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796319367_0001_000000, appSubmitTime=1452796319397, launchTime=1452796319397
2016-01-14 18:31:59,428 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:59,429 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:47078
2016-01-14 18:31:59,431 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:59,432 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:59,432 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:59,433 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:59,435 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796319367_0001_000000, startTime=1452796319435
2016-01-14 18:31:59,435 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:59,435 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:59,495 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:59,495 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:59,495 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452796319367_0001, dagName=[2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 18:31:59,515 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 18:31:59,516 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796319367_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A/.tez/application_1452796319367_0001/localmode-log-dir/dag_1452796319367_0001_1.dot
2016-01-14 18:31:59,517 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A/.tez/application_1452796319367_0001/localmode-log-dir/dag_1452796319367_0001_1-tez-dag.pb.txt
2016-01-14 18:31:59,526 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796319367_0001_1
2016-01-14 18:31:59,526 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:59,526 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 18:31:59 Running Dag: dag_1452796319367_0001_1
2016-01-14 18:31:59,536 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796319367_0001_1, submitTime=1452796319515
2016-01-14 18:31:59,536 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:31:59,537 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex FA7C70A28A454F0AB20611F7FA33DB69
2016-01-14 18:31:59,537 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:31:59,537 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796319367_0001_1, initTime=1452796319536
2016-01-14 18:31:59,538 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796319367_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:31:59,537 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:31:59,539 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:DAG_STARTED]: dagID=dag_1452796319367_0001_1, startTime=1452796319539
2016-01-14 18:31:59,539 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:31:59,540 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796319367_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:31:59,540 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: FA7C70A28A454F0AB20611F7FA33DB69 : {F4AC55ABCF2749EA86D406A97BF017C7={InputName=F4AC55ABCF2749EA86D406A97BF017C7}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:31:59,540 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: F4AC55ABCF2749EA86D406A97BF017C7, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:31:59,540 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,540 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,539 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:31:59,540 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,540 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452796319367_0001, dagName=[2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 18:31:59,541 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]. Starting root input initializers: 1
2016-01-14 18:31:59,542 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:31:59,542 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: F4AC55ABCF2749EA86D406A97BF017C7 on vertex vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,544 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:31:59,544 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input F4AC55ABCF2749EA86D406A97BF017C7 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:31:59,545 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:31:59,545 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:31:59,547 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:31:59,547 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: F4AC55ABCF2749EA86D406A97BF017C7 on vertex vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,547 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:59,547 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {F4AC55ABCF2749EA86D406A97BF017C7=forAllWorkUnits=true, update=[1]}
2016-01-14 18:31:59,548 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] parallelism set to 1
2016-01-14 18:31:59,548 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:31:59,548 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796319367_0001_1_00, eventCount=1
2016-01-14 18:31:59,548 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,548 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=9DB5858E4142450790622A027B00FED5, vertexId=vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:31:59,549 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=9DB5858E4142450790622A027B00FED5, vertexId=vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,550 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=9DB5858E4142450790622A027B00FED5, vertexName=FA7C70A28A454F0AB20611F7FA33DB69, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:31:59,550 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=9DB5858E4142450790622A027B00FED5, vertexId=vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,551 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FA7C70A28A454F0AB20611F7FA33DB69, vertexId=vertex_1452796319367_0001_1_00, initRequestedTime=1452796319540, initedTime=1452796319551, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:31:59,551 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] with distanceFromRoot: 0
2016-01-14 18:31:59,551 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:31:59,552 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:31:59,552 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in FA7C70A28A454F0AB20611F7FA33DB69
2016-01-14 18:31:59,552 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,552 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:31:59,553 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796319367_0001_1_00, startRequestedTime=1452796319552, startedTime=1452796319552
2016-01-14 18:31:59,553 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:31:59,553 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:31:59,553 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:TASK_STARTED]: vertexName=FA7C70A28A454F0AB20611F7FA33DB69, taskId=task_1452796319367_0001_1_00_000000, scheduledTime=1452796319553, launchTime=1452796319553
2016-01-14 18:31:59,554 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796319367_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:31:59,554 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,554 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL, VertexName: FA7C70A28A454F0AB20611F7FA33DB69, VertexParallelism: 1, TaskAttemptID:attempt_1452796319367_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F4AC55ABCF2749EA86D406A97BF017C7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=9DB5858E4142450790622A027B00FED5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:59,554 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796319367_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:31:59,554 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:31:59,555 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:31:59,556 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:31:59,556 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:31:59,556 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796319367_0001_00_000001
2016-01-14 18:31:59,556 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319367_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:31:59,558 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796319367_0001_00_000001
2016-01-14 18:31:59,558 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:31:59,559 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319367_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:31:59,559 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796319367_0001_00_000001, launchTime=1452796319559
2016-01-14 18:31:59,559 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:31:59,560 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796319367_0001_00_000001
2016-01-14 18:31:59,561 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796319367_0001_1_00_000000_0] to container: [container_1452796319367_0001_00_000001]
2016-01-14 18:31:59,561 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319367_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:31:59,562 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796319367_0001_00_000001 given task: attempt_1452796319367_0001_1_00_000000_0
2016-01-14 18:31:59,562 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796319367_0001_1_00_000000_0] started. Is using containerId: [container_1452796319367_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:31:59,562 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796319367_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796319367_0001_1_00_000000_0
2016-01-14 18:31:59,563 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FA7C70A28A454F0AB20611F7FA33DB69, taskAttemptId=attempt_1452796319367_0001_1_00_000000_0, startTime=1452796319562, containerId=container_1452796319367_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796319367_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:31:59,563 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:31:59 Starting to run new task attempt: attempt_1452796319367_0001_1_00_000000_0
2016-01-14 18:31:59,564 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796319367_0001_1_00_000000_0
2016-01-14 18:31:59,564 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:59,564 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:31:59,564 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:31:59,564 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796319367_0001, with dag id: dag_1452796319367_0001_1
2016-01-14 18:31:59,564 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:31:59,565 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:31:59,565 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:31:59,565 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL, VertexName: FA7C70A28A454F0AB20611F7FA33DB69, VertexParallelism: 1, TaskAttemptID:attempt_1452796319367_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=F4AC55ABCF2749EA86D406A97BF017C7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=9DB5858E4142450790622A027B00FED5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:31:59,565 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:31:59,565 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796319367_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:31:59,566 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796319367_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:31:59,566 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796319367_0001_1_00_000000_0
2016-01-14 18:31:59,566 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:31:59,566 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:59,571 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796319367_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:31:59,571 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:59,571 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=F4AC55ABCF2749EA86D406A97BF017C7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:31:59,572 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=9DB5858E4142450790622A027B00FED5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:31:59,573 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:31:59,573 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 9DB5858E4142450790622A027B00FED5
2016-01-14 18:31:59,573 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:31:59,573 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 9DB5858E4142450790622A027B00FED5
2016-01-14 18:31:59,575 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:31:59,575 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: F4AC55ABCF2749EA86D406A97BF017C7
2016-01-14 18:31:59,575 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: F4AC55ABCF2749EA86D406A97BF017C7
2016-01-14 18:31:59,579 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:31:59,579 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: F4AC55ABCF2749EA86D406A97BF017C7
2016-01-14 18:31:59,580 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: F4AC55ABCF2749EA86D406A97BF017C7
2016-01-14 18:31:59,580 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:31:59,584 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:31:59,585 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 9DB5858E4142450790622A027B00FED5
2016-01-14 18:31:59,589 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FA7C70A28A454F0AB20611F7FA33DB69, ordinal: 0
2016-01-14 18:31:59,589 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FA7C70A28A454F0AB20611F7FA33DB69, mem on start (mb), free: 255, total: 384, max: 672
2016-01-14 18:31:59,589 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:31:59,589 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:31:59,590 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:31:59,590 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:31:59,590 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:31:59,590 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:31:59,590 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:31:59,590 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:31:59,591 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:59,591 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:31:59,591 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:31:59,591 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:31:59,591 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:31:59,591 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 9DB5858E4142450790622A027B00FED5, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:31:59,591 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, F4AC55ABCF2749EA86D406A97BF017C7, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:31:59,592 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:31:59,592 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: F4AC55ABCF2749EA86D406A97BF017C7 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:31:59,592 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:31:59,592 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:31:59,592 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: F4AC55ABCF2749EA86D406A97BF017C7
2016-01-14 18:31:59,592 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:59,592 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: F4AC55ABCF2749EA86D406A97BF017C7
2016-01-14 18:31:59,593 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:31:59,593 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796319367_0001_1_00_000000_0
2016-01-14 18:31:59,593 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:31:59,594 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@48e70148
2016-01-14 18:31:59,595 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@48e70148
2016-01-14 18:31:59,595 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:31:59,595 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:31:59,596 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:59,599 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: F4AC55ABCF2749EA86D406A97BF017C7
2016-01-14 18:31:59,600 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"], id: 9DB5858E4142450790622A027B00FED5
2016-01-14 18:31:59,602 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"]
2016-01-14 18:31:59,602 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:59,603 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:31:59,604 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FA7C70A28A454F0AB20611F7FA33DB69, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:31:59,605 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:59,614 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:59,623 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:59,631 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:31:59,631 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:31:59,632 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796319367_0001_1_00_000000_0
2016-01-14 18:31:59,632 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796319367_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:31:59,633 INFO task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452796319367_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:31:59,637 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FA7C70A28A454F0AB20611F7FA33DB69, taskAttemptId=attempt_1452796319367_0001_1_00_000000_0, startTime=1452796319562, finishTime=1452796319637, timeTaken=75, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452796319604, Process_Duration=29, Process_End_Time=1452796319633, Read_Duration=1, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 18:31:59,637 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796319367_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 18:31:59,637 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:31:59,637 INFO impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452796319367_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 18:31:59,638 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:TASK_FINISHED]: vertexName=FA7C70A28A454F0AB20611F7FA33DB69, taskId=task_1452796319367_0001_1_00_000000, startTime=1452796319562, finishTime=1452796319638, timeTaken=76, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 18:31:59,638 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796319367_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 18:31:59,638 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:31:59,638 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] : 1
2016-01-14 18:31:59,638 INFO impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] because task failed: task_1452796319367_0001_1_00_000000
2016-01-14 18:31:59,638 INFO impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] due to trigger: OWN_TASK_FAILURE
2016-01-14 18:31:59,638 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:31:59,639 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 18:31:59,639 INFO impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,639 INFO impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=9DB5858E4142450790622A027B00FED5, vertexId=vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,641 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:VERTEX_FINISHED]: vertexName=FA7C70A28A454F0AB20611F7FA33DB69, vertexId=vertex_1452796319367_0001_1_00, initRequestedTime=1452796319540, initedTime=1452796319551, startRequestedTime=1452796319552, startedTime=1452796319552, finishTime=1452796319640, timeTaken=88, status=FAILED, diagnostics=Task failed, taskId=task_1452796319367_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452796319562, firstTasksToStart=[ task_1452796319367_0001_1_00_000000 ], lastTaskFinishTime=1452796319637, lastTasksToFinish=[ task_1452796319367_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[ ], longestDurationTasks=[ ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 18:31:59,641 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:31:59,641 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 18:31:59,642 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796319367_0001_00_000001, stoppedTime=1452796319642, exitStatus=0
2016-01-14 18:31:59,642 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319367_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:31:59,642 INFO node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452796319367_0001_1_00_000000_0 failed: true container: container_1452796319367_0001_00_000001 numFailedTAs: 0
2016-01-14 18:31:59,642 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 18:31:59,642 INFO impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 18:31:59,643 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796319367_0001_1
2016-01-14 18:31:59,643 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 9DB5858E4142450790622A027B00FED5 for vertex: vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69]
2016-01-14 18:31:59,643 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:31:59,644 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796319367_0001_1, queueSize=0
2016-01-14 18:31:59,644 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319367_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796319367_0001_1, startTime=1452796319539, finishTime=1452796319643, timeTaken=104, status=FAILED, diagnostics=Vertex failed, vertexName=FA7C70A28A454F0AB20611F7FA33DB69, vertexId=vertex_1452796319367_0001_1_00, diagnostics=[Task failed, taskId=task_1452796319367_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452796319367_0001_1_00 [FA7C70A28A454F0AB20611F7FA33DB69] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 18:31:59,644 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796319367_0001_1 finished with state: FAILED
2016-01-14 18:31:59,644 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796319367_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:31:59,645 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:31:59,645 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452796319367_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 18:31:59 Completed Dag: dag_1452796319367_0001_1
2016-01-14 18:31:59,645 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796319367_0001_1, dagState=FAILED
2016-01-14 18:31:59,645 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796319367_0001_1_post
2016-01-14 18:31:59,645 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:31:59,645 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:31:59,645 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319367_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 18:31:59,646 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 19 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452796319604, Process_Duration=29, Process_End_Time=1452796319633, Read_Duration=1, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 18:31:59,646 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FA7C70A28A454F0AB20611F7FA33DB69, mem on close (mb), free: 251, total: 384, max: 672
2016-01-14 18:31:59,646 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=FA7C70A28A454F0AB20611F7FA33DB69, index=0
2016-01-14 18:31:59,646 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=FA7C70A28A454F0AB20611F7FA33DB69, sourceVertex=F4AC55ABCF2749EA86D406A97BF017C7
2016-01-14 18:31:59,646 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=FA7C70A28A454F0AB20611F7FA33DB69, sourceVertex=9DB5858E4142450790622A027B00FED5
2016-01-14 18:31:59,646 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796319367_0001_00_000001
2016-01-14 18:31:59,648 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796319367_0001_00_000001
2016-01-14 18:31:59,651 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796319367_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 18:31:59,651 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452796319367_0001_00_000001 completed but with errors
2016-01-14 18:31:59,652 INFO container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452796319367_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 18:31:59,653 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319367_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 18:31:59,653 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796319367_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 18:31:59,653 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452796319367_0001
2016-01-14 18:31:59,657 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:31:59,657 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:31:59,657 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:31:59,657 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:31:59,658 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:31:59,658 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:31:59,658 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:31:59,658 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:31:59,659 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:31:59,664 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:31:59,664 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:31:59,664 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:31:59,665 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:31:59,669 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/2EB87A604D504203BABCEA41F065733C/D31FF2AAEB8D4F0EAEA2FAF93D51C83A/.tez/application_1452796319367_0001
2016-01-14 18:31:59,669 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 18:31:59,670 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 18:31:59,670 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 18:31:59,671 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.331
2016-01-14 18:31:59,671 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_ALL
2016-01-14 18:31:59,702 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:59,703 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:59,735 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2016-01-14 18:31:59,739 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.009
2016-01-14 18:31:59,740 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:31:59,740 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:31:59,740 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_'field2'
2016-01-14 18:31:59,766 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:31:59,766 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:31:59,814 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 18:31:59,822 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-01-14 18:31:59,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:59,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:31:59,823 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:31:59,841 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:31:59,841 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS
2016-01-14 18:31:59,851 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:31:59,852 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:31:59,852 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"]
2016-01-14 18:31:59,852 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:31:59,852 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:31:59,852 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:31:59,853 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 18:31:59,853 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:31:59,867 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:31:59,871 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:59,871 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:31:59,871 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:31:59,880 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E/.tez/application_1452796319871_0001 doesn't exist and is created
2016-01-14 18:31:59,895 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:31:59,895 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:31:59,896 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E/.tez/application_1452796319871_0001
2016-01-14 18:31:59,898 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796319871_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:31:59,911 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:31:59,912 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:31:59,913 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:31:59,914 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:31:59,914 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E/.tez/application_1452796319871_0001/localmode-log-dir
2016-01-14 18:31:59,914 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E/.tez/application_1452796319871_0001/localmode-log-dir/history.txt.appattempt_1452796319871_0001_000000, maxErrors=10
2016-01-14 18:31:59,914 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:31:59,915 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796319871_0001_000000, appSubmitTime=1452796319898, launchTime=1452796319898
2016-01-14 18:31:59,918 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:31:59,919 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:31:59,922 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:31:59,922 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:31:59,926 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:55011
2016-01-14 18:31:59,931 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:31:59,933 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:31:59,933 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796319871_0001_000000, startTime=1452796319933
2016-01-14 18:31:59,933 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:31:59,996 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:31:59,996 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:31:59,996 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452796319871_0001, dagName=[66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 18:32:00,015 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 18:32:00,017 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796319871_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E/.tez/application_1452796319871_0001/localmode-log-dir/dag_1452796319871_0001_1.dot
2016-01-14 18:32:00,017 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E/.tez/application_1452796319871_0001/localmode-log-dir/dag_1452796319871_0001_1-tez-dag.pb.txt
2016-01-14 18:32:00,023 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796319871_0001_1
2016-01-14 18:32:00,023 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:00,023 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 18:32:00 Running Dag: dag_1452796319871_0001_1
2016-01-14 18:32:00,033 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796319871_0001_1, submitTime=1452796320015
2016-01-14 18:32:00,033 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:00,034 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BCB66E9C1979408C935B6202CB9AB51C
2016-01-14 18:32:00,034 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:00,034 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796319871_0001_1, initTime=1452796320033
2016-01-14 18:32:00,035 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796319871_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:00,035 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:00,035 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:DAG_STARTED]: dagID=dag_1452796319871_0001_1, startTime=1452796320035
2016-01-14 18:32:00,036 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:00,036 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:00,036 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796319871_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:00,036 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BCB66E9C1979408C935B6202CB9AB51C : {768D103745C840BCB6F4BDC5C154F73B={InputName=768D103745C840BCB6F4BDC5C154F73B}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:00,037 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 768D103745C840BCB6F4BDC5C154F73B, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:00,037 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,037 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,037 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,038 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]. Starting root input initializers: 1
2016-01-14 18:32:00,038 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:00,038 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 768D103745C840BCB6F4BDC5C154F73B on vertex vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,038 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452796319871_0001, dagName=[66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 18:32:00,040 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:00,041 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 768D103745C840BCB6F4BDC5C154F73B asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:00,041 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:00,041 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:00,043 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:00,043 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 768D103745C840BCB6F4BDC5C154F73B on vertex vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,044 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:00,044 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {768D103745C840BCB6F4BDC5C154F73B=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:00,044 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C] parallelism set to 1
2016-01-14 18:32:00,044 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:00,044 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796319871_0001_1_00, eventCount=1
2016-01-14 18:32:00,044 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,044 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=1E7136BD6DF941A99F2AB2F43A03AC64, vertexId=vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:00,045 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=1E7136BD6DF941A99F2AB2F43A03AC64, vertexId=vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,046 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=1E7136BD6DF941A99F2AB2F43A03AC64, vertexName=BCB66E9C1979408C935B6202CB9AB51C, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:00,047 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=1E7136BD6DF941A99F2AB2F43A03AC64, vertexId=vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,047 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:00,048 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BCB66E9C1979408C935B6202CB9AB51C, vertexId=vertex_1452796319871_0001_1_00, initRequestedTime=1452796320036, initedTime=1452796320047, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:00,048 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C] with distanceFromRoot: 0
2016-01-14 18:32:00,048 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:00,048 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BCB66E9C1979408C935B6202CB9AB51C
2016-01-14 18:32:00,048 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,049 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:00,049 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796319871_0001_1_00, startRequestedTime=1452796320048, startedTime=1452796320048
2016-01-14 18:32:00,050 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:00,050 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:00,050 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:TASK_STARTED]: vertexName=BCB66E9C1979408C935B6202CB9AB51C, taskId=task_1452796319871_0001_1_00_000000, scheduledTime=1452796320050, launchTime=1452796320050
2016-01-14 18:32:00,051 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796319871_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:00,051 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,051 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS, VertexName: BCB66E9C1979408C935B6202CB9AB51C, VertexParallelism: 1, TaskAttemptID:attempt_1452796319871_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=768D103745C840BCB6F4BDC5C154F73B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1E7136BD6DF941A99F2AB2F43A03AC64, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:00,052 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796319871_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:00,052 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:00,052 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:00,053 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:00,053 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:00,054 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796319871_0001_00_000001
2016-01-14 18:32:00,054 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319871_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:00,055 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796319871_0001_00_000001
2016-01-14 18:32:00,056 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:00,056 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319871_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:00,057 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796319871_0001_00_000001, launchTime=1452796320056
2016-01-14 18:32:00,056 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:00,058 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796319871_0001_00_000001
2016-01-14 18:32:00,059 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796319871_0001_1_00_000000_0] to container: [container_1452796319871_0001_00_000001]
2016-01-14 18:32:00,059 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319871_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:00,060 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796319871_0001_00_000001 given task: attempt_1452796319871_0001_1_00_000000_0
2016-01-14 18:32:00,060 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796319871_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796319871_0001_1_00_000000_0
2016-01-14 18:32:00,060 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796319871_0001_1_00_000000_0] started. Is using containerId: [container_1452796319871_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:00,061 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:00,061 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BCB66E9C1979408C935B6202CB9AB51C, taskAttemptId=attempt_1452796319871_0001_1_00_000000_0, startTime=1452796320060, containerId=container_1452796319871_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796319871_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:00,061 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796319871_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:00,062 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796319871_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:00 Starting to run new task attempt: attempt_1452796319871_0001_1_00_000000_0
2016-01-14 18:32:00,063 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796319871_0001_1_00_000000_0
2016-01-14 18:32:00,063 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:00,063 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:00,063 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:00,064 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796319871_0001, with dag id: dag_1452796319871_0001_1
2016-01-14 18:32:00,064 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:00,064 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:00,065 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:00,065 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS, VertexName: BCB66E9C1979408C935B6202CB9AB51C, VertexParallelism: 1, TaskAttemptID:attempt_1452796319871_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=768D103745C840BCB6F4BDC5C154F73B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1E7136BD6DF941A99F2AB2F43A03AC64, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:00,065 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:00,068 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796319871_0001_1_00_000000_0
2016-01-14 18:32:00,068 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:00,069 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:00,071 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:00,071 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=1E7136BD6DF941A99F2AB2F43A03AC64, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:00,072 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:00,072 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=768D103745C840BCB6F4BDC5C154F73B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:00,071 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796319871_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:00,074 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:00,073 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:00,072 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 1E7136BD6DF941A99F2AB2F43A03AC64
2016-01-14 18:32:00,076 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:00,076 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 1E7136BD6DF941A99F2AB2F43A03AC64
2016-01-14 18:32:00,075 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 768D103745C840BCB6F4BDC5C154F73B
2016-01-14 18:32:00,077 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 768D103745C840BCB6F4BDC5C154F73B
2016-01-14 18:32:00,079 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:00,080 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 768D103745C840BCB6F4BDC5C154F73B
2016-01-14 18:32:00,080 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 768D103745C840BCB6F4BDC5C154F73B
2016-01-14 18:32:00,084 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BCB66E9C1979408C935B6202CB9AB51C, ordinal: 0
2016-01-14 18:32:00,084 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BCB66E9C1979408C935B6202CB9AB51C, mem on start (mb), free: 163, total: 384, max: 672
2016-01-14 18:32:00,084 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:00,085 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:00,085 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:00,089 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:00,089 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 1E7136BD6DF941A99F2AB2F43A03AC64
2016-01-14 18:32:00,089 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:00,089 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:00,090 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:00,090 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:00,091 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:00,091 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:00,091 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:00,091 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:00,092 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 1E7136BD6DF941A99F2AB2F43A03AC64, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:00,092 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 768D103745C840BCB6F4BDC5C154F73B, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:00,092 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:00,092 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 768D103745C840BCB6F4BDC5C154F73B
2016-01-14 18:32:00,092 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:00,092 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 768D103745C840BCB6F4BDC5C154F73B
2016-01-14 18:32:00,093 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 768D103745C840BCB6F4BDC5C154F73B being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:00,093 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:00,094 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:00,094 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:00,094 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796319871_0001_1_00_000000_0
2016-01-14 18:32:00,095 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:00,097 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@63bd6e3d
2016-01-14 18:32:00,098 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@63bd6e3d
2016-01-14 18:32:00,098 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:00,100 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 768D103745C840BCB6F4BDC5C154F73B
2016-01-14 18:32:00,100 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"], id: 1E7136BD6DF941A99F2AB2F43A03AC64
2016-01-14 18:32:00,100 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"]
2016-01-14 18:32:00,101 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:00,101 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:00,100 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:00,101 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:00,101 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BCB66E9C1979408C935B6202CB9AB51C, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:00,115 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:00,116 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:00,116 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796319871_0001_1_00_000000_0
2016-01-14 18:32:00,116 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796319871_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:00,117 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796319871_0001_1_00_000000_0
2016-01-14 18:32:00,117 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BCB66E9C1979408C935B6202CB9AB51C, mem on close (mb), free: 161, total: 384, max: 672
2016-01-14 18:32:00 Completed running task attempt: attempt_1452796319871_0001_1_00_000000_0
2016-01-14 18:32:00,118 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796319871_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:00,119 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796320102, Process_Duration=15, Process_End_Time=1452796320117, Read_Duration=12, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:00,120 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:00,120 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:00,120 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BCB66E9C1979408C935B6202CB9AB51C, taskAttemptId=attempt_1452796319871_0001_1_00_000000_0, startTime=1452796320060, finishTime=1452796320119, timeTaken=59, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796320102, Process_Duration=15, Process_End_Time=1452796320117, Read_Duration=12, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:00,120 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796319871_0001_00_000001
2016-01-14 18:32:00,120 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796319871_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:00,120 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:00,120 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796319871_0001_1_00_000000_0
2016-01-14 18:32:00,121 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:00,122 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:TASK_FINISHED]: vertexName=BCB66E9C1979408C935B6202CB9AB51C, taskId=task_1452796319871_0001_1_00_000000, startTime=1452796320060, finishTime=1452796320121, timeTaken=61, status=SUCCEEDED, successfulAttemptID=attempt_1452796319871_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796320102, Process_Duration=15, Process_End_Time=1452796320117, Read_Duration=12, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:00,122 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:00,122 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796319871_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:00,122 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C] : 1
2016-01-14 18:32:00,122 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,123 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:00,124 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:VERTEX_FINISHED]: vertexName=BCB66E9C1979408C935B6202CB9AB51C, vertexId=vertex_1452796319871_0001_1_00, initRequestedTime=1452796320036, initedTime=1452796320047, startRequestedTime=1452796320048, startedTime=1452796320048, finishTime=1452796320122, timeTaken=74, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796320102, Process_Duration=15, Process_End_Time=1452796320117, Read_Duration=12, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796320060, firstTasksToStart=[ task_1452796319871_0001_1_00_000000 ], lastTaskFinishTime=1452796320119, lastTasksToFinish=[ task_1452796319871_0001_1_00_000000 ], minTaskDuration=59, maxTaskDuration=59, avgTaskDuration=59.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796319871_0001_1_00_000000 ], longestDurationTasks=[ task_1452796319871_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:00,124 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:00,124 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319871_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:00,124 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796319871_0001_00_000001, stoppedTime=1452796320124, exitStatus=0
2016-01-14 18:32:00,124 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:00,124 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319871_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:00,124 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:00,125 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796319871_0001_1
2016-01-14 18:32:00,125 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796319871_0001_1
2016-01-14 18:32:00,125 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 1E7136BD6DF941A99F2AB2F43A03AC64 for vertex: vertex_1452796319871_0001_1_00 [BCB66E9C1979408C935B6202CB9AB51C]
2016-01-14 18:32:00,131 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796319871_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:00,131 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796319871_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:00,131 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796319871_0001_00_000001, Exiting
2016-01-14 18:32:00,131 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796319871_0001_00_000001
2016-01-14 18:32:00,131 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796319871_0001_00_000001
2016-01-14 18:32:00,133 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796319871_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:00,134 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796319871_0001_00_000001 completed successfully
2016-01-14 18:32:00,135 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796319871_0001_1, queueSize=0
2016-01-14 18:32:00,135 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:00,136 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796319871_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796319871_0001_1, startTime=1452796320035, finishTime=1452796320134, timeTaken=99, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796320102, Process_Duration=15, Process_End_Time=1452796320117, Read_Duration=12, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:00,136 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796319871_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:00,136 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796319871_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:00,137 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796319871_0001_00_000001
2016-01-14 18:32:00,137 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796319871_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:00 Completed Dag: dag_1452796319871_0001_1
2016-01-14 18:32:00,138 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796319871_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:00,138 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796319871_0001_1_post
2016-01-14 18:32:00,138 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:00,138 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:00,143 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452796319871_0001
2016-01-14 18:32:00,145 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:00,145 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:00,146 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:00,146 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:00,146 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:00,146 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:00,146 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:00,147 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:00,147 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:00,147 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:00,147 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:00,148 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:00,148 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:00,152 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/66662D3F36B94A529583EE7E767A074F/FBA80F5EA450418A9A4D582085DBAF2E/.tez/application_1452796319871_0001
2016-01-14 18:32:00,152 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.301
2016-01-14 18:32:00,183 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:00,183 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:00,231 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_RESULTS
2016-01-14 18:32:00,275 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:00,275 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:00,310 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.005
2016-01-14 18:32:00,313 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.008
2016-01-14 18:32:00,313 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:00,314 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:00,314 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_ALL
2016-01-14 18:32:00,337 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:00,338 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:00,379 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 18:32:00,382 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 18:32:00,382 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:00,382 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:00,383 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:00,398 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:00,399 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1
2016-01-14 18:32:00,410 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:00,410 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:00,410 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"]
2016-01-14 18:32:00,410 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:00,410 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:00,411 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:00,411 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 18:32:00,412 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:00,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:00,433 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:00,434 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:00,434 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:00,445 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22/.tez/application_1452796320434_0001 doesn't exist and is created
2016-01-14 18:32:00,461 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:00,462 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:00,462 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22/.tez/application_1452796320434_0001
2016-01-14 18:32:00,465 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796320434_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:00,478 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:00,479 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:00,481 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:00,481 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:00,482 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22/.tez/application_1452796320434_0001/localmode-log-dir
2016-01-14 18:32:00,482 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22/.tez/application_1452796320434_0001/localmode-log-dir/history.txt.appattempt_1452796320434_0001_000000, maxErrors=10
2016-01-14 18:32:00,482 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:00,483 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796320434_0001_000000, appSubmitTime=1452796320464, launchTime=1452796320464
2016-01-14 18:32:00,489 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:00,491 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:00,492 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:00,492 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:00,501 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:48319
2016-01-14 18:32:00,503 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:00,505 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796320434_0001_000000, startTime=1452796320505
2016-01-14 18:32:00,505 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:00,505 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:00,562 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:00,562 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:00,563 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452796320434_0001, dagName=[0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 18:32:00,584 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 18:32:00,586 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796320434_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22/.tez/application_1452796320434_0001/localmode-log-dir/dag_1452796320434_0001_1.dot
2016-01-14 18:32:00,586 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22/.tez/application_1452796320434_0001/localmode-log-dir/dag_1452796320434_0001_1-tez-dag.pb.txt
2016-01-14 18:32:00,592 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796320434_0001_1
2016-01-14 18:32:00,592 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:00,592 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 18:32:00 Running Dag: dag_1452796320434_0001_1
2016-01-14 18:32:00,602 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796320434_0001_1, submitTime=1452796320584
2016-01-14 18:32:00,602 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:00,603 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D2AF9E2A7C3E4C1CB7BDC093CCEB71B7
2016-01-14 18:32:00,603 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:00,603 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796320434_0001_1, initTime=1452796320602
2016-01-14 18:32:00,603 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:00,604 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796320434_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:00,605 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:DAG_STARTED]: dagID=dag_1452796320434_0001_1, startTime=1452796320605
2016-01-14 18:32:00,605 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:00,605 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452796320434_0001, dagName=[0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 18:32:00,605 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:00,606 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796320434_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:00,606 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D2AF9E2A7C3E4C1CB7BDC093CCEB71B7 : {B0080C09BD6A4CECA3CE4E2ED0AFDC6C={InputName=B0080C09BD6A4CECA3CE4E2ED0AFDC6C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:00,606 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: B0080C09BD6A4CECA3CE4E2ED0AFDC6C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:00,606 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,606 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,606 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,607 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]. Starting root input initializers: 1
2016-01-14 18:32:00,607 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:00,608 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: B0080C09BD6A4CECA3CE4E2ED0AFDC6C on vertex vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,610 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:00,610 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input B0080C09BD6A4CECA3CE4E2ED0AFDC6C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:00,610 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:00,610 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:00,613 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:00,613 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: B0080C09BD6A4CECA3CE4E2ED0AFDC6C on vertex vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,614 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:00,614 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {B0080C09BD6A4CECA3CE4E2ED0AFDC6C=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:00,614 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7] parallelism set to 1
2016-01-14 18:32:00,614 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:00,615 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796320434_0001_1_00, eventCount=1
2016-01-14 18:32:00,615 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,615 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=32B55986E96841E7BA1EB6A3C31C9A8B, vertexId=vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:00,615 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=32B55986E96841E7BA1EB6A3C31C9A8B, vertexId=vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,617 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=32B55986E96841E7BA1EB6A3C31C9A8B, vertexName=D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:00,617 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=32B55986E96841E7BA1EB6A3C31C9A8B, vertexId=vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,618 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:00,619 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, vertexId=vertex_1452796320434_0001_1_00, initRequestedTime=1452796320606, initedTime=1452796320618, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:00,619 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7] with distanceFromRoot: 0
2016-01-14 18:32:00,619 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:00,619 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D2AF9E2A7C3E4C1CB7BDC093CCEB71B7
2016-01-14 18:32:00,619 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,620 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:00,620 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796320434_0001_1_00, startRequestedTime=1452796320619, startedTime=1452796320619
2016-01-14 18:32:00,620 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:00,621 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:00,621 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:TASK_STARTED]: vertexName=D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, taskId=task_1452796320434_0001_1_00_000000, scheduledTime=1452796320620, launchTime=1452796320620
2016-01-14 18:32:00,621 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796320434_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:00,621 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,622 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1, VertexName: D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, VertexParallelism: 1, TaskAttemptID:attempt_1452796320434_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B0080C09BD6A4CECA3CE4E2ED0AFDC6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=32B55986E96841E7BA1EB6A3C31C9A8B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:00,622 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796320434_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:00,622 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:00,623 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:00,624 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:00,624 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796320434_0001, with dag id: dag_1452796320434_0001_1
2016-01-14 18:32:00,624 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:00,625 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796320434_0001_00_000001
2016-01-14 18:32:00,626 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320434_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:00,630 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796320434_0001_00_000001
2016-01-14 18:32:00,630 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:00,631 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320434_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:00,632 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:00,632 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796320434_0001_00_000001, launchTime=1452796320631
2016-01-14 18:32:00,633 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796320434_0001_00_000001
2016-01-14 18:32:00,634 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796320434_0001_1_00_000000_0] to container: [container_1452796320434_0001_00_000001]
2016-01-14 18:32:00,634 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320434_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:00,634 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796320434_0001_1_00_000000_0] started. Is using containerId: [container_1452796320434_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:00,635 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796320434_0001_00_000001 given task: attempt_1452796320434_0001_1_00_000000_0
2016-01-14 18:32:00,635 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:00,636 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796320434_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796320434_0001_1_00_000000_0
2016-01-14 18:32:00,636 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, taskAttemptId=attempt_1452796320434_0001_1_00_000000_0, startTime=1452796320634, containerId=container_1452796320434_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796320434_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:00,636 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796320434_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:00 Starting to run new task attempt: attempt_1452796320434_0001_1_00_000000_0
2016-01-14 18:32:00,636 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796320434_0001_1_00_000000_0
2016-01-14 18:32:00,637 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:00,637 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:00,637 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:00,637 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:00,637 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:00,638 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:00,638 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1, VertexName: D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, VertexParallelism: 1, TaskAttemptID:attempt_1452796320434_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B0080C09BD6A4CECA3CE4E2ED0AFDC6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=32B55986E96841E7BA1EB6A3C31C9A8B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:00,638 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:00,638 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796320434_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:00,639 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796320434_0001_1_00_000000_0
2016-01-14 18:32:00,639 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:00,639 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:00,640 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796320434_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:00,640 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=B0080C09BD6A4CECA3CE4E2ED0AFDC6C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:00,641 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:00,641 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=32B55986E96841E7BA1EB6A3C31C9A8B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:00,641 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:00,642 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: B0080C09BD6A4CECA3CE4E2ED0AFDC6C
2016-01-14 18:32:00,642 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:00,642 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 32B55986E96841E7BA1EB6A3C31C9A8B
2016-01-14 18:32:00,643 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:00,642 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: B0080C09BD6A4CECA3CE4E2ED0AFDC6C
2016-01-14 18:32:00,643 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 32B55986E96841E7BA1EB6A3C31C9A8B
2016-01-14 18:32:00,647 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:00,647 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: B0080C09BD6A4CECA3CE4E2ED0AFDC6C
2016-01-14 18:32:00,648 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: B0080C09BD6A4CECA3CE4E2ED0AFDC6C
2016-01-14 18:32:00,648 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:00,656 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, ordinal: 0
2016-01-14 18:32:00,656 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, mem on start (mb), free: 264, total: 386, max: 672
2016-01-14 18:32:00,656 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:00,657 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:00,657 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:00,657 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:00,659 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 32B55986E96841E7BA1EB6A3C31C9A8B
2016-01-14 18:32:00,659 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:00,659 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:00,660 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:00,660 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:00,660 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:00,660 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:00,661 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:00,661 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:00,661 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, B0080C09BD6A4CECA3CE4E2ED0AFDC6C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:00,661 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 32B55986E96841E7BA1EB6A3C31C9A8B, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:00,662 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:00,662 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: B0080C09BD6A4CECA3CE4E2ED0AFDC6C being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:00,662 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: B0080C09BD6A4CECA3CE4E2ED0AFDC6C
2016-01-14 18:32:00,662 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:00,662 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: B0080C09BD6A4CECA3CE4E2ED0AFDC6C
2016-01-14 18:32:00,662 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:00,663 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:00,663 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:00,663 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796320434_0001_1_00_000000_0
2016-01-14 18:32:00,663 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:00,665 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@249d6d0e
2016-01-14 18:32:00,666 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@249d6d0e
2016-01-14 18:32:00,666 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:00,666 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:00,667 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:00,668 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: B0080C09BD6A4CECA3CE4E2ED0AFDC6C
2016-01-14 18:32:00,668 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"], id: 32B55986E96841E7BA1EB6A3C31C9A8B
2016-01-14 18:32:00,668 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"]
2016-01-14 18:32:00,669 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:00,669 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:00,669 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:00,673 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:00,673 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:00,674 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796320434_0001_1_00_000000_0
2016-01-14 18:32:00,674 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796320434_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:00,675 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796320434_0001_1_00_000000_0
2016-01-14 18:32:00,675 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, mem on close (mb), free: 262, total: 386, max: 672
2016-01-14 18:32:00 Completed running task attempt: attempt_1452796320434_0001_1_00_000000_0
2016-01-14 18:32:00,676 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796320434_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:00,677 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796320670, Process_Duration=5, Process_End_Time=1452796320675, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:00,677 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:00,678 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:00,678 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:00,679 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796320434_0001_00_000001
2016-01-14 18:32:00,678 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, taskAttemptId=attempt_1452796320434_0001_1_00_000000_0, startTime=1452796320634, finishTime=1452796320677, timeTaken=43, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796320670, Process_Duration=5, Process_End_Time=1452796320675, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:00,679 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796320434_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:00,680 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:00,680 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796320434_0001_1_00_000000_0
2016-01-14 18:32:00,680 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:00,681 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:TASK_FINISHED]: vertexName=D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, taskId=task_1452796320434_0001_1_00_000000, startTime=1452796320634, finishTime=1452796320680, timeTaken=46, status=SUCCEEDED, successfulAttemptID=attempt_1452796320434_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796320670, Process_Duration=5, Process_End_Time=1452796320675, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:00,681 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796320434_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:00,681 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7] : 1
2016-01-14 18:32:00,681 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,682 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:00,682 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:VERTEX_FINISHED]: vertexName=D2AF9E2A7C3E4C1CB7BDC093CCEB71B7, vertexId=vertex_1452796320434_0001_1_00, initRequestedTime=1452796320606, initedTime=1452796320618, startRequestedTime=1452796320619, startedTime=1452796320619, finishTime=1452796320681, timeTaken=62, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796320670, Process_Duration=5, Process_End_Time=1452796320675, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796320634, firstTasksToStart=[ task_1452796320434_0001_1_00_000000 ], lastTaskFinishTime=1452796320677, lastTasksToFinish=[ task_1452796320434_0001_1_00_000000 ], minTaskDuration=43, maxTaskDuration=43, avgTaskDuration=43.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796320434_0001_1_00_000000 ], longestDurationTasks=[ task_1452796320434_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:00,683 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:00,683 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320434_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:00,683 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796320434_0001_00_000001, stoppedTime=1452796320683, exitStatus=0
2016-01-14 18:32:00,683 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:00,683 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320434_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:00,683 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:00,683 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796320434_0001_1
2016-01-14 18:32:00,684 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796320434_0001_1
2016-01-14 18:32:00,684 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 32B55986E96841E7BA1EB6A3C31C9A8B for vertex: vertex_1452796320434_0001_1_00 [D2AF9E2A7C3E4C1CB7BDC093CCEB71B7]
2016-01-14 18:32:00,690 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796320434_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:00,690 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796320434_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:00,690 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796320434_0001_00_000001, Exiting
2016-01-14 18:32:00,690 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796320434_0001_00_000001
2016-01-14 18:32:00,691 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796320434_0001_00_000001
2016-01-14 18:32:00,692 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796320434_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:00,693 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796320434_0001_00_000001 completed successfully
2016-01-14 18:32:00,693 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796320434_0001_1, queueSize=0
2016-01-14 18:32:00,693 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:00,694 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320434_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796320434_0001_1, startTime=1452796320605, finishTime=1452796320691, timeTaken=86, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796320670, Process_Duration=5, Process_End_Time=1452796320675, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:00,694 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796320434_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:00,694 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796320434_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:00,695 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796320434_0001_00_000001
2016-01-14 18:32:00,695 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320434_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:00 Completed Dag: dag_1452796320434_0001_1
2016-01-14 18:32:00,696 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796320434_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:00,696 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796320434_0001_1_post
2016-01-14 18:32:00,696 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:00,696 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:00,701 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452796320434_0001
2016-01-14 18:32:00,703 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:00,703 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:00,703 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:00,703 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:00,704 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:00,704 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:00,704 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:00,705 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:00,705 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:00,705 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:00,706 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:00,706 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:00,707 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:00,711 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/0A4811256F024D8F82A1B94B413681A0/A301F1838F584F02A6E076C021341B22/.tez/application_1452796320434_0001
2016-01-14 18:32:00,711 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.301
2016-01-14 18:32:00,784 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_-1
2016-01-14 18:32:00,809 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:00,810 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:00,847 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.010
2016-01-14 18:32:00,853 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 18:32:00,854 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:00,854 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:00,855 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:00,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:00,872 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'
2016-01-14 18:32:00,882 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:00,882 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:00,882 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"]
2016-01-14 18:32:00,883 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:00,883 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:00,883 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:00,883 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 18:32:00,884 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:00,892 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:00,892 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:00,898 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:00,903 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:00,903 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:00,903 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:00,912 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03/.tez/application_1452796320903_0001 doesn't exist and is created
2016-01-14 18:32:00,927 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:00,928 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:00,928 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03/.tez/application_1452796320903_0001
2016-01-14 18:32:00,931 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796320903_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:00,952 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:00,954 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:00,956 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:00,956 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:00,957 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03/.tez/application_1452796320903_0001/localmode-log-dir
2016-01-14 18:32:00,957 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03/.tez/application_1452796320903_0001/localmode-log-dir/history.txt.appattempt_1452796320903_0001_000000, maxErrors=10
2016-01-14 18:32:00,957 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:00,957 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796320903_0001_000000, appSubmitTime=1452796320930, launchTime=1452796320930
2016-01-14 18:32:00,963 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:51148
2016-01-14 18:32:00,964 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:00,966 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:00,967 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:00,967 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:00,968 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:00,970 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796320903_0001_000000, startTime=1452796320970
2016-01-14 18:32:00,970 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:00,970 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:01,028 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:01,028 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:01,028 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452796320903_0001, dagName=[AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 18:32:01,047 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 18:32:01,049 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796320903_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03/.tez/application_1452796320903_0001/localmode-log-dir/dag_1452796320903_0001_1.dot
2016-01-14 18:32:01,049 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03/.tez/application_1452796320903_0001/localmode-log-dir/dag_1452796320903_0001_1-tez-dag.pb.txt
2016-01-14 18:32:01,057 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796320903_0001_1
2016-01-14 18:32:01,057 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:01,058 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 18:32:01 Running Dag: dag_1452796320903_0001_1
2016-01-14 18:32:01,068 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796320903_0001_1, submitTime=1452796321047
2016-01-14 18:32:01,068 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:01,068 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex CCBDE210EFFA491A8C49F8BA45977ABD
2016-01-14 18:32:01,069 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:01,069 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:01,070 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796320903_0001_1, initTime=1452796321068
2016-01-14 18:32:01,070 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796320903_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:01,071 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:DAG_STARTED]: dagID=dag_1452796320903_0001_1, startTime=1452796321070
2016-01-14 18:32:01,071 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:01,071 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796320903_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:01,071 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: CCBDE210EFFA491A8C49F8BA45977ABD : {A66A7B13110A4D1F9C6BE7791F126047={InputName=A66A7B13110A4D1F9C6BE7791F126047}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:01,071 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: A66A7B13110A4D1F9C6BE7791F126047, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:01,072 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,072 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,072 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,072 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452796320903_0001, dagName=[AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 18:32:01,071 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:01,072 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]. Starting root input initializers: 1
2016-01-14 18:32:01,074 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:01,075 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: A66A7B13110A4D1F9C6BE7791F126047 on vertex vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,077 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:01,077 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input A66A7B13110A4D1F9C6BE7791F126047 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:01,077 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:01,078 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:01,080 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:01,080 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: A66A7B13110A4D1F9C6BE7791F126047 on vertex vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,081 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:01,081 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {A66A7B13110A4D1F9C6BE7791F126047=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:01,081 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD] parallelism set to 1
2016-01-14 18:32:01,081 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:01,081 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796320903_0001_1_00, eventCount=1
2016-01-14 18:32:01,082 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,082 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=A796E3F8AEFB43A59F38825DF432A095, vertexId=vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:01,082 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=A796E3F8AEFB43A59F38825DF432A095, vertexId=vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,084 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=A796E3F8AEFB43A59F38825DF432A095, vertexName=CCBDE210EFFA491A8C49F8BA45977ABD, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:01,084 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=A796E3F8AEFB43A59F38825DF432A095, vertexId=vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,085 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:01,085 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:VERTEX_INITIALIZED]: vertexName=CCBDE210EFFA491A8C49F8BA45977ABD, vertexId=vertex_1452796320903_0001_1_00, initRequestedTime=1452796321071, initedTime=1452796321085, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:01,086 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD] with distanceFromRoot: 0
2016-01-14 18:32:01,086 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:01,086 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in CCBDE210EFFA491A8C49F8BA45977ABD
2016-01-14 18:32:01,086 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,087 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:01,087 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796320903_0001_1_00, startRequestedTime=1452796321086, startedTime=1452796321086
2016-01-14 18:32:01,088 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:01,088 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:01,088 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:TASK_STARTED]: vertexName=CCBDE210EFFA491A8C49F8BA45977ABD, taskId=task_1452796320903_0001_1_00_000000, scheduledTime=1452796321088, launchTime=1452796321088
2016-01-14 18:32:01,089 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796320903_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:01,089 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,089 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03] every.every/(1/1) ...SULTS.0_'field2'_'field2', VertexName: CCBDE210EFFA491A8C49F8BA45977ABD, VertexParallelism: 1, TaskAttemptID:attempt_1452796320903_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A66A7B13110A4D1F9C6BE7791F126047, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A796E3F8AEFB43A59F38825DF432A095, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:01,090 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796320903_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:01,090 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:01,089 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796320903_0001, with dag id: dag_1452796320903_0001_1
2016-01-14 18:32:01,092 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:01,092 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:01,092 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:01,093 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796320903_0001_00_000001
2016-01-14 18:32:01,093 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320903_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:01,095 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796320903_0001_00_000001
2016-01-14 18:32:01,095 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:01,096 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320903_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:01,096 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796320903_0001_00_000001, launchTime=1452796321096
2016-01-14 18:32:01,096 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:01,097 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796320903_0001_00_000001
2016-01-14 18:32:01,098 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796320903_0001_1_00_000000_0] to container: [container_1452796320903_0001_00_000001]
2016-01-14 18:32:01,098 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320903_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:01,098 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796320903_0001_00_000001 given task: attempt_1452796320903_0001_1_00_000000_0
2016-01-14 18:32:01,098 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796320903_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796320903_0001_1_00_000000_0
2016-01-14 18:32:01,099 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796320903_0001_1_00_000000_0] started. Is using containerId: [container_1452796320903_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:01 Starting to run new task attempt: attempt_1452796320903_0001_1_00_000000_0
2016-01-14 18:32:01,099 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796320903_0001_1_00_000000_0
2016-01-14 18:32:01,099 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:01,099 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:01,099 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:01,099 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:01,099 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:01,099 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:01,099 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=CCBDE210EFFA491A8C49F8BA45977ABD, taskAttemptId=attempt_1452796320903_0001_1_00_000000_0, startTime=1452796321098, containerId=container_1452796320903_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796320903_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:01,100 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:01,100 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03] every.every/(1/1) ...SULTS.0_'field2'_'field2', VertexName: CCBDE210EFFA491A8C49F8BA45977ABD, VertexParallelism: 1, TaskAttemptID:attempt_1452796320903_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A66A7B13110A4D1F9C6BE7791F126047, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A796E3F8AEFB43A59F38825DF432A095, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:01,100 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:01,101 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796320903_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:01,101 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796320903_0001_1_00_000000_0
2016-01-14 18:32:01,102 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:01,102 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:01,101 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796320903_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:01,102 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796320903_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:01,103 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:01,103 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=A66A7B13110A4D1F9C6BE7791F126047, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:01,103 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:01,103 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: A66A7B13110A4D1F9C6BE7791F126047
2016-01-14 18:32:01,103 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: A66A7B13110A4D1F9C6BE7791F126047
2016-01-14 18:32:01,104 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=A796E3F8AEFB43A59F38825DF432A095, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:01,106 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:01,106 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:01,106 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: A66A7B13110A4D1F9C6BE7791F126047
2016-01-14 18:32:01,107 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: A66A7B13110A4D1F9C6BE7791F126047
2016-01-14 18:32:01,111 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:01,111 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: A796E3F8AEFB43A59F38825DF432A095
2016-01-14 18:32:01,111 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:01,111 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: A796E3F8AEFB43A59F38825DF432A095
2016-01-14 18:32:01,121 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:01,121 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: A796E3F8AEFB43A59F38825DF432A095
2016-01-14 18:32:01,121 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: CCBDE210EFFA491A8C49F8BA45977ABD, ordinal: 0
2016-01-14 18:32:01,122 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CCBDE210EFFA491A8C49F8BA45977ABD, mem on start (mb), free: 173, total: 386, max: 672
2016-01-14 18:32:01,123 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:01,123 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:01,124 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:01,124 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:01,125 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:01,125 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:01,125 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:01,125 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:01,125 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:01,125 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:01,126 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:01,126 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, A66A7B13110A4D1F9C6BE7791F126047, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:01,126 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, A796E3F8AEFB43A59F38825DF432A095, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:01,126 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:01,127 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: A66A7B13110A4D1F9C6BE7791F126047 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:01,127 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: A66A7B13110A4D1F9C6BE7791F126047
2016-01-14 18:32:01,127 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:01,127 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: A66A7B13110A4D1F9C6BE7791F126047
2016-01-14 18:32:01,127 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:01,127 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:01,127 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:01,128 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796320903_0001_1_00_000000_0
2016-01-14 18:32:01,128 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:01,128 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@3e03e829
2016-01-14 18:32:01,129 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@3e03e829
2016-01-14 18:32:01,129 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:01,129 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:01,133 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:01,134 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: A66A7B13110A4D1F9C6BE7791F126047
2016-01-14 18:32:01,134 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"], id: A796E3F8AEFB43A59F38825DF432A095
2016-01-14 18:32:01,135 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"]
2016-01-14 18:32:01,135 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:01,136 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:01,136 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: CCBDE210EFFA491A8C49F8BA45977ABD, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:01,138 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:01,139 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:01,139 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796320903_0001_1_00_000000_0
2016-01-14 18:32:01,140 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796320903_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:01,140 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796320903_0001_1_00_000000_0
2016-01-14 18:32:01,141 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CCBDE210EFFA491A8C49F8BA45977ABD, mem on close (mb), free: 171, total: 386, max: 672
2016-01-14 18:32:01 Completed running task attempt: attempt_1452796320903_0001_1_00_000000_0
2016-01-14 18:32:01,142 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796320903_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:01,143 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796321136, Process_Duration=4, Process_End_Time=1452796321140, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:01,143 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:01,143 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:01,143 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:01,143 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=CCBDE210EFFA491A8C49F8BA45977ABD, taskAttemptId=attempt_1452796320903_0001_1_00_000000_0, startTime=1452796321098, finishTime=1452796321143, timeTaken=45, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796321136, Process_Duration=4, Process_End_Time=1452796321140, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:01,143 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796320903_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:01,144 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796320903_0001_1_00_000000_0
2016-01-14 18:32:01,144 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796320903_0001_00_000001
2016-01-14 18:32:01,144 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:01,144 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:01,144 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:TASK_FINISHED]: vertexName=CCBDE210EFFA491A8C49F8BA45977ABD, taskId=task_1452796320903_0001_1_00_000000, startTime=1452796321098, finishTime=1452796321144, timeTaken=46, status=SUCCEEDED, successfulAttemptID=attempt_1452796320903_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796321136, Process_Duration=4, Process_End_Time=1452796321140, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:01,145 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796320903_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:01,145 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD] : 1
2016-01-14 18:32:01,145 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,146 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:01,146 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:VERTEX_FINISHED]: vertexName=CCBDE210EFFA491A8C49F8BA45977ABD, vertexId=vertex_1452796320903_0001_1_00, initRequestedTime=1452796321071, initedTime=1452796321085, startRequestedTime=1452796321086, startedTime=1452796321086, finishTime=1452796321145, timeTaken=59, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796321136, Process_Duration=4, Process_End_Time=1452796321140, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796321098, firstTasksToStart=[ task_1452796320903_0001_1_00_000000 ], lastTaskFinishTime=1452796321143, lastTasksToFinish=[ task_1452796320903_0001_1_00_000000 ], minTaskDuration=45, maxTaskDuration=45, avgTaskDuration=45.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796320903_0001_1_00_000000 ], longestDurationTasks=[ task_1452796320903_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:01,146 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:01,146 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320903_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:01,147 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796320903_0001_00_000001, stoppedTime=1452796321147, exitStatus=0
2016-01-14 18:32:01,147 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:01,147 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320903_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:01,147 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:01,147 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796320903_0001_1
2016-01-14 18:32:01,148 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796320903_0001_1
2016-01-14 18:32:01,148 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: A796E3F8AEFB43A59F38825DF432A095 for vertex: vertex_1452796320903_0001_1_00 [CCBDE210EFFA491A8C49F8BA45977ABD]
2016-01-14 18:32:01,154 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796320903_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:01,154 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796320903_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:01,154 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796320903_0001_00_000001, Exiting
2016-01-14 18:32:01,154 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796320903_0001_00_000001
2016-01-14 18:32:01,155 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796320903_0001_00_000001
2016-01-14 18:32:01,156 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796320903_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:01,156 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796320903_0001_1, queueSize=0
2016-01-14 18:32:01,157 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:01,156 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796320903_0001_00_000001 completed successfully
2016-01-14 18:32:01,157 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796320903_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796320903_0001_1, startTime=1452796321070, finishTime=1452796321154, timeTaken=84, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796321136, Process_Duration=4, Process_End_Time=1452796321140, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:01,157 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796320903_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:01,158 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796320903_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:01,158 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796320903_0001_00_000001
2016-01-14 18:32:01,158 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796320903_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:01 Completed Dag: dag_1452796320903_0001_1
2016-01-14 18:32:01,158 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796320903_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:01,159 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796320903_0001_1_post
2016-01-14 18:32:01,159 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:01,159 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:01,164 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452796320903_0001
2016-01-14 18:32:01,166 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:01,166 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:01,166 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:01,167 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:01,167 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:01,167 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:01,167 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:01,168 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:01,169 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:01,169 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:01,169 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:01,170 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:01,170 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:01,173 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/AEE4520CD55A4A9986281B340D220482/BFDFD082E0D347498249F9239852CE03/.tez/application_1452796320903_0001
2016-01-14 18:32:01,174 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.291
2016-01-14 18:32:01,246 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_'field2'
2016-01-14 18:32:01,269 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:01,270 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:01,323 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 18:32:01,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 18:32:01,329 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:01,329 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:01,329 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:01,346 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:01,347 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS
2016-01-14 18:32:01,357 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:01,357 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:01,357 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"]
2016-01-14 18:32:01,358 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:01,358 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:01,358 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:01,359 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 18:32:01,359 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:01,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:01,377 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:01,377 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:01,378 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:01,386 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB/.tez/application_1452796321377_0001 doesn't exist and is created
2016-01-14 18:32:01,403 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:01,403 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:01,404 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB/.tez/application_1452796321377_0001
2016-01-14 18:32:01,406 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796321377_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:01,418 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:01,419 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:01,420 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:01,420 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:01,421 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB/.tez/application_1452796321377_0001/localmode-log-dir
2016-01-14 18:32:01,421 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB/.tez/application_1452796321377_0001/localmode-log-dir/history.txt.appattempt_1452796321377_0001_000000, maxErrors=10
2016-01-14 18:32:01,421 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:01,422 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796321377_0001_000000, appSubmitTime=1452796321406, launchTime=1452796321406
2016-01-14 18:32:01,427 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:01,429 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:01,430 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:01,430 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:01,434 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:41198
2016-01-14 18:32:01,436 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:01,439 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796321377_0001_000000, startTime=1452796321439
2016-01-14 18:32:01,439 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:01,439 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:01,504 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:01,504 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:01,504 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452796321377_0001, dagName=[CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 18:32:01,522 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 18:32:01,524 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796321377_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB/.tez/application_1452796321377_0001/localmode-log-dir/dag_1452796321377_0001_1.dot
2016-01-14 18:32:01,524 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB/.tez/application_1452796321377_0001/localmode-log-dir/dag_1452796321377_0001_1-tez-dag.pb.txt
2016-01-14 18:32:01,533 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:01,533 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:01,538 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796321377_0001_1
2016-01-14 18:32:01,538 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:01,538 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 18:32:01 Running Dag: dag_1452796321377_0001_1
2016-01-14 18:32:01,549 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796321377_0001_1, submitTime=1452796321522
2016-01-14 18:32:01,549 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:01,549 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex EB348CE9B44B4FF6BC130D2A69F595FB
2016-01-14 18:32:01,549 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:01,550 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796321377_0001_1, initTime=1452796321549
2016-01-14 18:32:01,550 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796321377_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:01,551 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:DAG_STARTED]: dagID=dag_1452796321377_0001_1, startTime=1452796321551
2016-01-14 18:32:01,551 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:01,551 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796321377_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:01,551 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:01,552 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: EB348CE9B44B4FF6BC130D2A69F595FB : {BCC37B89EA8348EA9B704E2B60A32925={InputName=BCC37B89EA8348EA9B704E2B60A32925}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:01,552 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: BCC37B89EA8348EA9B704E2B60A32925, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:01,552 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,552 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:01,552 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,553 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,553 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]. Starting root input initializers: 1
2016-01-14 18:32:01,554 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:01,556 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: BCC37B89EA8348EA9B704E2B60A32925 on vertex vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,557 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452796321377_0001, dagName=[CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 18:32:01,560 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:01,560 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input BCC37B89EA8348EA9B704E2B60A32925 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:01,560 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:01,561 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:01,564 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:01,564 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: BCC37B89EA8348EA9B704E2B60A32925 on vertex vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,564 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:01,564 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {BCC37B89EA8348EA9B704E2B60A32925=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:01,565 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB] parallelism set to 1
2016-01-14 18:32:01,565 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:01,565 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796321377_0001_1_00, eventCount=1
2016-01-14 18:32:01,565 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,565 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=0610409B9E9B4675AF9665C380D31FA0, vertexId=vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:01,566 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=0610409B9E9B4675AF9665C380D31FA0, vertexId=vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,568 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=0610409B9E9B4675AF9665C380D31FA0, vertexName=EB348CE9B44B4FF6BC130D2A69F595FB, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:01,568 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=0610409B9E9B4675AF9665C380D31FA0, vertexId=vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,569 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:01,570 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:VERTEX_INITIALIZED]: vertexName=EB348CE9B44B4FF6BC130D2A69F595FB, vertexId=vertex_1452796321377_0001_1_00, initRequestedTime=1452796321552, initedTime=1452796321569, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:01,570 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB] with distanceFromRoot: 0
2016-01-14 18:32:01,570 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:01,570 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in EB348CE9B44B4FF6BC130D2A69F595FB
2016-01-14 18:32:01,570 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,571 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:01,571 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796321377_0001_1_00, startRequestedTime=1452796321570, startedTime=1452796321570
2016-01-14 18:32:01,571 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:01,572 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:01,573 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:TASK_STARTED]: vertexName=EB348CE9B44B4FF6BC130D2A69F595FB, taskId=task_1452796321377_0001_1_00_000000, scheduledTime=1452796321572, launchTime=1452796321572
2016-01-14 18:32:01,573 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796321377_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:01,573 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,573 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS, VertexName: EB348CE9B44B4FF6BC130D2A69F595FB, VertexParallelism: 1, TaskAttemptID:attempt_1452796321377_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=BCC37B89EA8348EA9B704E2B60A32925, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0610409B9E9B4675AF9665C380D31FA0, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:01,574 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796321377_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:01,574 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:01,577 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:01,577 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:01,578 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:01,579 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796321377_0001_00_000001
2016-01-14 18:32:01,579 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321377_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:01,581 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796321377_0001_00_000001
2016-01-14 18:32:01,581 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:01,583 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321377_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:01,584 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:01,584 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796321377_0001_00_000001, launchTime=1452796321584
2016-01-14 18:32:01,585 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796321377_0001_00_000001
2016-01-14 18:32:01,587 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796321377_0001_1_00_000000_0] to container: [container_1452796321377_0001_00_000001]
2016-01-14 18:32:01,587 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321377_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:01,587 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796321377_0001_1_00_000000_0] started. Is using containerId: [container_1452796321377_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:01,588 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=EB348CE9B44B4FF6BC130D2A69F595FB, taskAttemptId=attempt_1452796321377_0001_1_00_000000_0, startTime=1452796321587, containerId=container_1452796321377_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796321377_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:01,588 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796321377_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:01,588 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:01,588 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796321377_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:01,589 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796321377_0001_00_000001 given task: attempt_1452796321377_0001_1_00_000000_0
2016-01-14 18:32:01,590 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796321377_0001_00_000001: 1 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796321377_0001_1_00_000000_0
2016-01-14 18:32:01,590 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796321377_0001, with dag id: dag_1452796321377_0001_1
2016-01-14 18:32:01 Starting to run new task attempt: attempt_1452796321377_0001_1_00_000000_0
2016-01-14 18:32:01,592 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796321377_0001_1_00_000000_0
2016-01-14 18:32:01,592 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:01,592 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:01,593 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:01,593 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:01,594 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:01,594 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:01,595 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS, VertexName: EB348CE9B44B4FF6BC130D2A69F595FB, VertexParallelism: 1, TaskAttemptID:attempt_1452796321377_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=BCC37B89EA8348EA9B704E2B60A32925, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=0610409B9E9B4675AF9665C380D31FA0, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:01,595 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:01,597 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796321377_0001_1_00_000000_0
2016-01-14 18:32:01,597 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:01,597 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:01,599 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=BCC37B89EA8348EA9B704E2B60A32925, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:01,600 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:01,601 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: BCC37B89EA8348EA9B704E2B60A32925
2016-01-14 18:32:01,601 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: BCC37B89EA8348EA9B704E2B60A32925
2016-01-14 18:32:01,603 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:01,603 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=0610409B9E9B4675AF9665C380D31FA0, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:01,603 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:01,604 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 0610409B9E9B4675AF9665C380D31FA0
2016-01-14 18:32:01,604 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:01,604 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 0610409B9E9B4675AF9665C380D31FA0
2016-01-14 18:32:01,606 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:01,610 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796321377_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:01,615 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:01,616 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: BCC37B89EA8348EA9B704E2B60A32925
2016-01-14 18:32:01,616 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: BCC37B89EA8348EA9B704E2B60A32925
2016-01-14 18:32:01,618 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: EB348CE9B44B4FF6BC130D2A69F595FB, ordinal: 0
2016-01-14 18:32:01,619 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EB348CE9B44B4FF6BC130D2A69F595FB, mem on start (mb), free: 287, total: 387, max: 672
2016-01-14 18:32:01,619 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:01,619 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:01,620 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:01,625 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:01,625 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 0610409B9E9B4675AF9665C380D31FA0
2016-01-14 18:32:01,626 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:01,626 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:01,626 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:01,626 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:01,626 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:01,626 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:01,626 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:01,627 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:01,627 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, BCC37B89EA8348EA9B704E2B60A32925, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:01,627 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 0610409B9E9B4675AF9665C380D31FA0, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:01,627 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:01,627 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: BCC37B89EA8348EA9B704E2B60A32925 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:01,627 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:01,627 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:01,628 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: BCC37B89EA8348EA9B704E2B60A32925
2016-01-14 18:32:01,629 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:01,629 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: BCC37B89EA8348EA9B704E2B60A32925
2016-01-14 18:32:01,630 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:01,630 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796321377_0001_1_00_000000_0
2016-01-14 18:32:01,633 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:01,634 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: BCC37B89EA8348EA9B704E2B60A32925
2016-01-14 18:32:01,634 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"], id: 0610409B9E9B4675AF9665C380D31FA0
2016-01-14 18:32:01,634 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"]
2016-01-14 18:32:01,635 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:01,635 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:01,635 INFO input.MRInput (MRInput.java:checkAndAwaitRecordReaderInitialization(597)) - Awaiting RecordReader initialization
2016-01-14 18:32:01,637 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:01,639 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@421a3fcf
2016-01-14 18:32:01,640 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@421a3fcf
2016-01-14 18:32:01,640 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:01,640 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:01,641 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: EB348CE9B44B4FF6BC130D2A69F595FB, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:01,644 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:01,644 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:01,644 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796321377_0001_1_00_000000_0
2016-01-14 18:32:01,645 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796321377_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:01,646 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796321377_0001_1_00_000000_0
2016-01-14 18:32:01,646 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EB348CE9B44B4FF6BC130D2A69F595FB, mem on close (mb), free: 285, total: 387, max: 672
2016-01-14 18:32:01 Completed running task attempt: attempt_1452796321377_0001_1_00_000000_0
2016-01-14 18:32:01,647 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796321377_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:01,650 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796321641, Process_Duration=5, Process_End_Time=1452796321646, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:01,651 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=EB348CE9B44B4FF6BC130D2A69F595FB, taskAttemptId=attempt_1452796321377_0001_1_00_000000_0, startTime=1452796321587, finishTime=1452796321650, timeTaken=63, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796321641, Process_Duration=5, Process_End_Time=1452796321646, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:01,651 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:01,651 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796321377_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:01,651 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796321377_0001_1_00_000000_0
2016-01-14 18:32:01,652 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:01,652 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:TASK_FINISHED]: vertexName=EB348CE9B44B4FF6BC130D2A69F595FB, taskId=task_1452796321377_0001_1_00_000000, startTime=1452796321587, finishTime=1452796321651, timeTaken=64, status=SUCCEEDED, successfulAttemptID=attempt_1452796321377_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796321641, Process_Duration=5, Process_End_Time=1452796321646, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:01,652 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796321377_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:01,652 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB] : 1
2016-01-14 18:32:01,652 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,653 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796321377_0001_00_000001
2016-01-14 18:32:01,654 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:01,653 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:01,656 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:VERTEX_FINISHED]: vertexName=EB348CE9B44B4FF6BC130D2A69F595FB, vertexId=vertex_1452796321377_0001_1_00, initRequestedTime=1452796321552, initedTime=1452796321569, startRequestedTime=1452796321570, startedTime=1452796321570, finishTime=1452796321652, timeTaken=82, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796321641, Process_Duration=5, Process_End_Time=1452796321646, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796321587, firstTasksToStart=[ task_1452796321377_0001_1_00_000000 ], lastTaskFinishTime=1452796321650, lastTasksToFinish=[ task_1452796321377_0001_1_00_000000 ], minTaskDuration=63, maxTaskDuration=63, avgTaskDuration=63.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796321377_0001_1_00_000000 ], longestDurationTasks=[ task_1452796321377_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:01,656 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:01,657 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321377_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:01,657 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796321377_0001_00_000001, stoppedTime=1452796321657, exitStatus=0
2016-01-14 18:32:01,657 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321377_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:01,657 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:01,657 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796321377_0001_1
2016-01-14 18:32:01,657 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796321377_0001_1
2016-01-14 18:32:01,657 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 0610409B9E9B4675AF9665C380D31FA0 for vertex: vertex_1452796321377_0001_1_00 [EB348CE9B44B4FF6BC130D2A69F595FB]
2016-01-14 18:32:01,659 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:01,659 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:01,660 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:01,666 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796321377_0001_1, queueSize=0
2016-01-14 18:32:01,667 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:01,667 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321377_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796321377_0001_1, startTime=1452796321551, finishTime=1452796321665, timeTaken=114, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796321641, Process_Duration=5, Process_End_Time=1452796321646, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:01,667 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796321377_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:01,667 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796321377_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:01 Completed Dag: dag_1452796321377_0001_1
2016-01-14 18:32:01,667 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796321377_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:01,668 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796321377_0001_1_post
2016-01-14 18:32:01,668 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:01,668 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:01,668 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452796321377_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 18:32:01,670 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321377_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 18:32:01,670 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796321377_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:01,671 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796321377_0001_00_000001: 15 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:01,671 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796321377_0001_00_000001, Exiting
2016-01-14 18:32:01,671 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796321377_0001_00_000001
2016-01-14 18:32:01,671 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796321377_0001_00_000001
2016-01-14 18:32:01,675 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796321377_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:01,676 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796321377_0001_00_000001 completed successfully
2016-01-14 18:32:01,676 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452796321377_0001
2016-01-14 18:32:01,676 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321377_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 18:32:01,678 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:01,678 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:01,678 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:01,679 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:01,679 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:01,680 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:01,680 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:01,680 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:01,680 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:01,680 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:01,681 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:01,681 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:01,684 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:01,687 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CF21E543BF054247B8CF54799FE99EF8/B60C192B9D884F449DFAEB4B3BC91DEB/.tez/application_1452796321377_0001
2016-01-14 18:32:01,688 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.330
2016-01-14 18:32:01,773 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_RESULTS
2016-01-14 18:32:01,796 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:01,796 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:01,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.009
2016-01-14 18:32:01,842 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 18:32:01,843 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:01,843 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:01,843 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:01,858 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:01,859 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL
2016-01-14 18:32:01,868 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:01,868 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:01,869 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"]
2016-01-14 18:32:01,869 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:01,869 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:01,869 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:01,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 18:32:01,871 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:01,885 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:01,889 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:01,889 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:01,890 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:01,898 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D/.tez/application_1452796321889_0001 doesn't exist and is created
2016-01-14 18:32:01,918 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:01,918 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:01,919 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D/.tez/application_1452796321889_0001
2016-01-14 18:32:01,923 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796321889_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:01,940 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:01,941 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:01,943 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:01,944 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:01,944 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D/.tez/application_1452796321889_0001/localmode-log-dir
2016-01-14 18:32:01,945 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D/.tez/application_1452796321889_0001/localmode-log-dir/history.txt.appattempt_1452796321889_0001_000000, maxErrors=10
2016-01-14 18:32:01,945 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:01,945 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796321889_0001_000000, appSubmitTime=1452796321922, launchTime=1452796321922
2016-01-14 18:32:01,949 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:01,954 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:01,955 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:01,955 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:01,958 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:55304
2016-01-14 18:32:01,959 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:01,962 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:01,962 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796321889_0001_000000, startTime=1452796321962
2016-01-14 18:32:01,962 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:02,018 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:02,019 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:02,019 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452796321889_0001, dagName=[A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 18:32:02,037 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 18:32:02,039 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796321889_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D/.tez/application_1452796321889_0001/localmode-log-dir/dag_1452796321889_0001_1.dot
2016-01-14 18:32:02,039 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D/.tez/application_1452796321889_0001/localmode-log-dir/dag_1452796321889_0001_1-tez-dag.pb.txt
2016-01-14 18:32:02,047 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796321889_0001_1
2016-01-14 18:32:02,047 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:02,047 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 18:32:02 Running Dag: dag_1452796321889_0001_1
2016-01-14 18:32:02,057 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796321889_0001_1, submitTime=1452796322037
2016-01-14 18:32:02,057 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:02,057 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E5F715D55A994F5EACA9D228F8E4203D
2016-01-14 18:32:02,058 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:02,058 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796321889_0001_1, initTime=1452796322057
2016-01-14 18:32:02,058 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796321889_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:02,059 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:DAG_STARTED]: dagID=dag_1452796321889_0001_1, startTime=1452796322058
2016-01-14 18:32:02,059 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:02,059 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:02,059 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796321889_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:02,059 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452796321889_0001, dagName=[A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 18:32:02,059 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E5F715D55A994F5EACA9D228F8E4203D : {3BB67213901A4EBD9306206FA8547EBF={InputName=3BB67213901A4EBD9306206FA8547EBF}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:02,060 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 3BB67213901A4EBD9306206FA8547EBF, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:02,061 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,061 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,061 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,061 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]. Starting root input initializers: 1
2016-01-14 18:32:02,059 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:02,062 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:02,062 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 3BB67213901A4EBD9306206FA8547EBF on vertex vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,064 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:02,064 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 3BB67213901A4EBD9306206FA8547EBF asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:02,065 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:02,065 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:02,067 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:02,067 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 3BB67213901A4EBD9306206FA8547EBF on vertex vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,067 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:02,067 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {3BB67213901A4EBD9306206FA8547EBF=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:02,068 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D] parallelism set to 1
2016-01-14 18:32:02,068 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:02,068 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796321889_0001_1_00, eventCount=1
2016-01-14 18:32:02,068 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,068 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=CDC7EE1FFAE049FF9D27FA3E828208DF, vertexId=vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:02,068 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=CDC7EE1FFAE049FF9D27FA3E828208DF, vertexId=vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,070 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=CDC7EE1FFAE049FF9D27FA3E828208DF, vertexName=E5F715D55A994F5EACA9D228F8E4203D, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:02,071 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=CDC7EE1FFAE049FF9D27FA3E828208DF, vertexId=vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,072 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:02,072 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E5F715D55A994F5EACA9D228F8E4203D, vertexId=vertex_1452796321889_0001_1_00, initRequestedTime=1452796322059, initedTime=1452796322071, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:02,072 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D] with distanceFromRoot: 0
2016-01-14 18:32:02,072 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:02,072 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E5F715D55A994F5EACA9D228F8E4203D
2016-01-14 18:32:02,072 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,073 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:02,073 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796321889_0001_1_00, startRequestedTime=1452796322072, startedTime=1452796322072
2016-01-14 18:32:02,073 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:02,074 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:02,074 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:TASK_STARTED]: vertexName=E5F715D55A994F5EACA9D228F8E4203D, taskId=task_1452796321889_0001_1_00_000000, scheduledTime=1452796322074, launchTime=1452796322074
2016-01-14 18:32:02,074 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796321889_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:02,075 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,075 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL, VertexName: E5F715D55A994F5EACA9D228F8E4203D, VertexParallelism: 1, TaskAttemptID:attempt_1452796321889_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3BB67213901A4EBD9306206FA8547EBF, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CDC7EE1FFAE049FF9D27FA3E828208DF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:02,075 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796321889_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:02,075 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:02,076 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:02,078 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:02,078 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:02,079 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796321889_0001_00_000001
2016-01-14 18:32:02,079 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321889_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:02,080 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796321889_0001, with dag id: dag_1452796321889_0001_1
2016-01-14 18:32:02,081 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796321889_0001_00_000001
2016-01-14 18:32:02,081 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:02,082 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:02,082 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321889_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:02,083 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796321889_0001_00_000001, launchTime=1452796322082
2016-01-14 18:32:02,084 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796321889_0001_00_000001
2016-01-14 18:32:02,085 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796321889_0001_1_00_000000_0] to container: [container_1452796321889_0001_00_000001]
2016-01-14 18:32:02,085 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321889_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:02,085 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796321889_0001_00_000001 given task: attempt_1452796321889_0001_1_00_000000_0
2016-01-14 18:32:02,085 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796321889_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796321889_0001_1_00_000000_0
2016-01-14 18:32:02,086 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796321889_0001_1_00_000000_0] started. Is using containerId: [container_1452796321889_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:02 Starting to run new task attempt: attempt_1452796321889_0001_1_00_000000_0
2016-01-14 18:32:02,086 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796321889_0001_1_00_000000_0
2016-01-14 18:32:02,086 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:02,086 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E5F715D55A994F5EACA9D228F8E4203D, taskAttemptId=attempt_1452796321889_0001_1_00_000000_0, startTime=1452796322085, containerId=container_1452796321889_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796321889_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:02,086 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:02,087 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796321889_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:02,087 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:02,087 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:02,087 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:02,087 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:02,088 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:02,088 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL, VertexName: E5F715D55A994F5EACA9D228F8E4203D, VertexParallelism: 1, TaskAttemptID:attempt_1452796321889_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3BB67213901A4EBD9306206FA8547EBF, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CDC7EE1FFAE049FF9D27FA3E828208DF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:02,087 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796321889_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:02,088 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:02,094 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796321889_0001_1_00_000000_0
2016-01-14 18:32:02,094 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:02,094 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:02,095 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:02,095 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=CDC7EE1FFAE049FF9D27FA3E828208DF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:02,095 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796321889_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:02,096 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:02,096 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: CDC7EE1FFAE049FF9D27FA3E828208DF
2016-01-14 18:32:02,096 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:02,097 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: CDC7EE1FFAE049FF9D27FA3E828208DF
2016-01-14 18:32:02,096 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=3BB67213901A4EBD9306206FA8547EBF, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:02,099 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:02,099 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 3BB67213901A4EBD9306206FA8547EBF
2016-01-14 18:32:02,099 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 3BB67213901A4EBD9306206FA8547EBF
2016-01-14 18:32:02,101 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:02,102 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:02,102 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 3BB67213901A4EBD9306206FA8547EBF
2016-01-14 18:32:02,102 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 3BB67213901A4EBD9306206FA8547EBF
2016-01-14 18:32:02,108 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:02,108 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: CDC7EE1FFAE049FF9D27FA3E828208DF
2016-01-14 18:32:02,109 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E5F715D55A994F5EACA9D228F8E4203D, ordinal: 0
2016-01-14 18:32:02,109 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E5F715D55A994F5EACA9D228F8E4203D, mem on start (mb), free: 196, total: 387, max: 672
2016-01-14 18:32:02,110 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:02,110 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:02,111 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:02,111 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:02,111 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:02,111 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:02,111 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:02,111 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:02,111 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:02,111 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:02,112 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:02,112 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, CDC7EE1FFAE049FF9D27FA3E828208DF, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:02,112 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 3BB67213901A4EBD9306206FA8547EBF, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:02,112 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:02,112 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 3BB67213901A4EBD9306206FA8547EBF
2016-01-14 18:32:02,112 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:02,112 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 3BB67213901A4EBD9306206FA8547EBF
2016-01-14 18:32:02,112 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 3BB67213901A4EBD9306206FA8547EBF being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:02,113 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:02,113 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:02,113 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:02,113 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796321889_0001_1_00_000000_0
2016-01-14 18:32:02,113 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:02,114 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2d22efc3
2016-01-14 18:32:02,115 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2d22efc3
2016-01-14 18:32:02,115 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:02,115 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:02,117 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:02,117 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 3BB67213901A4EBD9306206FA8547EBF
2016-01-14 18:32:02,118 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"], id: CDC7EE1FFAE049FF9D27FA3E828208DF
2016-01-14 18:32:02,118 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"]
2016-01-14 18:32:02,118 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:02,118 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:02,119 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E5F715D55A994F5EACA9D228F8E4203D, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:02,123 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:02,123 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:02,124 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796321889_0001_1_00_000000_0
2016-01-14 18:32:02,124 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796321889_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:02,125 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796321889_0001_1_00_000000_0
2016-01-14 18:32:02,125 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E5F715D55A994F5EACA9D228F8E4203D, mem on close (mb), free: 194, total: 387, max: 672
2016-01-14 18:32:02 Completed running task attempt: attempt_1452796321889_0001_1_00_000000_0
2016-01-14 18:32:02,126 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796321889_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:02,128 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796322119, Process_Duration=6, Process_End_Time=1452796322125, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:02,128 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E5F715D55A994F5EACA9D228F8E4203D, taskAttemptId=attempt_1452796321889_0001_1_00_000000_0, startTime=1452796322085, finishTime=1452796322128, timeTaken=43, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796322119, Process_Duration=6, Process_End_Time=1452796322125, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:02,128 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:02,128 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796321889_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:02,129 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:02,128 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:02,129 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796321889_0001_1_00_000000_0
2016-01-14 18:32:02,129 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:02,129 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796321889_0001_00_000001
2016-01-14 18:32:02,130 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:02,130 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:TASK_FINISHED]: vertexName=E5F715D55A994F5EACA9D228F8E4203D, taskId=task_1452796321889_0001_1_00_000000, startTime=1452796322085, finishTime=1452796322129, timeTaken=44, status=SUCCEEDED, successfulAttemptID=attempt_1452796321889_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796322119, Process_Duration=6, Process_End_Time=1452796322125, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:02,130 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796321889_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:02,130 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D] : 1
2016-01-14 18:32:02,130 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,131 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:02,132 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:VERTEX_FINISHED]: vertexName=E5F715D55A994F5EACA9D228F8E4203D, vertexId=vertex_1452796321889_0001_1_00, initRequestedTime=1452796322059, initedTime=1452796322071, startRequestedTime=1452796322072, startedTime=1452796322072, finishTime=1452796322130, timeTaken=58, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796322119, Process_Duration=6, Process_End_Time=1452796322125, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796322085, firstTasksToStart=[ task_1452796321889_0001_1_00_000000 ], lastTaskFinishTime=1452796322128, lastTasksToFinish=[ task_1452796321889_0001_1_00_000000 ], minTaskDuration=43, maxTaskDuration=43, avgTaskDuration=43.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796321889_0001_1_00_000000 ], longestDurationTasks=[ task_1452796321889_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:02,132 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:02,132 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321889_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:02,132 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:02,132 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796321889_0001_00_000001, stoppedTime=1452796322132, exitStatus=0
2016-01-14 18:32:02,132 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321889_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:02,133 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:02,133 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796321889_0001_1
2016-01-14 18:32:02,133 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796321889_0001_1
2016-01-14 18:32:02,134 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: CDC7EE1FFAE049FF9D27FA3E828208DF for vertex: vertex_1452796321889_0001_1_00 [E5F715D55A994F5EACA9D228F8E4203D]
2016-01-14 18:32:02,135 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:02,135 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:02,140 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796321889_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:02,140 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796321889_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:02,141 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796321889_0001_00_000001, Exiting
2016-01-14 18:32:02,141 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796321889_0001_00_000001
2016-01-14 18:32:02,141 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796321889_0001_00_000001
2016-01-14 18:32:02,142 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796321889_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:02,142 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796321889_0001_00_000001 completed successfully
2016-01-14 18:32:02,144 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796321889_0001_1, queueSize=0
2016-01-14 18:32:02,144 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:02,144 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796321889_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796321889_0001_1, startTime=1452796322058, finishTime=1452796322142, timeTaken=84, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796322119, Process_Duration=6, Process_End_Time=1452796322125, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:02,144 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796321889_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:02,145 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796321889_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:02,145 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796321889_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:02 Completed Dag: dag_1452796321889_0001_1
2016-01-14 18:32:02,145 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796321889_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:02,146 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796321889_0001_1_post
2016-01-14 18:32:02,146 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:02,146 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:02,145 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796321889_0001_00_000001
2016-01-14 18:32:02,151 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452796321889_0001
2016-01-14 18:32:02,153 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:02,153 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:02,153 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:02,153 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:02,153 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:02,154 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:02,154 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:02,154 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:02,155 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:02,155 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:02,155 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:02,155 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:02,155 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:02,160 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A4A87D1871A34D4CB197B4CA7B0BB9F0/BB4AF90E6AF941219415964775C79B1D/.tez/application_1452796321889_0001
2016-01-14 18:32:02,161 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.293
2016-01-14 18:32:02,234 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_ALL
2016-01-14 18:32:02,257 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:02,258 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:02,296 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.010
2016-01-14 18:32:02,300 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 18:32:02,300 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:02,301 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:02,301 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:02,316 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:02,317 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1
2016-01-14 18:32:02,327 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:02,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:02,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1"]
2016-01-14 18:32:02,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:02,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:02,328 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:02,330 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 18:32:02,330 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:02,344 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:02,349 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:02,349 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:02,349 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:02,358 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274/.tez/application_1452796322349_0001 doesn't exist and is created
2016-01-14 18:32:02,373 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:02,373 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:02,374 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274/.tez/application_1452796322349_0001
2016-01-14 18:32:02,376 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796322349_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:02,398 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:02,399 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:02,400 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:02,400 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:02,400 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274/.tez/application_1452796322349_0001/localmode-log-dir
2016-01-14 18:32:02,401 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274/.tez/application_1452796322349_0001/localmode-log-dir/history.txt.appattempt_1452796322349_0001_000000, maxErrors=10
2016-01-14 18:32:02,401 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:02,401 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796322349_0001_000000, appSubmitTime=1452796322376, launchTime=1452796322376
2016-01-14 18:32:02,406 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:02,407 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:02,408 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:02,408 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:02,410 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:42730
2016-01-14 18:32:02,412 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:02,415 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796322349_0001_000000, startTime=1452796322415
2016-01-14 18:32:02,415 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:02,415 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:02,473 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:02,473 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:02,473 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, applicationId=application_1452796322349_0001, dagName=[4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 18:32:02,492 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 18:32:02,493 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796322349_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274/.tez/application_1452796322349_0001/localmode-log-dir/dag_1452796322349_0001_1.dot
2016-01-14 18:32:02,494 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274/.tez/application_1452796322349_0001/localmode-log-dir/dag_1452796322349_0001_1-tez-dag.pb.txt
2016-01-14 18:32:02,500 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796322349_0001_1
2016-01-14 18:32:02,501 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:02,501 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 18:32:02 Running Dag: dag_1452796322349_0001_1
2016-01-14 18:32:02,511 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796322349_0001_1, submitTime=1452796322492
2016-01-14 18:32:02,511 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:02,512 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F204DD10771A46BB8ECA7954BB76F31D
2016-01-14 18:32:02,512 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:02,513 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796322349_0001_1, initTime=1452796322512
2016-01-14 18:32:02,513 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:02,513 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796322349_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:02,514 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:DAG_STARTED]: dagID=dag_1452796322349_0001_1, startTime=1452796322514
2016-01-14 18:32:02,514 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:02,514 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:02,514 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796322349_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:02,515 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F204DD10771A46BB8ECA7954BB76F31D : {B82262945E6D4863939CC930EF786AA8={InputName=B82262945E6D4863939CC930EF786AA8}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:02,517 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: B82262945E6D4863939CC930EF786AA8, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:02,517 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,517 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,517 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,517 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]. Starting root input initializers: 1
2016-01-14 18:32:02,517 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, applicationId=application_1452796322349_0001, dagName=[4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 18:32:02,518 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:02,518 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: B82262945E6D4863939CC930EF786AA8 on vertex vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,519 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:02,520 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input B82262945E6D4863939CC930EF786AA8 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:02,520 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:02,520 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:02,522 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:02,522 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: B82262945E6D4863939CC930EF786AA8 on vertex vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,522 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:02,522 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {B82262945E6D4863939CC930EF786AA8=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:02,523 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D] parallelism set to 1
2016-01-14 18:32:02,523 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:02,523 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796322349_0001_1_00, eventCount=1
2016-01-14 18:32:02,523 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,523 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=9C326926D0B04A36911B119975702D28, vertexId=vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:02,524 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=9C326926D0B04A36911B119975702D28, vertexId=vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,525 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=9C326926D0B04A36911B119975702D28, vertexName=F204DD10771A46BB8ECA7954BB76F31D, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:02,526 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=9C326926D0B04A36911B119975702D28, vertexId=vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,527 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:02,527 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F204DD10771A46BB8ECA7954BB76F31D, vertexId=vertex_1452796322349_0001_1_00, initRequestedTime=1452796322515, initedTime=1452796322526, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:02,527 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D] with distanceFromRoot: 0
2016-01-14 18:32:02,527 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:02,527 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F204DD10771A46BB8ECA7954BB76F31D
2016-01-14 18:32:02,528 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,528 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:02,528 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796322349_0001_1_00, startRequestedTime=1452796322527, startedTime=1452796322527
2016-01-14 18:32:02,529 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:02,529 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:02,531 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:TASK_STARTED]: vertexName=F204DD10771A46BB8ECA7954BB76F31D, taskId=task_1452796322349_0001_1_00_000000, scheduledTime=1452796322529, launchTime=1452796322529
2016-01-14 18:32:02,531 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796322349_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:02,532 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,532 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, VertexName: F204DD10771A46BB8ECA7954BB76F31D, VertexParallelism: 1, TaskAttemptID:attempt_1452796322349_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B82262945E6D4863939CC930EF786AA8, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=9C326926D0B04A36911B119975702D28, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:02,533 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796322349_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:02,533 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:02,535 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:02,535 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:02,535 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:02,537 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796322349_0001_00_000001
2016-01-14 18:32:02,537 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322349_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:02,539 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796322349_0001_00_000001
2016-01-14 18:32:02,539 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:02,540 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322349_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:02,540 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:02,541 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796322349_0001_00_000001, launchTime=1452796322540
2016-01-14 18:32:02,542 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796322349_0001_00_000001
2016-01-14 18:32:02,543 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796322349_0001, with dag id: dag_1452796322349_0001_1
2016-01-14 18:32:02,543 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796322349_0001_1_00_000000_0] to container: [container_1452796322349_0001_00_000001]
2016-01-14 18:32:02,544 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322349_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:02,545 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796322349_0001_1_00_000000_0] started. Is using containerId: [container_1452796322349_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:02,545 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F204DD10771A46BB8ECA7954BB76F31D, taskAttemptId=attempt_1452796322349_0001_1_00_000000_0, startTime=1452796322545, containerId=container_1452796322349_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796322349_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:02,545 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796322349_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:02,545 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796322349_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:02,546 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796322349_0001_00_000001 given task: attempt_1452796322349_0001_1_00_000000_0
2016-01-14 18:32:02,545 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:02,546 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796322349_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796322349_0001_1_00_000000_0
2016-01-14 18:32:02 Starting to run new task attempt: attempt_1452796322349_0001_1_00_000000_0
2016-01-14 18:32:02,547 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796322349_0001_1_00_000000_0
2016-01-14 18:32:02,547 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:02,547 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:02,548 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:02,548 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:02,548 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:02,549 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:02,549 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, VertexName: F204DD10771A46BB8ECA7954BB76F31D, VertexParallelism: 1, TaskAttemptID:attempt_1452796322349_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B82262945E6D4863939CC930EF786AA8, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=9C326926D0B04A36911B119975702D28, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:02,550 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:02,550 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796322349_0001_1_00_000000_0
2016-01-14 18:32:02,550 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:02,551 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:02,551 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796322349_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:02,552 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:02,552 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=B82262945E6D4863939CC930EF786AA8, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:02,552 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=9C326926D0B04A36911B119975702D28, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:02,553 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:02,553 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: B82262945E6D4863939CC930EF786AA8
2016-01-14 18:32:02,553 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: B82262945E6D4863939CC930EF786AA8
2016-01-14 18:32:02,553 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:02,554 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 9C326926D0B04A36911B119975702D28
2016-01-14 18:32:02,554 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:02,555 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 9C326926D0B04A36911B119975702D28
2016-01-14 18:32:02,557 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:02,558 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:02,558 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: B82262945E6D4863939CC930EF786AA8
2016-01-14 18:32:02,559 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: B82262945E6D4863939CC930EF786AA8
2016-01-14 18:32:02,566 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:02,566 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 9C326926D0B04A36911B119975702D28
2016-01-14 18:32:02,567 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F204DD10771A46BB8ECA7954BB76F31D, ordinal: 0
2016-01-14 18:32:02,567 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F204DD10771A46BB8ECA7954BB76F31D, mem on start (mb), free: 317, total: 388, max: 672
2016-01-14 18:32:02,568 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:02,568 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:02,568 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:02,569 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:02,569 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:02,569 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:02,569 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:02,570 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:02,570 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:02,570 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:02,571 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:02,571 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, B82262945E6D4863939CC930EF786AA8, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:02,571 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 9C326926D0B04A36911B119975702D28, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:02,572 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:02,572 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: B82262945E6D4863939CC930EF786AA8 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:02,572 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: B82262945E6D4863939CC930EF786AA8
2016-01-14 18:32:02,573 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:02,573 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: B82262945E6D4863939CC930EF786AA8
2016-01-14 18:32:02,573 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:02,573 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:02,574 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:02,574 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796322349_0001_1_00_000000_0
2016-01-14 18:32:02,574 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:02,575 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4f6630cb
2016-01-14 18:32:02,576 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4f6630cb
2016-01-14 18:32:02,576 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:02,577 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:02,578 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:02,579 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: B82262945E6D4863939CC930EF786AA8
2016-01-14 18:32:02,579 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1"], id: 9C326926D0B04A36911B119975702D28
2016-01-14 18:32:02,579 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1"]
2016-01-14 18:32:02,579 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:02,579 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:02,580 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F204DD10771A46BB8ECA7954BB76F31D, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:02,582 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:02,582 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:02,583 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796322349_0001_1_00_000000_0
2016-01-14 18:32:02,583 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796322349_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:02,583 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796322349_0001_1_00_000000_0
2016-01-14 18:32:02,584 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F204DD10771A46BB8ECA7954BB76F31D, mem on close (mb), free: 316, total: 388, max: 672
2016-01-14 18:32:02 Completed running task attempt: attempt_1452796322349_0001_1_00_000000_0
2016-01-14 18:32:02,584 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796322349_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:02,587 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F204DD10771A46BB8ECA7954BB76F31D, taskAttemptId=attempt_1452796322349_0001_1_00_000000_0, startTime=1452796322545, finishTime=1452796322587, timeTaken=42, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796322580, Process_Duration=3, Process_End_Time=1452796322583, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:02,588 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796322349_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:02,588 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:02,588 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:02,588 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796322349_0001_1_00_000000_0
2016-01-14 18:32:02,589 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:02,589 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:TASK_FINISHED]: vertexName=F204DD10771A46BB8ECA7954BB76F31D, taskId=task_1452796322349_0001_1_00_000000, startTime=1452796322545, finishTime=1452796322588, timeTaken=43, status=SUCCEEDED, successfulAttemptID=attempt_1452796322349_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796322580, Process_Duration=3, Process_End_Time=1452796322583, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:02,589 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796322349_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:02,589 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D] : 1
2016-01-14 18:32:02,589 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,591 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:02,591 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:VERTEX_FINISHED]: vertexName=F204DD10771A46BB8ECA7954BB76F31D, vertexId=vertex_1452796322349_0001_1_00, initRequestedTime=1452796322515, initedTime=1452796322526, startRequestedTime=1452796322527, startedTime=1452796322527, finishTime=1452796322589, timeTaken=62, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796322580, Process_Duration=3, Process_End_Time=1452796322583, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796322545, firstTasksToStart=[ task_1452796322349_0001_1_00_000000 ], lastTaskFinishTime=1452796322587, lastTasksToFinish=[ task_1452796322349_0001_1_00_000000 ], minTaskDuration=42, maxTaskDuration=42, avgTaskDuration=42.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796322349_0001_1_00_000000 ], longestDurationTasks=[ task_1452796322349_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:02,591 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:02,591 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322349_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:02,592 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796322580, Process_Duration=3, Process_End_Time=1452796322583, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:02,592 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796322349_0001_00_000001, stoppedTime=1452796322592, exitStatus=0
2016-01-14 18:32:02,592 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:02,592 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:02,592 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:02,592 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322349_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:02,592 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796322349_0001_00_000001
2016-01-14 18:32:02,592 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:02,592 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796322349_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:02,593 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796322349_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:02,592 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796322349_0001_1
2016-01-14 18:32:02,593 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796322349_0001_00_000001, Exiting
2016-01-14 18:32:02,593 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796322349_0001_00_000001
2016-01-14 18:32:02,593 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796322349_0001_00_000001
2016-01-14 18:32:02,594 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796322349_0001_1
2016-01-14 18:32:02,594 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 9C326926D0B04A36911B119975702D28 for vertex: vertex_1452796322349_0001_1_00 [F204DD10771A46BB8ECA7954BB76F31D]
2016-01-14 18:32:02,594 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796322349_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:02,595 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796322349_0001_00_000001 completed successfully
2016-01-14 18:32:02,601 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796322349_0001_1, queueSize=0
2016-01-14 18:32:02,601 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:02,601 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322349_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796322349_0001_1, startTime=1452796322514, finishTime=1452796322600, timeTaken=86, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796322580, Process_Duration=3, Process_End_Time=1452796322583, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:02,601 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796322349_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:02,602 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796322349_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:02,602 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796322349_0001_00_000001
2016-01-14 18:32:02,602 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322349_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:02 Completed Dag: dag_1452796322349_0001_1
2016-01-14 18:32:02,602 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796322349_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:02,602 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796322349_0001_1_post
2016-01-14 18:32:02,602 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:02,602 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:02,610 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, applicationId=application_1452796322349_0001
2016-01-14 18:32:02,611 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:02,612 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:02,613 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:02,613 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:02,613 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:02,613 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:02,614 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:02,614 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:02,614 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:02,614 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:02,615 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:02,615 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:02,615 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:02,620 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/4B12DAAC249D4C9BAA984FFEA630D4E6/B20A877EFCD44BAE835D788C85E02274/.tez/application_1452796322349_0001
2016-01-14 18:32:02,620 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.293
2016-01-14 18:32:02,660 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:02,660 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:02,693 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_UNKNOWN_-1
2016-01-14 18:32:02,716 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:02,716 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:02,745 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2016-01-14 18:32:02,746 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.005
2016-01-14 18:32:02,747 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:02,747 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:02,747 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_UNKNOWN_'field2'
2016-01-14 18:32:02,772 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:02,772 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:02,807 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.008
2016-01-14 18:32:02,820 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 18:32:02,820 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:02,821 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:02,821 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:02,836 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:02,837 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_RESULTS
2016-01-14 18:32:02,846 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:02,846 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:02,847 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_RESULTS"]
2016-01-14 18:32:02,847 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:02,847 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:02,847 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:02,848 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...RESULTS.0_UNKNOWN_RESULTS
2016-01-14 18:32:02,848 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:02,862 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:02,866 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:02,866 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:02,867 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:02,876 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829/.tez/application_1452796322866_0001 doesn't exist and is created
2016-01-14 18:32:02,890 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:02,890 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:02,891 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829/.tez/application_1452796322866_0001
2016-01-14 18:32:02,894 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796322866_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:02,906 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:02,908 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:02,910 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:02,911 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:02,911 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829/.tez/application_1452796322866_0001/localmode-log-dir
2016-01-14 18:32:02,912 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829/.tez/application_1452796322866_0001/localmode-log-dir/history.txt.appattempt_1452796322866_0001_000000, maxErrors=10
2016-01-14 18:32:02,913 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:02,913 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796322866_0001_000000, appSubmitTime=1452796322893, launchTime=1452796322893
2016-01-14 18:32:02,920 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:02,922 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:54312
2016-01-14 18:32:02,923 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:02,924 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:02,924 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:02,925 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:02,928 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796322866_0001_000000, startTime=1452796322928
2016-01-14 18:32:02,928 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:02,928 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:02,991 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:02,991 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:02,991 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...RESULTS.0_UNKNOWN_RESULTS, applicationId=application_1452796322866_0001, dagName=[74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS
2016-01-14 18:32:03,008 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS
2016-01-14 18:32:03,010 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796322866_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829/.tez/application_1452796322866_0001/localmode-log-dir/dag_1452796322866_0001_1.dot
2016-01-14 18:32:03,010 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829/.tez/application_1452796322866_0001/localmode-log-dir/dag_1452796322866_0001_1-tez-dag.pb.txt
2016-01-14 18:32:03,015 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796322866_0001_1
2016-01-14 18:32:03,015 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:03,015 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS
2016-01-14 18:32:03 Running Dag: dag_1452796322866_0001_1
2016-01-14 18:32:03,025 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796322866_0001_1, submitTime=1452796323009
2016-01-14 18:32:03,025 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:03,026 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F2A36140C4E54F71B2AC674F0AC85D58
2016-01-14 18:32:03,026 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:03,026 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796322866_0001_1, initTime=1452796323025
2016-01-14 18:32:03,027 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:03,027 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796322866_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:03,028 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:DAG_STARTED]: dagID=dag_1452796322866_0001_1, startTime=1452796323027
2016-01-14 18:32:03,028 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:03,028 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:03,029 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...RESULTS.0_UNKNOWN_RESULTS, applicationId=application_1452796322866_0001, dagName=[74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS
2016-01-14 18:32:03,028 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796322866_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:03,029 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F2A36140C4E54F71B2AC674F0AC85D58 : {547985FB8C2547ABA534783662047AD4={InputName=547985FB8C2547ABA534783662047AD4}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:03,029 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 547985FB8C2547ABA534783662047AD4, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:03,029 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,030 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,030 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,030 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]. Starting root input initializers: 1
2016-01-14 18:32:03,031 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:03,031 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 547985FB8C2547ABA534783662047AD4 on vertex vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,033 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:03,033 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 547985FB8C2547ABA534783662047AD4 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:03,034 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:03,034 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:03,036 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:03,036 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 547985FB8C2547ABA534783662047AD4 on vertex vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,036 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:03,036 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {547985FB8C2547ABA534783662047AD4=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:03,037 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58] parallelism set to 1
2016-01-14 18:32:03,037 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:03,037 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796322866_0001_1_00, eventCount=1
2016-01-14 18:32:03,037 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,037 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=1B1DCE8EE1534118AAEC5DCA87573AB7, vertexId=vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:03,037 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=1B1DCE8EE1534118AAEC5DCA87573AB7, vertexId=vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,039 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=1B1DCE8EE1534118AAEC5DCA87573AB7, vertexName=F2A36140C4E54F71B2AC674F0AC85D58, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:03,039 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=1B1DCE8EE1534118AAEC5DCA87573AB7, vertexId=vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,040 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F2A36140C4E54F71B2AC674F0AC85D58, vertexId=vertex_1452796322866_0001_1_00, initRequestedTime=1452796323029, initedTime=1452796323040, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:03,040 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58] with distanceFromRoot: 0
2016-01-14 18:32:03,040 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:03,040 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:03,041 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F2A36140C4E54F71B2AC674F0AC85D58
2016-01-14 18:32:03,041 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,041 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796322866_0001_1_00, startRequestedTime=1452796323041, startedTime=1452796323041
2016-01-14 18:32:03,041 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:03,041 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:03,042 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:03,042 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:TASK_STARTED]: vertexName=F2A36140C4E54F71B2AC674F0AC85D58, taskId=task_1452796322866_0001_1_00_000000, scheduledTime=1452796323042, launchTime=1452796323042
2016-01-14 18:32:03,042 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796322866_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:03,042 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,043 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS, VertexName: F2A36140C4E54F71B2AC674F0AC85D58, VertexParallelism: 1, TaskAttemptID:attempt_1452796322866_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=547985FB8C2547ABA534783662047AD4, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1B1DCE8EE1534118AAEC5DCA87573AB7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:03,043 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796322866_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:03,043 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:03,044 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:03,044 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:03,044 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:03,045 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796322866_0001_00_000001
2016-01-14 18:32:03,045 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322866_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:03,047 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796322866_0001_00_000001
2016-01-14 18:32:03,047 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:03,049 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322866_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:03,049 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796322866_0001_00_000001, launchTime=1452796323049
2016-01-14 18:32:03,049 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:03,050 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796322866_0001_00_000001
2016-01-14 18:32:03,051 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796322866_0001_1_00_000000_0] to container: [container_1452796322866_0001_00_000001]
2016-01-14 18:32:03,051 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322866_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:03,051 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796322866_0001_00_000001 given task: attempt_1452796322866_0001_1_00_000000_0
2016-01-14 18:32:03,051 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796322866_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796322866_0001_1_00_000000_0
2016-01-14 18:32:03,052 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796322866_0001_1_00_000000_0] started. Is using containerId: [container_1452796322866_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:03,052 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F2A36140C4E54F71B2AC674F0AC85D58, taskAttemptId=attempt_1452796322866_0001_1_00_000000_0, startTime=1452796323051, containerId=container_1452796322866_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796322866_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:03,052 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:03,052 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796322866_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:03,052 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796322866_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:03,053 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796322866_0001, with dag id: dag_1452796322866_0001_1
2016-01-14 18:32:03 Starting to run new task attempt: attempt_1452796322866_0001_1_00_000000_0
2016-01-14 18:32:03,054 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796322866_0001_1_00_000000_0
2016-01-14 18:32:03,055 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:03,055 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:03,055 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:03,055 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:03,056 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:03,056 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:03,056 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829] every.every/(1/1) ...RESULTS.0_UNKNOWN_RESULTS, VertexName: F2A36140C4E54F71B2AC674F0AC85D58, VertexParallelism: 1, TaskAttemptID:attempt_1452796322866_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=547985FB8C2547ABA534783662047AD4, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1B1DCE8EE1534118AAEC5DCA87573AB7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:03,057 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:03,058 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796322866_0001_1_00_000000_0
2016-01-14 18:32:03,058 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:03,058 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:03,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:03,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=547985FB8C2547ABA534783662047AD4, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:03,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=1B1DCE8EE1534118AAEC5DCA87573AB7, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:03,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:03,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:03,059 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 547985FB8C2547ABA534783662047AD4
2016-01-14 18:32:03,060 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 1B1DCE8EE1534118AAEC5DCA87573AB7
2016-01-14 18:32:03,060 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 547985FB8C2547ABA534783662047AD4
2016-01-14 18:32:03,060 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:03,060 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 1B1DCE8EE1534118AAEC5DCA87573AB7
2016-01-14 18:32:03,061 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:03,062 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796322866_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:03,063 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:03,063 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 547985FB8C2547ABA534783662047AD4
2016-01-14 18:32:03,063 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 547985FB8C2547ABA534783662047AD4
2016-01-14 18:32:03,070 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F2A36140C4E54F71B2AC674F0AC85D58, ordinal: 0
2016-01-14 18:32:03,070 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F2A36140C4E54F71B2AC674F0AC85D58, mem on start (mb), free: 208, total: 388, max: 672
2016-01-14 18:32:03,070 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:03,070 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:03,070 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:03,072 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:03,072 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 1B1DCE8EE1534118AAEC5DCA87573AB7
2016-01-14 18:32:03,072 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:03,072 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:03,072 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:03,072 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:03,076 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:03,076 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:03,076 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:03,076 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:03,076 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 547985FB8C2547ABA534783662047AD4, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:03,076 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 1B1DCE8EE1534118AAEC5DCA87573AB7, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:03,077 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:03,077 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 547985FB8C2547ABA534783662047AD4
2016-01-14 18:32:03,077 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:03,077 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 547985FB8C2547ABA534783662047AD4
2016-01-14 18:32:03,077 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 547985FB8C2547ABA534783662047AD4 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:03,078 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:03,078 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:03,078 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:03,078 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796322866_0001_1_00_000000_0
2016-01-14 18:32:03,081 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:03,082 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 547985FB8C2547ABA534783662047AD4
2016-01-14 18:32:03,082 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_RESULTS"], id: 1B1DCE8EE1534118AAEC5DCA87573AB7
2016-01-14 18:32:03,082 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_RESULTS"]
2016-01-14 18:32:03,082 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:03,083 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:03,083 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:03,083 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@555b049a
2016-01-14 18:32:03,084 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@555b049a
2016-01-14 18:32:03,084 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:03,084 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:03,085 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F2A36140C4E54F71B2AC674F0AC85D58, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:03,088 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:03,088 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:03,089 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796322866_0001_1_00_000000_0
2016-01-14 18:32:03,090 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796322866_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:03,091 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796322866_0001_1_00_000000_0
2016-01-14 18:32:03,091 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F2A36140C4E54F71B2AC674F0AC85D58, mem on close (mb), free: 206, total: 388, max: 672
2016-01-14 18:32:03 Completed running task attempt: attempt_1452796322866_0001_1_00_000000_0
2016-01-14 18:32:03,092 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796322866_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:03,094 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796323085, Process_Duration=6, Process_End_Time=1452796323091, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:03,094 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F2A36140C4E54F71B2AC674F0AC85D58, taskAttemptId=attempt_1452796322866_0001_1_00_000000_0, startTime=1452796323051, finishTime=1452796323094, timeTaken=43, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796323085, Process_Duration=6, Process_End_Time=1452796323091, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:03,095 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:03,095 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:03,094 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:03,095 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796322866_0001_00_000001
2016-01-14 18:32:03,095 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796322866_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:03,096 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796322866_0001_1_00_000000_0
2016-01-14 18:32:03,096 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:03,098 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:03,098 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:TASK_FINISHED]: vertexName=F2A36140C4E54F71B2AC674F0AC85D58, taskId=task_1452796322866_0001_1_00_000000, startTime=1452796323051, finishTime=1452796323096, timeTaken=45, status=SUCCEEDED, successfulAttemptID=attempt_1452796322866_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796323085, Process_Duration=6, Process_End_Time=1452796323091, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:03,099 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796322866_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:03,099 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58] : 1
2016-01-14 18:32:03,099 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,100 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:03,100 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:VERTEX_FINISHED]: vertexName=F2A36140C4E54F71B2AC674F0AC85D58, vertexId=vertex_1452796322866_0001_1_00, initRequestedTime=1452796323029, initedTime=1452796323040, startRequestedTime=1452796323041, startedTime=1452796323041, finishTime=1452796323099, timeTaken=58, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796323085, Process_Duration=6, Process_End_Time=1452796323091, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796323051, firstTasksToStart=[ task_1452796322866_0001_1_00_000000 ], lastTaskFinishTime=1452796323094, lastTasksToFinish=[ task_1452796322866_0001_1_00_000000 ], minTaskDuration=43, maxTaskDuration=43, avgTaskDuration=43.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796322866_0001_1_00_000000 ], longestDurationTasks=[ task_1452796322866_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:03,100 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:03,101 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322866_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:03,101 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796322866_0001_00_000001, stoppedTime=1452796323101, exitStatus=0
2016-01-14 18:32:03,101 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:03,101 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322866_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:03,101 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:03,101 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796322866_0001_1
2016-01-14 18:32:03,101 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796322866_0001_1
2016-01-14 18:32:03,102 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 1B1DCE8EE1534118AAEC5DCA87573AB7 for vertex: vertex_1452796322866_0001_1_00 [F2A36140C4E54F71B2AC674F0AC85D58]
2016-01-14 18:32:03,108 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796322866_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:03,108 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796322866_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:03,108 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796322866_0001_00_000001, Exiting
2016-01-14 18:32:03,108 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796322866_0001_00_000001
2016-01-14 18:32:03,108 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796322866_0001_00_000001
2016-01-14 18:32:03,109 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796322866_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:03,110 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796322866_0001_00_000001 completed successfully
2016-01-14 18:32:03,112 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796322866_0001_1, queueSize=0
2016-01-14 18:32:03,112 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796322866_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796322866_0001_1, startTime=1452796323027, finishTime=1452796323111, timeTaken=84, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796323085, Process_Duration=6, Process_End_Time=1452796323091, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:03,112 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796322866_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:03,112 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796322866_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:03,112 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796322866_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:03 Completed Dag: dag_1452796322866_0001_1
2016-01-14 18:32:03,113 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796322866_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:03,113 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796322866_0001_1_post
2016-01-14 18:32:03,113 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:03,113 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:03,113 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796322866_0001_00_000001
2016-01-14 18:32:03,115 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:03,121 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...RESULTS.0_UNKNOWN_RESULTS, applicationId=application_1452796322866_0001
2016-01-14 18:32:03,123 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:03,123 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:03,123 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:03,123 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:03,123 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:03,124 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:03,125 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:03,125 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:03,125 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:03,126 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:03,126 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:03,127 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:03,127 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:03,131 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/74A38DD89ABD4551A04F3759B25DDD5B/B43F50E6A4144A28AF48B06E0E7B4829/.tez/application_1452796322866_0001
2016-01-14 18:32:03,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.285
2016-01-14 18:32:03,197 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:03,197 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:03,216 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_UNKNOWN_RESULTS
2016-01-14 18:32:03,240 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:03,241 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:03,282 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.010
2016-01-14 18:32:03,293 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 18:32:03,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:03,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:03,295 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:03,309 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:03,309 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_ALL
2016-01-14 18:32:03,319 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:03,319 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:03,319 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_ALL"]
2016-01-14 18:32:03,319 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:03,319 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:03,319 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:03,320 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ld'_RESULTS.0_UNKNOWN_ALL
2016-01-14 18:32:03,320 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:03,334 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:03,338 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:03,339 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:03,340 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:03,349 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C/.tez/application_1452796323339_0001 doesn't exist and is created
2016-01-14 18:32:03,364 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:03,364 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:03,365 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C/.tez/application_1452796323339_0001
2016-01-14 18:32:03,366 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796323339_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:03,377 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:03,378 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:03,380 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:03,380 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:03,380 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C/.tez/application_1452796323339_0001/localmode-log-dir
2016-01-14 18:32:03,381 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C/.tez/application_1452796323339_0001/localmode-log-dir/history.txt.appattempt_1452796323339_0001_000000, maxErrors=10
2016-01-14 18:32:03,381 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:03,381 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796323339_0001_000000, appSubmitTime=1452796323366, launchTime=1452796323366
2016-01-14 18:32:03,389 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:03,389 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:40755
2016-01-14 18:32:03,391 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:03,392 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:03,392 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:03,394 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:03,396 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796323339_0001_000000, startTime=1452796323396
2016-01-14 18:32:03,396 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:03,396 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:03,464 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:03,465 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:03,465 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL, applicationId=application_1452796323339_0001, dagName=[CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL
2016-01-14 18:32:03,482 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL
2016-01-14 18:32:03,484 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796323339_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C/.tez/application_1452796323339_0001/localmode-log-dir/dag_1452796323339_0001_1.dot
2016-01-14 18:32:03,484 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C/.tez/application_1452796323339_0001/localmode-log-dir/dag_1452796323339_0001_1-tez-dag.pb.txt
2016-01-14 18:32:03,500 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796323339_0001_1
2016-01-14 18:32:03,500 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:03,500 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL
2016-01-14 18:32:03 Running Dag: dag_1452796323339_0001_1
2016-01-14 18:32:03,509 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796323339_0001_1, submitTime=1452796323482
2016-01-14 18:32:03,509 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:03,510 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex EC1308002A0D4616867B598F42A6754C
2016-01-14 18:32:03,511 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:03,512 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:03,512 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796323339_0001_1, initTime=1452796323510
2016-01-14 18:32:03,512 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796323339_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:03,513 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:DAG_STARTED]: dagID=dag_1452796323339_0001_1, startTime=1452796323513
2016-01-14 18:32:03,513 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:03,513 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:03,513 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796323339_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:03,514 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL, applicationId=application_1452796323339_0001, dagName=[CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL
2016-01-14 18:32:03,514 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: EC1308002A0D4616867B598F42A6754C : {3D9E2729B3FF486B8033A1E0CBFC654A={InputName=3D9E2729B3FF486B8033A1E0CBFC654A}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:03,514 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 3D9E2729B3FF486B8033A1E0CBFC654A, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:03,514 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,514 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,514 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,515 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]. Starting root input initializers: 1
2016-01-14 18:32:03,515 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:03,516 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 3D9E2729B3FF486B8033A1E0CBFC654A on vertex vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,517 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:03,518 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 3D9E2729B3FF486B8033A1E0CBFC654A asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:03,518 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:03,519 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:03,520 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:03,520 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 3D9E2729B3FF486B8033A1E0CBFC654A on vertex vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,520 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:03,520 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {3D9E2729B3FF486B8033A1E0CBFC654A=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:03,521 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C] parallelism set to 1
2016-01-14 18:32:03,521 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:03,521 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796323339_0001_1_00, eventCount=1
2016-01-14 18:32:03,521 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,521 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=C4177E6BD2294B6EB2F14B5C11554873, vertexId=vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:03,522 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=C4177E6BD2294B6EB2F14B5C11554873, vertexId=vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,523 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=C4177E6BD2294B6EB2F14B5C11554873, vertexName=EC1308002A0D4616867B598F42A6754C, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:03,523 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=C4177E6BD2294B6EB2F14B5C11554873, vertexId=vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,524 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:03,524 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:VERTEX_INITIALIZED]: vertexName=EC1308002A0D4616867B598F42A6754C, vertexId=vertex_1452796323339_0001_1_00, initRequestedTime=1452796323514, initedTime=1452796323524, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:03,525 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C] with distanceFromRoot: 0
2016-01-14 18:32:03,525 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:03,525 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in EC1308002A0D4616867B598F42A6754C
2016-01-14 18:32:03,525 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,525 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:03,525 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796323339_0001_1_00, startRequestedTime=1452796323525, startedTime=1452796323525
2016-01-14 18:32:03,526 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:03,526 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:03,526 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:TASK_STARTED]: vertexName=EC1308002A0D4616867B598F42A6754C, taskId=task_1452796323339_0001_1_00_000000, scheduledTime=1452796323526, launchTime=1452796323526
2016-01-14 18:32:03,526 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796323339_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:03,527 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,527 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL, VertexName: EC1308002A0D4616867B598F42A6754C, VertexParallelism: 1, TaskAttemptID:attempt_1452796323339_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3D9E2729B3FF486B8033A1E0CBFC654A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C4177E6BD2294B6EB2F14B5C11554873, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:03,527 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796323339_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:03,527 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:03,528 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:03,528 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:03,528 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:03,529 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796323339_0001_00_000001
2016-01-14 18:32:03,529 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323339_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:03,531 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796323339_0001_00_000001
2016-01-14 18:32:03,531 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:03,532 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323339_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:03,532 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:03,532 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796323339_0001_00_000001, launchTime=1452796323532
2016-01-14 18:32:03,533 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796323339_0001_00_000001
2016-01-14 18:32:03,534 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796323339_0001_1_00_000000_0] to container: [container_1452796323339_0001_00_000001]
2016-01-14 18:32:03,534 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323339_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:03,535 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796323339_0001_1_00_000000_0] started. Is using containerId: [container_1452796323339_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:03,535 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=EC1308002A0D4616867B598F42A6754C, taskAttemptId=attempt_1452796323339_0001_1_00_000000_0, startTime=1452796323535, containerId=container_1452796323339_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796323339_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:03,535 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796323339_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:03,535 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796323339_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:03,536 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:03,536 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796323339_0001, with dag id: dag_1452796323339_0001_1
2016-01-14 18:32:03,537 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796323339_0001_00_000001 given task: attempt_1452796323339_0001_1_00_000000_0
2016-01-14 18:32:03,537 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796323339_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796323339_0001_1_00_000000_0
2016-01-14 18:32:03 Starting to run new task attempt: attempt_1452796323339_0001_1_00_000000_0
2016-01-14 18:32:03,537 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796323339_0001_1_00_000000_0
2016-01-14 18:32:03,537 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:03,537 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:03,537 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:03,537 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:03,538 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:03,538 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:03,538 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C] every.every/(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL, VertexName: EC1308002A0D4616867B598F42A6754C, VertexParallelism: 1, TaskAttemptID:attempt_1452796323339_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3D9E2729B3FF486B8033A1E0CBFC654A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C4177E6BD2294B6EB2F14B5C11554873, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:03,538 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:03,539 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796323339_0001_1_00_000000_0
2016-01-14 18:32:03,539 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:03,540 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:03,540 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796323339_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:03,540 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:03,540 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=3D9E2729B3FF486B8033A1E0CBFC654A, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:03,540 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=C4177E6BD2294B6EB2F14B5C11554873, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:03,541 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:03,541 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:03,541 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 3D9E2729B3FF486B8033A1E0CBFC654A
2016-01-14 18:32:03,541 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: C4177E6BD2294B6EB2F14B5C11554873
2016-01-14 18:32:03,541 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:03,541 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 3D9E2729B3FF486B8033A1E0CBFC654A
2016-01-14 18:32:03,541 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: C4177E6BD2294B6EB2F14B5C11554873
2016-01-14 18:32:03,544 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:03,546 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:03,547 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 3D9E2729B3FF486B8033A1E0CBFC654A
2016-01-14 18:32:03,548 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 3D9E2729B3FF486B8033A1E0CBFC654A
2016-01-14 18:32:03,551 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:03,551 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: C4177E6BD2294B6EB2F14B5C11554873
2016-01-14 18:32:03,551 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: EC1308002A0D4616867B598F42A6754C, ordinal: 0
2016-01-14 18:32:03,552 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EC1308002A0D4616867B598F42A6754C, mem on start (mb), free: 326, total: 387, max: 672
2016-01-14 18:32:03,552 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:03,552 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:03,552 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:03,553 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:03,553 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:03,553 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:03,553 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:03,554 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:03,554 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:03,554 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:03,555 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:03,555 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 3D9E2729B3FF486B8033A1E0CBFC654A, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:03,555 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, C4177E6BD2294B6EB2F14B5C11554873, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:03,555 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:03,556 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 3D9E2729B3FF486B8033A1E0CBFC654A being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:03,556 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:03,556 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:03,556 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 3D9E2729B3FF486B8033A1E0CBFC654A
2016-01-14 18:32:03,557 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:03,557 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 3D9E2729B3FF486B8033A1E0CBFC654A
2016-01-14 18:32:03,557 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:03,557 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796323339_0001_1_00_000000_0
2016-01-14 18:32:03,558 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:03,558 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5079c3bb
2016-01-14 18:32:03,559 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5079c3bb
2016-01-14 18:32:03,559 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:03,559 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:03,561 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:03,562 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 3D9E2729B3FF486B8033A1E0CBFC654A
2016-01-14 18:32:03,562 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_ALL"], id: C4177E6BD2294B6EB2F14B5C11554873
2016-01-14 18:32:03,563 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_ALL"]
2016-01-14 18:32:03,563 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:03,563 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:03,564 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: EC1308002A0D4616867B598F42A6754C, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:03,567 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:03,567 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:03,568 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796323339_0001_1_00_000000_0
2016-01-14 18:32:03,568 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796323339_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:03,569 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796323339_0001_1_00_000000_0
2016-01-14 18:32:03,569 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: EC1308002A0D4616867B598F42A6754C, mem on close (mb), free: 324, total: 387, max: 672
2016-01-14 18:32:03 Completed running task attempt: attempt_1452796323339_0001_1_00_000000_0
2016-01-14 18:32:03,570 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796323339_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:03,571 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796323564, Process_Duration=5, Process_End_Time=1452796323569, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:03,572 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=EC1308002A0D4616867B598F42A6754C, taskAttemptId=attempt_1452796323339_0001_1_00_000000_0, startTime=1452796323535, finishTime=1452796323571, timeTaken=36, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796323564, Process_Duration=5, Process_End_Time=1452796323569, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:03,572 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796323339_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:03,572 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:03,572 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796323339_0001_1_00_000000_0
2016-01-14 18:32:03,572 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:03,573 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:03,573 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:TASK_FINISHED]: vertexName=EC1308002A0D4616867B598F42A6754C, taskId=task_1452796323339_0001_1_00_000000, startTime=1452796323535, finishTime=1452796323573, timeTaken=38, status=SUCCEEDED, successfulAttemptID=attempt_1452796323339_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796323564, Process_Duration=5, Process_End_Time=1452796323569, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:03,573 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:03,574 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796323339_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:03,574 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C] : 1
2016-01-14 18:32:03,574 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,574 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:03,574 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:03,575 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:VERTEX_FINISHED]: vertexName=EC1308002A0D4616867B598F42A6754C, vertexId=vertex_1452796323339_0001_1_00, initRequestedTime=1452796323514, initedTime=1452796323524, startRequestedTime=1452796323525, startedTime=1452796323525, finishTime=1452796323574, timeTaken=49, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796323564, Process_Duration=5, Process_End_Time=1452796323569, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796323535, firstTasksToStart=[ task_1452796323339_0001_1_00_000000 ], lastTaskFinishTime=1452796323571, lastTasksToFinish=[ task_1452796323339_0001_1_00_000000 ], minTaskDuration=36, maxTaskDuration=36, avgTaskDuration=36.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796323339_0001_1_00_000000 ], longestDurationTasks=[ task_1452796323339_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:03,575 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:03,575 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323339_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:03,575 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796323339_0001_00_000001, stoppedTime=1452796323575, exitStatus=0
2016-01-14 18:32:03,575 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796323339_0001_00_000001
2016-01-14 18:32:03,575 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:03,575 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323339_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:03,576 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:03,576 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796323339_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:03,576 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796323339_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:03,576 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796323339_0001_1
2016-01-14 18:32:03,576 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796323339_0001_00_000001, Exiting
2016-01-14 18:32:03,577 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796323339_0001_1
2016-01-14 18:32:03,577 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: C4177E6BD2294B6EB2F14B5C11554873 for vertex: vertex_1452796323339_0001_1_00 [EC1308002A0D4616867B598F42A6754C]
2016-01-14 18:32:03,577 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796323339_0001_00_000001
2016-01-14 18:32:03,577 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796323339_0001_00_000001
2016-01-14 18:32:03,579 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796323339_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:03,579 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796323339_0001_00_000001 completed successfully
2016-01-14 18:32:03,588 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796323339_0001_1, queueSize=0
2016-01-14 18:32:03,589 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:03,589 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323339_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796323339_0001_1, startTime=1452796323513, finishTime=1452796323585, timeTaken=72, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796323564, Process_Duration=5, Process_End_Time=1452796323569, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:03,589 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796323339_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:03,589 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796323339_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:03,589 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796323339_0001_00_000001
2016-01-14 18:32:03,589 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323339_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:03 Completed Dag: dag_1452796323339_0001_1
2016-01-14 18:32:03,591 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796323339_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:03,591 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796323339_0001_1_post
2016-01-14 18:32:03,591 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:03,591 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:03,597 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.0_UNKNOWN_ALL, applicationId=application_1452796323339_0001
2016-01-14 18:32:03,599 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:03,600 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:03,600 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:03,600 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:03,600 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:03,601 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:03,601 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:03,602 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:03,602 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:03,602 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:03,602 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:03,602 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:03,603 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:03,609 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CA25B517AB83402586627E6BCD0F963E/C7D51E21008143AB914E4313BC240C1C/.tez/application_1452796323339_0001
2016-01-14 18:32:03,610 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.291
2016-01-14 18:32:03,681 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_UNKNOWN_ALL
2016-01-14 18:32:03,702 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:03,702 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:03,704 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:03,704 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:03,739 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 18:32:03,752 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-14 18:32:03,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:03,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:03,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:03,770 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:03,770 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_-1
2016-01-14 18:32:03,780 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:03,780 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:03,780 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_-1"]
2016-01-14 18:32:03,780 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:03,781 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:03,781 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:03,781 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 18:32:03,782 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:03,794 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:03,799 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:03,799 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:03,799 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:03,808 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0/.tez/application_1452796323799_0001 doesn't exist and is created
2016-01-14 18:32:03,824 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:03,824 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:03,825 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0/.tez/application_1452796323799_0001
2016-01-14 18:32:03,827 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796323799_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:03,839 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:03,839 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:03,841 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:03,841 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:03,842 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0/.tez/application_1452796323799_0001/localmode-log-dir
2016-01-14 18:32:03,842 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0/.tez/application_1452796323799_0001/localmode-log-dir/history.txt.appattempt_1452796323799_0001_000000, maxErrors=10
2016-01-14 18:32:03,842 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:03,842 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796323799_0001_000000, appSubmitTime=1452796323827, launchTime=1452796323827
2016-01-14 18:32:03,847 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:03,848 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:03,848 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:03,851 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:03,852 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:51868
2016-01-14 18:32:03,853 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:03,855 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796323799_0001_000000, startTime=1452796323855
2016-01-14 18:32:03,855 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:03,855 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:03,925 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:03,925 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:03,925 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ield'_RESULTS.0_VALUES_-1, applicationId=application_1452796323799_0001, dagName=[53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 18:32:03,943 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 18:32:03,944 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796323799_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0/.tez/application_1452796323799_0001/localmode-log-dir/dag_1452796323799_0001_1.dot
2016-01-14 18:32:03,944 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0/.tez/application_1452796323799_0001/localmode-log-dir/dag_1452796323799_0001_1-tez-dag.pb.txt
2016-01-14 18:32:03,950 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796323799_0001_1
2016-01-14 18:32:03,950 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:03,950 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 18:32:03 Running Dag: dag_1452796323799_0001_1
2016-01-14 18:32:03,959 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:03,960 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796323799_0001_1, submitTime=1452796323943
2016-01-14 18:32:03,960 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex DCA6136B7DED491BBCB9C2344700FD35
2016-01-14 18:32:03,961 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:03,961 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:03,961 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796323799_0001_1, initTime=1452796323960
2016-01-14 18:32:03,961 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796323799_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:03,962 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:DAG_STARTED]: dagID=dag_1452796323799_0001_1, startTime=1452796323962
2016-01-14 18:32:03,962 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:03,962 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:03,962 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796323799_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:03,962 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: DCA6136B7DED491BBCB9C2344700FD35 : {1CD4EDC8D65A4E7283D711BF47142B1C={InputName=1CD4EDC8D65A4E7283D711BF47142B1C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:03,962 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 1CD4EDC8D65A4E7283D711BF47142B1C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:03,962 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:03,962 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:03,963 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:03,963 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]. Starting root input initializers: 1
2016-01-14 18:32:03,963 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:03,964 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 1CD4EDC8D65A4E7283D711BF47142B1C on vertex vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:03,965 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ield'_RESULTS.0_VALUES_-1, applicationId=application_1452796323799_0001, dagName=[53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 18:32:03,967 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:03,967 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 1CD4EDC8D65A4E7283D711BF47142B1C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:03,967 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:03,968 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:03,969 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:03,969 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 1CD4EDC8D65A4E7283D711BF47142B1C on vertex vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:03,969 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:03,970 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {1CD4EDC8D65A4E7283D711BF47142B1C=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:03,970 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] parallelism set to 1
2016-01-14 18:32:03,970 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:03,970 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796323799_0001_1_00, eventCount=1
2016-01-14 18:32:03,970 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:03,970 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=3C321296FD74484280CA37D08D918189, vertexId=vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:03,971 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=3C321296FD74484280CA37D08D918189, vertexId=vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:03,972 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=3C321296FD74484280CA37D08D918189, vertexName=DCA6136B7DED491BBCB9C2344700FD35, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:03,973 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=3C321296FD74484280CA37D08D918189, vertexId=vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:03,974 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:03,974 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:VERTEX_INITIALIZED]: vertexName=DCA6136B7DED491BBCB9C2344700FD35, vertexId=vertex_1452796323799_0001_1_00, initRequestedTime=1452796323962, initedTime=1452796323973, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:03,974 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] with distanceFromRoot: 0
2016-01-14 18:32:03,974 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:03,974 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in DCA6136B7DED491BBCB9C2344700FD35
2016-01-14 18:32:03,974 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:03,975 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:03,975 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796323799_0001_1_00, startRequestedTime=1452796323974, startedTime=1452796323974
2016-01-14 18:32:03,975 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:03,976 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:03,976 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:TASK_STARTED]: vertexName=DCA6136B7DED491BBCB9C2344700FD35, taskId=task_1452796323799_0001_1_00_000000, scheduledTime=1452796323975, launchTime=1452796323975
2016-01-14 18:32:03,976 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796323799_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:03,976 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:03,976 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1, VertexName: DCA6136B7DED491BBCB9C2344700FD35, VertexParallelism: 1, TaskAttemptID:attempt_1452796323799_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1CD4EDC8D65A4E7283D711BF47142B1C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3C321296FD74484280CA37D08D918189, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:03,977 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796323799_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:03,977 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:03,977 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:03,978 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:03,978 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:03,978 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796323799_0001_00_000001
2016-01-14 18:32:03,979 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323799_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:03,980 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796323799_0001_00_000001
2016-01-14 18:32:03,980 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:03,981 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323799_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:03,981 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:03,981 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796323799_0001_00_000001, launchTime=1452796323981
2016-01-14 18:32:03,982 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796323799_0001_00_000001
2016-01-14 18:32:03,982 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796323799_0001_1_00_000000_0] to container: [container_1452796323799_0001_00_000001]
2016-01-14 18:32:03,982 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323799_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:03,983 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796323799_0001_1_00_000000_0] started. Is using containerId: [container_1452796323799_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:03,983 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=DCA6136B7DED491BBCB9C2344700FD35, taskAttemptId=attempt_1452796323799_0001_1_00_000000_0, startTime=1452796323982, containerId=container_1452796323799_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796323799_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:03,983 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796323799_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:03,983 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796323799_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:03,983 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:03,983 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796323799_0001_00_000001 given task: attempt_1452796323799_0001_1_00_000000_0
2016-01-14 18:32:03,983 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796323799_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796323799_0001_1_00_000000_0
2016-01-14 18:32:03 Starting to run new task attempt: attempt_1452796323799_0001_1_00_000000_0
2016-01-14 18:32:03,984 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796323799_0001_1_00_000000_0
2016-01-14 18:32:03,984 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:03,984 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:03,984 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:03,984 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:03,984 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:03,985 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:03,985 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0] every.every/(1/1) ...ield'_RESULTS.0_VALUES_-1, VertexName: DCA6136B7DED491BBCB9C2344700FD35, VertexParallelism: 1, TaskAttemptID:attempt_1452796323799_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1CD4EDC8D65A4E7283D711BF47142B1C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3C321296FD74484280CA37D08D918189, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:03,985 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:03,985 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796323799_0001_1_00_000000_0
2016-01-14 18:32:03,986 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:03,986 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:03,986 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=1CD4EDC8D65A4E7283D711BF47142B1C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:03,986 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:03,987 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 1CD4EDC8D65A4E7283D711BF47142B1C
2016-01-14 18:32:03,987 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 1CD4EDC8D65A4E7283D711BF47142B1C
2016-01-14 18:32:03,987 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:03,990 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796323799_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:03,991 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:03,991 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 1CD4EDC8D65A4E7283D711BF47142B1C
2016-01-14 18:32:03,991 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 1CD4EDC8D65A4E7283D711BF47142B1C
2016-01-14 18:32:03,992 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=3C321296FD74484280CA37D08D918189, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:03,992 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:03,992 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:03,992 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 3C321296FD74484280CA37D08D918189
2016-01-14 18:32:03,993 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:03,993 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 3C321296FD74484280CA37D08D918189
2016-01-14 18:32:03,999 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796323799_0001, with dag id: dag_1452796323799_0001_1
2016-01-14 18:32:04,003 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:04,004 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 3C321296FD74484280CA37D08D918189
2016-01-14 18:32:04,004 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: DCA6136B7DED491BBCB9C2344700FD35, ordinal: 0
2016-01-14 18:32:04,005 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DCA6136B7DED491BBCB9C2344700FD35, mem on start (mb), free: 235, total: 387, max: 672
2016-01-14 18:32:04,005 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:04,005 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:04,005 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:04,005 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:04,005 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:04,006 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:04,006 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:04,006 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:04,007 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:04,007 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:04,007 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:04,007 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 1CD4EDC8D65A4E7283D711BF47142B1C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:04,008 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 3C321296FD74484280CA37D08D918189, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:04,008 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:04,008 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 1CD4EDC8D65A4E7283D711BF47142B1C being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:04,008 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 1CD4EDC8D65A4E7283D711BF47142B1C
2016-01-14 18:32:04,009 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:04,009 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 1CD4EDC8D65A4E7283D711BF47142B1C
2016-01-14 18:32:04,008 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:04,009 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:04,009 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:04,010 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796323799_0001_1_00_000000_0
2016-01-14 18:32:04,010 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:04,011 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@6bde47cf
2016-01-14 18:32:04,014 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@6bde47cf
2016-01-14 18:32:04,014 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:04,015 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:04,015 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:04,016 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 1CD4EDC8D65A4E7283D711BF47142B1C
2016-01-14 18:32:04,017 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_-1"], id: 3C321296FD74484280CA37D08D918189
2016-01-14 18:32:04,017 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_-1"]
2016-01-14 18:32:04,018 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:04,018 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:04,018 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: DCA6136B7DED491BBCB9C2344700FD35, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:04,019 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,022 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,026 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,030 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:04,031 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:04,031 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796323799_0001_1_00_000000_0
2016-01-14 18:32:04,031 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796323799_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:04,032 INFO task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452796323799_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,038 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=DCA6136B7DED491BBCB9C2344700FD35, taskAttemptId=attempt_1452796323799_0001_1_00_000000_0, startTime=1452796323982, finishTime=1452796324037, timeTaken=55, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452796324018, Process_Duration=14, Process_End_Time=1452796324032, Read_Duration=0, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 18:32:04,038 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796323799_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 18:32:04,038 INFO impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452796323799_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 18:32:04,038 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:TASK_FINISHED]: vertexName=DCA6136B7DED491BBCB9C2344700FD35, taskId=task_1452796323799_0001_1_00_000000, startTime=1452796323982, finishTime=1452796324038, timeTaken=56, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 18:32:04,039 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796323799_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 18:32:04,039 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] : 1
2016-01-14 18:32:04,039 INFO impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] because task failed: task_1452796323799_0001_1_00_000000
2016-01-14 18:32:04,039 INFO impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] due to trigger: OWN_TASK_FAILURE
2016-01-14 18:32:04,039 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 18:32:04,039 INFO impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:04,040 INFO impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=3C321296FD74484280CA37D08D918189, vertexId=vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:04,041 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:04,041 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:04,042 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:04,044 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:VERTEX_FINISHED]: vertexName=DCA6136B7DED491BBCB9C2344700FD35, vertexId=vertex_1452796323799_0001_1_00, initRequestedTime=1452796323962, initedTime=1452796323973, startRequestedTime=1452796323974, startedTime=1452796323974, finishTime=1452796324044, timeTaken=70, status=FAILED, diagnostics=Task failed, taskId=task_1452796323799_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452796323982, firstTasksToStart=[ task_1452796323799_0001_1_00_000000 ], lastTaskFinishTime=1452796324037, lastTasksToFinish=[ task_1452796323799_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[ ], longestDurationTasks=[ ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 18:32:04,044 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 18:32:04,046 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:04,048 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 19 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452796324018, Process_Duration=14, Process_End_Time=1452796324032, Read_Duration=0, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 18:32:04,048 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:04,048 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796323799_0001_00_000001, stoppedTime=1452796324048, exitStatus=0
2016-01-14 18:32:04,048 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323799_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:04,049 INFO node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452796323799_0001_1_00_000000_0 failed: true container: container_1452796323799_0001_00_000001 numFailedTAs: 0
2016-01-14 18:32:04,050 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 18:32:04,051 INFO impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 18:32:04,051 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796323799_0001_1
2016-01-14 18:32:04,051 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 3C321296FD74484280CA37D08D918189 for vertex: vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35]
2016-01-14 18:32:04,052 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796323799_0001_1, queueSize=0
2016-01-14 18:32:04,053 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796323799_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796323799_0001_1, startTime=1452796323962, finishTime=1452796324052, timeTaken=90, status=FAILED, diagnostics=Vertex failed, vertexName=DCA6136B7DED491BBCB9C2344700FD35, vertexId=vertex_1452796323799_0001_1_00, diagnostics=[Task failed, taskId=task_1452796323799_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452796323799_0001_1_00 [DCA6136B7DED491BBCB9C2344700FD35] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 18:32:04,053 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796323799_0001_1 finished with state: FAILED
2016-01-14 18:32:04,053 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796323799_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:04,053 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452796323799_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 18:32:04,058 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:04,051 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DCA6136B7DED491BBCB9C2344700FD35, mem on close (mb), free: 232, total: 387, max: 672
2016-01-14 18:32:04,060 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=DCA6136B7DED491BBCB9C2344700FD35, index=0
2016-01-14 18:32:04,060 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=DCA6136B7DED491BBCB9C2344700FD35, sourceVertex=1CD4EDC8D65A4E7283D711BF47142B1C
2016-01-14 18:32:04,060 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=DCA6136B7DED491BBCB9C2344700FD35, sourceVertex=3C321296FD74484280CA37D08D918189
2016-01-14 18:32:04,061 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796323799_0001_00_000001
2016-01-14 18:32:04,061 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796323799_0001_00_000001
2016-01-14 18:32:04 Completed Dag: dag_1452796323799_0001_1
2016-01-14 18:32:04,062 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796323799_0001_1, dagState=FAILED
2016-01-14 18:32:04,062 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796323799_0001_1_post
2016-01-14 18:32:04,062 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:04,063 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:04,063 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323799_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 18:32:04,064 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796323799_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 18:32:04,064 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452796323799_0001_00_000001 completed but with errors
2016-01-14 18:32:04,064 INFO container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452796323799_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 18:32:04,065 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796323799_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 18:32:04,065 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796323799_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 18:32:04,066 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ield'_RESULTS.0_VALUES_-1, applicationId=application_1452796323799_0001
2016-01-14 18:32:04,069 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:04,069 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:04,069 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:04,070 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:04,070 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:04,075 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:04,075 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:04,075 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:04,076 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:04,076 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:04,076 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:04,077 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:04,078 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:04,084 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/53C82781F5804D2EBC273049707F16D5/E6E0E0F221DF494D9F4DCD86239A5EE0/.tez/application_1452796323799_0001
2016-01-14 18:32:04,084 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 18:32:04,084 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...ield'_RESULTS.0_VALUES_-1
2016-01-14 18:32:04,085 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 18:32:04,086 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.305
2016-01-14 18:32:04,086 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_VALUES_-1
2016-01-14 18:32:04,118 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:04,119 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:04,152 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2016-01-14 18:32:04,153 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.006
2016-01-14 18:32:04,154 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:04,154 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:04,155 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_VALUES_'field2'
2016-01-14 18:32:04,179 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:04,180 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:04,210 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:04,210 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:04,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.010
2016-01-14 18:32:04,221 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 18:32:04,221 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:04,222 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:04,222 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:04,238 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:04,239 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_RESULTS
2016-01-14 18:32:04,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:04,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:04,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_RESULTS"]
2016-01-14 18:32:04,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:04,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:04,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:04,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 18:32:04,249 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:04,262 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:04,267 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:04,267 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:04,267 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:04,276 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381/.tez/application_1452796324267_0001 doesn't exist and is created
2016-01-14 18:32:04,291 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:04,291 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:04,292 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381/.tez/application_1452796324267_0001
2016-01-14 18:32:04,294 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796324267_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:04,306 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:04,307 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:04,308 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:04,308 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:04,309 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381/.tez/application_1452796324267_0001/localmode-log-dir
2016-01-14 18:32:04,309 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381/.tez/application_1452796324267_0001/localmode-log-dir/history.txt.appattempt_1452796324267_0001_000000, maxErrors=10
2016-01-14 18:32:04,310 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:04,310 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796324267_0001_000000, appSubmitTime=1452796324293, launchTime=1452796324294
2016-01-14 18:32:04,314 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:04,315 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:04,316 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:04,316 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:04,318 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:42903
2016-01-14 18:32:04,319 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:04,321 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796324267_0001_000000, startTime=1452796324321
2016-01-14 18:32:04,321 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:04,321 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:04,391 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:04,392 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:04,392 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ..._RESULTS.0_VALUES_RESULTS, applicationId=application_1452796324267_0001, dagName=[1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 18:32:04,409 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 18:32:04,410 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796324267_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381/.tez/application_1452796324267_0001/localmode-log-dir/dag_1452796324267_0001_1.dot
2016-01-14 18:32:04,411 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381/.tez/application_1452796324267_0001/localmode-log-dir/dag_1452796324267_0001_1-tez-dag.pb.txt
2016-01-14 18:32:04,415 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796324267_0001_1
2016-01-14 18:32:04,415 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:04,415 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 18:32:04 Running Dag: dag_1452796324267_0001_1
2016-01-14 18:32:04,425 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796324267_0001_1, submitTime=1452796324409
2016-01-14 18:32:04,425 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:04,425 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F974D83F1093442FA48B2710165E1491
2016-01-14 18:32:04,425 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:04,426 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796324267_0001_1, initTime=1452796324425
2016-01-14 18:32:04,426 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:04,426 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796324267_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:04,426 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:DAG_STARTED]: dagID=dag_1452796324267_0001_1, startTime=1452796324426
2016-01-14 18:32:04,426 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:04,427 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796324267_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:04,427 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ..._RESULTS.0_VALUES_RESULTS, applicationId=application_1452796324267_0001, dagName=[1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 18:32:04,427 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:04,427 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F974D83F1093442FA48B2710165E1491 : {FEE8CD8A9CF74978A112B3501E2B651D={InputName=FEE8CD8A9CF74978A112B3501E2B651D}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:04,429 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: FEE8CD8A9CF74978A112B3501E2B651D, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:04,429 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,429 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,429 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,429 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]. Starting root input initializers: 1
2016-01-14 18:32:04,430 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:04,430 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: FEE8CD8A9CF74978A112B3501E2B651D on vertex vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,431 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:04,432 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input FEE8CD8A9CF74978A112B3501E2B651D asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:04,432 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:04,432 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:04,434 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:04,434 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: FEE8CD8A9CF74978A112B3501E2B651D on vertex vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,434 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:04,434 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {FEE8CD8A9CF74978A112B3501E2B651D=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:04,434 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] parallelism set to 1
2016-01-14 18:32:04,434 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:04,435 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796324267_0001_1_00, eventCount=1
2016-01-14 18:32:04,435 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,435 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=8D251FED3D5C488D909B76FBEDA864E8, vertexId=vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:04,435 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=8D251FED3D5C488D909B76FBEDA864E8, vertexId=vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,437 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=8D251FED3D5C488D909B76FBEDA864E8, vertexName=F974D83F1093442FA48B2710165E1491, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:04,439 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=8D251FED3D5C488D909B76FBEDA864E8, vertexId=vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,440 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:04,440 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F974D83F1093442FA48B2710165E1491, vertexId=vertex_1452796324267_0001_1_00, initRequestedTime=1452796324427, initedTime=1452796324440, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:04,440 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] with distanceFromRoot: 0
2016-01-14 18:32:04,441 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:04,441 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F974D83F1093442FA48B2710165E1491
2016-01-14 18:32:04,441 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,442 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:04,442 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796324267_0001_1_00, startRequestedTime=1452796324441, startedTime=1452796324441
2016-01-14 18:32:04,442 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:04,442 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:04,443 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:TASK_STARTED]: vertexName=F974D83F1093442FA48B2710165E1491, taskId=task_1452796324267_0001_1_00_000000, scheduledTime=1452796324442, launchTime=1452796324442
2016-01-14 18:32:04,443 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796324267_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:04,443 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,444 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS, VertexName: F974D83F1093442FA48B2710165E1491, VertexParallelism: 1, TaskAttemptID:attempt_1452796324267_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=FEE8CD8A9CF74978A112B3501E2B651D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=8D251FED3D5C488D909B76FBEDA864E8, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:04,444 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796324267_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:04,444 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:04,445 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:04,445 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:04,445 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:04,446 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796324267_0001_00_000001
2016-01-14 18:32:04,446 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796324267_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:04,446 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796324267_0001, with dag id: dag_1452796324267_0001_1
2016-01-14 18:32:04,448 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796324267_0001_00_000001
2016-01-14 18:32:04,449 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:04,450 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796324267_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:04,450 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:04,451 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796324267_0001_00_000001, launchTime=1452796324450
2016-01-14 18:32:04,451 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796324267_0001_00_000001
2016-01-14 18:32:04,452 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796324267_0001_1_00_000000_0] to container: [container_1452796324267_0001_00_000001]
2016-01-14 18:32:04,452 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796324267_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:04,452 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796324267_0001_1_00_000000_0] started. Is using containerId: [container_1452796324267_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:04,453 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F974D83F1093442FA48B2710165E1491, taskAttemptId=attempt_1452796324267_0001_1_00_000000_0, startTime=1452796324452, containerId=container_1452796324267_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796324267_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:04,453 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:04,453 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796324267_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:04,453 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796324267_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:04,453 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796324267_0001_00_000001 given task: attempt_1452796324267_0001_1_00_000000_0
2016-01-14 18:32:04,453 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796324267_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796324267_0001_1_00_000000_0
2016-01-14 18:32:04 Starting to run new task attempt: attempt_1452796324267_0001_1_00_000000_0
2016-01-14 18:32:04,453 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796324267_0001_1_00_000000_0
2016-01-14 18:32:04,454 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:04,454 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:04,454 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:04,454 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:04,454 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:04,454 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:04,454 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381] every.every/(1/1) ..._RESULTS.0_VALUES_RESULTS, VertexName: F974D83F1093442FA48B2710165E1491, VertexParallelism: 1, TaskAttemptID:attempt_1452796324267_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=FEE8CD8A9CF74978A112B3501E2B651D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=8D251FED3D5C488D909B76FBEDA864E8, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:04,454 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:04,455 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796324267_0001_1_00_000000_0
2016-01-14 18:32:04,455 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:04,455 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:04,455 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796324267_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:04,456 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:04,456 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=FEE8CD8A9CF74978A112B3501E2B651D, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:04,456 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:04,456 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: FEE8CD8A9CF74978A112B3501E2B651D
2016-01-14 18:32:04,457 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: FEE8CD8A9CF74978A112B3501E2B651D
2016-01-14 18:32:04,457 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=8D251FED3D5C488D909B76FBEDA864E8, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:04,458 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:04,458 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 8D251FED3D5C488D909B76FBEDA864E8
2016-01-14 18:32:04,458 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:04,459 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:04,459 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:04,459 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: FEE8CD8A9CF74978A112B3501E2B651D
2016-01-14 18:32:04,460 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: FEE8CD8A9CF74978A112B3501E2B651D
2016-01-14 18:32:04,459 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 8D251FED3D5C488D909B76FBEDA864E8
2016-01-14 18:32:04,469 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F974D83F1093442FA48B2710165E1491, ordinal: 0
2016-01-14 18:32:04,469 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F974D83F1093442FA48B2710165E1491, mem on start (mb), free: 145, total: 387, max: 672
2016-01-14 18:32:04,469 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:04,470 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:04,470 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:04,470 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:04,471 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 8D251FED3D5C488D909B76FBEDA864E8
2016-01-14 18:32:04,471 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:04,471 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:04,471 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:04,472 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:04,472 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:04,472 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:04,472 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:04,472 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:04,473 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, FEE8CD8A9CF74978A112B3501E2B651D, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:04,473 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 8D251FED3D5C488D909B76FBEDA864E8, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:04,473 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:04,473 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: FEE8CD8A9CF74978A112B3501E2B651D
2016-01-14 18:32:04,473 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:04,473 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: FEE8CD8A9CF74978A112B3501E2B651D
2016-01-14 18:32:04,474 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: FEE8CD8A9CF74978A112B3501E2B651D being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:04,474 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:04,474 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:04,475 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:04,475 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796324267_0001_1_00_000000_0
2016-01-14 18:32:04,475 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:04,476 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@6d89de28
2016-01-14 18:32:04,477 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@6d89de28
2016-01-14 18:32:04,477 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:04,477 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:04,479 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:04,480 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: FEE8CD8A9CF74978A112B3501E2B651D
2016-01-14 18:32:04,480 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_RESULTS"], id: 8D251FED3D5C488D909B76FBEDA864E8
2016-01-14 18:32:04,480 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_RESULTS"]
2016-01-14 18:32:04,481 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:04,481 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:04,481 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F974D83F1093442FA48B2710165E1491, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:04,482 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,484 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,486 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,492 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:04,492 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:04,493 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796324267_0001_1_00_000000_0
2016-01-14 18:32:04,493 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796324267_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:04,494 INFO task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452796324267_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,501 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:04,501 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F974D83F1093442FA48B2710165E1491, taskAttemptId=attempt_1452796324267_0001_1_00_000000_0, startTime=1452796324452, finishTime=1452796324500, timeTaken=48, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452796324481, Process_Duration=13, Process_End_Time=1452796324494, Read_Duration=1, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 18:32:04,501 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796324267_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 18:32:04,501 INFO impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452796324267_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 18:32:04,502 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:TASK_FINISHED]: vertexName=F974D83F1093442FA48B2710165E1491, taskId=task_1452796324267_0001_1_00_000000, startTime=1452796324452, finishTime=1452796324501, timeTaken=49, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 18:32:04,502 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796324267_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 18:32:04,502 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:04,502 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:04,502 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] : 1
2016-01-14 18:32:04,502 INFO impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] because task failed: task_1452796324267_0001_1_00_000000
2016-01-14 18:32:04,502 INFO impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] due to trigger: OWN_TASK_FAILURE
2016-01-14 18:32:04,503 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 19 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=405798912, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452796324481, Process_Duration=13, Process_End_Time=1452796324494, Read_Duration=1, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 18:32:04,503 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 18:32:04,503 INFO impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,503 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F974D83F1093442FA48B2710165E1491, mem on close (mb), free: 142, total: 387, max: 672
2016-01-14 18:32:04,503 INFO impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=8D251FED3D5C488D909B76FBEDA864E8, vertexId=vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,503 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=F974D83F1093442FA48B2710165E1491, index=0
2016-01-14 18:32:04,504 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=F974D83F1093442FA48B2710165E1491, sourceVertex=FEE8CD8A9CF74978A112B3501E2B651D
2016-01-14 18:32:04,504 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=F974D83F1093442FA48B2710165E1491, sourceVertex=8D251FED3D5C488D909B76FBEDA864E8
2016-01-14 18:32:04,504 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796324267_0001_00_000001
2016-01-14 18:32:04,504 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796324267_0001_00_000001
2016-01-14 18:32:04,505 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:04,506 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:VERTEX_FINISHED]: vertexName=F974D83F1093442FA48B2710165E1491, vertexId=vertex_1452796324267_0001_1_00, initRequestedTime=1452796324427, initedTime=1452796324440, startRequestedTime=1452796324441, startedTime=1452796324441, finishTime=1452796324505, timeTaken=64, status=FAILED, diagnostics=Task failed, taskId=task_1452796324267_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452796324452, firstTasksToStart=[ task_1452796324267_0001_1_00_000000 ], lastTaskFinishTime=1452796324500, lastTasksToFinish=[ task_1452796324267_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[ ], longestDurationTasks=[ ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 18:32:04,506 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 18:32:04,506 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796324267_0001_00_000001, stoppedTime=1452796324506, exitStatus=0
2016-01-14 18:32:04,507 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:04,507 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796324267_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:04,507 INFO node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452796324267_0001_1_00_000000_0 failed: true container: container_1452796324267_0001_00_000001 numFailedTAs: 0
2016-01-14 18:32:04,507 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 18:32:04,508 INFO impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 18:32:04,508 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796324267_0001_1
2016-01-14 18:32:04,508 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 8D251FED3D5C488D909B76FBEDA864E8 for vertex: vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491]
2016-01-14 18:32:04,509 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796324267_0001_1, queueSize=0
2016-01-14 18:32:04,509 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:04,510 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796324267_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 18:32:04,510 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324267_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796324267_0001_1, startTime=1452796324426, finishTime=1452796324509, timeTaken=83, status=FAILED, diagnostics=Vertex failed, vertexName=F974D83F1093442FA48B2710165E1491, vertexId=vertex_1452796324267_0001_1_00, diagnostics=[Task failed, taskId=task_1452796324267_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452796324267_0001_1_00 [F974D83F1093442FA48B2710165E1491] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 18:32:04,511 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796324267_0001_1 finished with state: FAILED
2016-01-14 18:32:04,511 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796324267_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:04,511 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796324267_0001_00_000001
2016-01-14 18:32:04 Completed Dag: dag_1452796324267_0001_1
2016-01-14 18:32:04,512 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796324267_0001_1, dagState=FAILED
2016-01-14 18:32:04,510 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452796324267_0001_00_000001 completed but with errors
2016-01-14 18:32:04,512 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796324267_0001_1_post
2016-01-14 18:32:04,512 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:04,512 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:04,513 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796324267_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 18:32:04,513 INFO container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452796324267_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 18:32:04,513 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796324267_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 18:32:04,513 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796324267_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 18:32:04,519 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ..._RESULTS.0_VALUES_RESULTS, applicationId=application_1452796324267_0001
2016-01-14 18:32:04,521 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:04,521 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:04,521 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:04,521 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:04,522 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:04,522 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:04,522 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:04,522 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:04,522 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:04,523 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:04,523 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:04,523 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:04,523 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:04,527 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/1294593BB4B14B8195CBE13083FDF9AF/C9D9258B7D6C4A85AC23B528A58F5381/.tez/application_1452796324267_0001
2016-01-14 18:32:04,527 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 18:32:04,528 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ..._RESULTS.0_VALUES_RESULTS
2016-01-14 18:32:04,529 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 18:32:04,530 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.281
2016-01-14 18:32:04,530 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_VALUES_RESULTS
2016-01-14 18:32:04,564 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:04,564 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:04,608 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.007
2016-01-14 18:32:04,616 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.015
2016-01-14 18:32:04,617 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:04,617 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:04,617 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:04,632 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:04,633 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_ALL
2016-01-14 18:32:04,642 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:04,642 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:04,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_ALL"]
2016-01-14 18:32:04,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:04,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:04,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:04,643 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 18:32:04,644 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:04,656 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:04,661 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:04,661 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:04,661 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:04,665 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:04,665 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:04,670 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA/.tez/application_1452796324661_0001 doesn't exist and is created
2016-01-14 18:32:04,684 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:04,685 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:04,685 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA/.tez/application_1452796324661_0001
2016-01-14 18:32:04,686 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796324661_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:04,697 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:04,698 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:04,699 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:04,699 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:04,699 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA/.tez/application_1452796324661_0001/localmode-log-dir
2016-01-14 18:32:04,700 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA/.tez/application_1452796324661_0001/localmode-log-dir/history.txt.appattempt_1452796324661_0001_000000, maxErrors=10
2016-01-14 18:32:04,700 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:04,700 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796324661_0001_000000, appSubmitTime=1452796324686, launchTime=1452796324686
2016-01-14 18:32:04,705 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:04,707 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:04,707 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:04,708 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:51555
2016-01-14 18:32:04,713 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:04,714 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:04,716 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796324661_0001_000000, startTime=1452796324716
2016-01-14 18:32:04,716 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:04,716 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:04,785 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:04,785 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:04,785 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_VALUES_ALL, applicationId=application_1452796324661_0001, dagName=[F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 18:32:04,803 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 18:32:04,804 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796324661_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA/.tez/application_1452796324661_0001/localmode-log-dir/dag_1452796324661_0001_1.dot
2016-01-14 18:32:04,805 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA/.tez/application_1452796324661_0001/localmode-log-dir/dag_1452796324661_0001_1-tez-dag.pb.txt
2016-01-14 18:32:04,809 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796324661_0001_1
2016-01-14 18:32:04,809 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:04,810 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 18:32:04 Running Dag: dag_1452796324661_0001_1
2016-01-14 18:32:04,818 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796324661_0001_1, submitTime=1452796324803
2016-01-14 18:32:04,818 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:04,819 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BB97A2B5F27F4C1CA8BA4D0F410CFBD2
2016-01-14 18:32:04,819 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:04,819 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:04,819 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796324661_0001_1, initTime=1452796324818
2016-01-14 18:32:04,819 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796324661_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:04,820 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:DAG_STARTED]: dagID=dag_1452796324661_0001_1, startTime=1452796324820
2016-01-14 18:32:04,820 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:04,820 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:04,820 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796324661_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:04,820 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BB97A2B5F27F4C1CA8BA4D0F410CFBD2 : {CF59CFE42E284D9FB264937086938C54={InputName=CF59CFE42E284D9FB264937086938C54}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:04,820 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: CF59CFE42E284D9FB264937086938C54, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:04,821 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,821 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,821 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,821 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]. Starting root input initializers: 1
2016-01-14 18:32:04,822 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:04,822 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: CF59CFE42E284D9FB264937086938C54 on vertex vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,822 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_VALUES_ALL, applicationId=application_1452796324661_0001, dagName=[F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 18:32:04,826 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:04,826 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input CF59CFE42E284D9FB264937086938C54 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:04,826 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:04,827 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:04,828 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:04,828 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: CF59CFE42E284D9FB264937086938C54 on vertex vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,829 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:04,829 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {CF59CFE42E284D9FB264937086938C54=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:04,829 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] parallelism set to 1
2016-01-14 18:32:04,829 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:04,829 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796324661_0001_1_00, eventCount=1
2016-01-14 18:32:04,829 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,830 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=D7405878CE2249EB9C6C533DA9BC96A5, vertexId=vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:04,830 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=D7405878CE2249EB9C6C533DA9BC96A5, vertexId=vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,832 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=D7405878CE2249EB9C6C533DA9BC96A5, vertexName=BB97A2B5F27F4C1CA8BA4D0F410CFBD2, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:04,832 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=D7405878CE2249EB9C6C533DA9BC96A5, vertexId=vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,833 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BB97A2B5F27F4C1CA8BA4D0F410CFBD2, vertexId=vertex_1452796324661_0001_1_00, initRequestedTime=1452796324820, initedTime=1452796324833, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:04,833 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] with distanceFromRoot: 0
2016-01-14 18:32:04,833 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:04,833 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:04,833 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BB97A2B5F27F4C1CA8BA4D0F410CFBD2
2016-01-14 18:32:04,834 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,834 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:04,834 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796324661_0001_1_00, startRequestedTime=1452796324833, startedTime=1452796324833
2016-01-14 18:32:04,834 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:04,834 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:04,835 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:TASK_STARTED]: vertexName=BB97A2B5F27F4C1CA8BA4D0F410CFBD2, taskId=task_1452796324661_0001_1_00_000000, scheduledTime=1452796324834, launchTime=1452796324834
2016-01-14 18:32:04,835 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796324661_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:04,835 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,836 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL, VertexName: BB97A2B5F27F4C1CA8BA4D0F410CFBD2, VertexParallelism: 1, TaskAttemptID:attempt_1452796324661_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CF59CFE42E284D9FB264937086938C54, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D7405878CE2249EB9C6C533DA9BC96A5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:04,836 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796324661_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:04,836 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:04,837 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:04,837 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:04,838 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:04,838 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796324661_0001_00_000001
2016-01-14 18:32:04,838 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796324661_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:04,840 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796324661_0001_00_000001
2016-01-14 18:32:04,840 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:04,841 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:04,842 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796324661_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:04,841 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796324661_0001_00_000001, launchTime=1452796324841
2016-01-14 18:32:04,845 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796324661_0001, with dag id: dag_1452796324661_0001_1
2016-01-14 18:32:04,847 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796324661_0001_00_000001
2016-01-14 18:32:04,848 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796324661_0001_1_00_000000_0] to container: [container_1452796324661_0001_00_000001]
2016-01-14 18:32:04,848 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796324661_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:04,848 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796324661_0001_00_000001 given task: attempt_1452796324661_0001_1_00_000000_0
2016-01-14 18:32:04,848 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796324661_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796324661_0001_1_00_000000_0
2016-01-14 18:32:04,850 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796324661_0001_1_00_000000_0] started. Is using containerId: [container_1452796324661_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:04,850 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:04 Starting to run new task attempt: attempt_1452796324661_0001_1_00_000000_0
2016-01-14 18:32:04,850 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BB97A2B5F27F4C1CA8BA4D0F410CFBD2, taskAttemptId=attempt_1452796324661_0001_1_00_000000_0, startTime=1452796324849, containerId=container_1452796324661_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796324661_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:04,851 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796324661_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:04,851 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796324661_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:04,851 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796324661_0001_1_00_000000_0
2016-01-14 18:32:04,852 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:04,852 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:04,853 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:04,853 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:04,853 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:04,853 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:04,854 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA] every.every/(1/1) ...eld'_RESULTS.0_VALUES_ALL, VertexName: BB97A2B5F27F4C1CA8BA4D0F410CFBD2, VertexParallelism: 1, TaskAttemptID:attempt_1452796324661_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CF59CFE42E284D9FB264937086938C54, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D7405878CE2249EB9C6C533DA9BC96A5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:04,854 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:04,855 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796324661_0001_1_00_000000_0
2016-01-14 18:32:04,855 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:04,855 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:04,856 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796324661_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:04,856 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:04,856 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=CF59CFE42E284D9FB264937086938C54, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:04,857 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:04,857 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: CF59CFE42E284D9FB264937086938C54
2016-01-14 18:32:04,857 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: CF59CFE42E284D9FB264937086938C54
2016-01-14 18:32:04,859 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:04,859 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=D7405878CE2249EB9C6C533DA9BC96A5, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:04,860 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:04,860 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: CF59CFE42E284D9FB264937086938C54
2016-01-14 18:32:04,860 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: CF59CFE42E284D9FB264937086938C54
2016-01-14 18:32:04,861 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:04,861 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: D7405878CE2249EB9C6C533DA9BC96A5
2016-01-14 18:32:04,862 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:04,862 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: D7405878CE2249EB9C6C533DA9BC96A5
2016-01-14 18:32:04,869 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BB97A2B5F27F4C1CA8BA4D0F410CFBD2, ordinal: 0
2016-01-14 18:32:04,869 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BB97A2B5F27F4C1CA8BA4D0F410CFBD2, mem on start (mb), free: 286, total: 388, max: 672
2016-01-14 18:32:04,869 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:04,869 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:04,869 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:04,871 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:04,871 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: D7405878CE2249EB9C6C533DA9BC96A5
2016-01-14 18:32:04,871 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:04,872 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:04,872 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:04,872 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:04,873 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:04,873 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:04,873 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:04,873 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:04,873 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, CF59CFE42E284D9FB264937086938C54, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:04,874 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, D7405878CE2249EB9C6C533DA9BC96A5, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:04,874 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:04,874 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: CF59CFE42E284D9FB264937086938C54
2016-01-14 18:32:04,874 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:04,874 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: CF59CFE42E284D9FB264937086938C54
2016-01-14 18:32:04,875 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: CF59CFE42E284D9FB264937086938C54 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:04,875 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:04,875 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:04,875 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:04,876 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796324661_0001_1_00_000000_0
2016-01-14 18:32:04,876 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:04,876 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@279e9db1
2016-01-14 18:32:04,879 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@279e9db1
2016-01-14 18:32:04,879 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:04,879 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:04,879 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:04,880 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: CF59CFE42E284D9FB264937086938C54
2016-01-14 18:32:04,880 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_ALL"], id: D7405878CE2249EB9C6C533DA9BC96A5
2016-01-14 18:32:04,881 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_VALUES_ALL"]
2016-01-14 18:32:04,881 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:04,881 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:04,882 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BB97A2B5F27F4C1CA8BA4D0F410CFBD2, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:04,882 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,885 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,889 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,894 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:04,894 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:04,895 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796324661_0001_1_00_000000_0
2016-01-14 18:32:04,895 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796324661_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:04,898 INFO task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452796324661_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:04,900 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452796324882, Process_Duration=16, Process_End_Time=1452796324898, Read_Duration=0, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 18:32:04,901 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BB97A2B5F27F4C1CA8BA4D0F410CFBD2, taskAttemptId=attempt_1452796324661_0001_1_00_000000_0, startTime=1452796324849, finishTime=1452796324900, timeTaken=51, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452796324882, Process_Duration=16, Process_End_Time=1452796324898, Read_Duration=0, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 18:32:04,901 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796324661_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 18:32:04,902 INFO impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452796324661_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 18:32:04,902 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:TASK_FINISHED]: vertexName=BB97A2B5F27F4C1CA8BA4D0F410CFBD2, taskId=task_1452796324661_0001_1_00_000000, startTime=1452796324849, finishTime=1452796324902, timeTaken=53, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 18:32:04,902 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796324661_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 18:32:04,902 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] : 1
2016-01-14 18:32:04,903 INFO impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] because task failed: task_1452796324661_0001_1_00_000000
2016-01-14 18:32:04,903 INFO impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] due to trigger: OWN_TASK_FAILURE
2016-01-14 18:32:04,903 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 18:32:04,903 INFO impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,903 INFO impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=D7405878CE2249EB9C6C533DA9BC96A5, vertexId=vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,904 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:04,901 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:04,905 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:VERTEX_FINISHED]: vertexName=BB97A2B5F27F4C1CA8BA4D0F410CFBD2, vertexId=vertex_1452796324661_0001_1_00, initRequestedTime=1452796324820, initedTime=1452796324833, startRequestedTime=1452796324833, startedTime=1452796324833, finishTime=1452796324904, timeTaken=71, status=FAILED, diagnostics=Task failed, taskId=task_1452796324661_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452796324849, firstTasksToStart=[ task_1452796324661_0001_1_00_000000 ], lastTaskFinishTime=1452796324900, lastTasksToFinish=[ task_1452796324661_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[ ], longestDurationTasks=[ ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 18:32:04,906 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:04,906 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:04,904 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BB97A2B5F27F4C1CA8BA4D0F410CFBD2, mem on close (mb), free: 283, total: 388, max: 672
2016-01-14 18:32:04,906 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 18:32:04,907 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796324661_0001_00_000001, stoppedTime=1452796324907, exitStatus=0
2016-01-14 18:32:04,908 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796324661_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:04,908 INFO node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452796324661_0001_1_00_000000_0 failed: true container: container_1452796324661_0001_00_000001 numFailedTAs: 0
2016-01-14 18:32:04,908 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 18:32:04,908 INFO impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 18:32:04,908 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796324661_0001_1
2016-01-14 18:32:04,909 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=BB97A2B5F27F4C1CA8BA4D0F410CFBD2, index=0
2016-01-14 18:32:04,909 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:04,909 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: D7405878CE2249EB9C6C533DA9BC96A5 for vertex: vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2]
2016-01-14 18:32:04,909 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=BB97A2B5F27F4C1CA8BA4D0F410CFBD2, sourceVertex=CF59CFE42E284D9FB264937086938C54
2016-01-14 18:32:04,910 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=BB97A2B5F27F4C1CA8BA4D0F410CFBD2, sourceVertex=D7405878CE2249EB9C6C533DA9BC96A5
2016-01-14 18:32:04,910 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796324661_0001_00_000001
2016-01-14 18:32:04,910 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796324661_0001_00_000001
2016-01-14 18:32:04,911 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796324661_0001_1, queueSize=0
2016-01-14 18:32:04,911 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:04,911 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796324661_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796324661_0001_1, startTime=1452796324820, finishTime=1452796324910, timeTaken=90, status=FAILED, diagnostics=Vertex failed, vertexName=BB97A2B5F27F4C1CA8BA4D0F410CFBD2, vertexId=vertex_1452796324661_0001_1_00, diagnostics=[Task failed, taskId=task_1452796324661_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
at cascading.TestFunction.operate(TestFunction.java:86)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452796324661_0001_1_00 [BB97A2B5F27F4C1CA8BA4D0F410CFBD2] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 18:32:04,911 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796324661_0001_1 finished with state: FAILED
2016-01-14 18:32:04,913 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796324661_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:04,913 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796324661_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 18:32:04,913 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452796324661_0001_00_000001 completed but with errors
2016-01-14 18:32:04,913 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796324661_0001_00_000001
2016-01-14 18:32:04 Completed Dag: dag_1452796324661_0001_1
2016-01-14 18:32:04,916 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796324661_0001_1, dagState=FAILED
2016-01-14 18:32:04,917 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796324661_0001_1_post
2016-01-14 18:32:04,917 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:04,917 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:04,918 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...eld'_RESULTS.0_VALUES_ALL, applicationId=application_1452796324661_0001
2016-01-14 18:32:04,918 INFO container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452796324661_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 18:32:04,918 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796324661_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:04,919 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796324661_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 18:32:04,920 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:04,920 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:04,920 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:04,920 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:04,920 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:04,921 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:04,921 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:04,921 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:04,921 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:04,921 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:04,922 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:04,922 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:04,922 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:04,927 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/F80ED9F8C22E41339AEA45DE8C7A11D8/C176A636CFD245829755D4881B4D6FAA/.tez/application_1452796324661_0001
2016-01-14 18:32:04,927 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 18:32:04,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...eld'_RESULTS.0_VALUES_ALL
2016-01-14 18:32:04,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 18:32:04,930 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.287
2016-01-14 18:32:04,930 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_VALUES_ALL
2016-01-14 18:32:04,963 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:04,963 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:04,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.007
2016-01-14 18:32:05,007 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 18:32:05,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:05,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:05,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:05,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:05,028 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_-1
2016-01-14 18:32:05,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:05,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:05,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_-1"]
2016-01-14 18:32:05,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:05,041 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:05,041 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:05,041 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...'field'_RESULTS.0_ARGS_-1
2016-01-14 18:32:05,042 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:05,061 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:05,066 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:05,066 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:05,067 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:05,076 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67/.tez/application_1452796325066_0001 doesn't exist and is created
2016-01-14 18:32:05,093 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:05,093 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:05,094 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67/.tez/application_1452796325066_0001
2016-01-14 18:32:05,096 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796325066_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:05,107 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:05,107 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:05,108 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:05,109 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:05,109 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67/.tez/application_1452796325066_0001/localmode-log-dir
2016-01-14 18:32:05,109 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67/.tez/application_1452796325066_0001/localmode-log-dir/history.txt.appattempt_1452796325066_0001_000000, maxErrors=10
2016-01-14 18:32:05,109 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:05,109 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796325066_0001_000000, appSubmitTime=1452796325095, launchTime=1452796325095
2016-01-14 18:32:05,114 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:05,116 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:05,118 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:05,118 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:05,120 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:33273
2016-01-14 18:32:05,127 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:05,128 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796325066_0001_000000, startTime=1452796325128
2016-01-14 18:32:05,128 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:05,128 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:05,147 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:05,147 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:05,194 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:05,194 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:05,195 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'field'_RESULTS.0_ARGS_-1, applicationId=application_1452796325066_0001, dagName=[CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1
2016-01-14 18:32:05,212 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1
2016-01-14 18:32:05,213 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796325066_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67/.tez/application_1452796325066_0001/localmode-log-dir/dag_1452796325066_0001_1.dot
2016-01-14 18:32:05,213 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67/.tez/application_1452796325066_0001/localmode-log-dir/dag_1452796325066_0001_1-tez-dag.pb.txt
2016-01-14 18:32:05,218 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796325066_0001_1
2016-01-14 18:32:05,218 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:05,218 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1
2016-01-14 18:32:05 Running Dag: dag_1452796325066_0001_1
2016-01-14 18:32:05,227 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796325066_0001_1, submitTime=1452796325212
2016-01-14 18:32:05,227 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:05,228 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F1F8AA6101BD4BDAB5209500F8732827
2016-01-14 18:32:05,228 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:05,229 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796325066_0001_1, initTime=1452796325228
2016-01-14 18:32:05,229 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:05,229 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796325066_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:05,229 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:DAG_STARTED]: dagID=dag_1452796325066_0001_1, startTime=1452796325229
2016-01-14 18:32:05,230 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:05,229 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:05,230 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796325066_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:05,230 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F1F8AA6101BD4BDAB5209500F8732827 : {4DC837C5A2E24967BA11FAB4B8FDB061={InputName=4DC837C5A2E24967BA11FAB4B8FDB061}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:05,230 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 4DC837C5A2E24967BA11FAB4B8FDB061, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:05,230 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,230 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,230 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,231 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]. Starting root input initializers: 1
2016-01-14 18:32:05,231 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:05,231 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'field'_RESULTS.0_ARGS_-1, applicationId=application_1452796325066_0001, dagName=[CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1
2016-01-14 18:32:05,231 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 4DC837C5A2E24967BA11FAB4B8FDB061 on vertex vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,233 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:05,233 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 4DC837C5A2E24967BA11FAB4B8FDB061 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:05,233 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:05,234 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:05,235 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:05,235 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 4DC837C5A2E24967BA11FAB4B8FDB061 on vertex vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,235 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:05,235 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {4DC837C5A2E24967BA11FAB4B8FDB061=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:05,236 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827] parallelism set to 1
2016-01-14 18:32:05,236 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:05,236 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796325066_0001_1_00, eventCount=1
2016-01-14 18:32:05,236 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,236 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=3CC4E422586B47D18912ED7EED1484FF, vertexId=vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:05,236 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=3CC4E422586B47D18912ED7EED1484FF, vertexId=vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,238 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=3CC4E422586B47D18912ED7EED1484FF, vertexName=F1F8AA6101BD4BDAB5209500F8732827, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:05,238 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=3CC4E422586B47D18912ED7EED1484FF, vertexId=vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,239 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:05,239 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F1F8AA6101BD4BDAB5209500F8732827, vertexId=vertex_1452796325066_0001_1_00, initRequestedTime=1452796325230, initedTime=1452796325239, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:05,239 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827] with distanceFromRoot: 0
2016-01-14 18:32:05,239 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:05,240 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F1F8AA6101BD4BDAB5209500F8732827
2016-01-14 18:32:05,240 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,240 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:05,240 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796325066_0001_1_00, startRequestedTime=1452796325240, startedTime=1452796325240
2016-01-14 18:32:05,240 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:05,241 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:05,241 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:TASK_STARTED]: vertexName=F1F8AA6101BD4BDAB5209500F8732827, taskId=task_1452796325066_0001_1_00_000000, scheduledTime=1452796325241, launchTime=1452796325241
2016-01-14 18:32:05,241 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796325066_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:05,241 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,242 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1, VertexName: F1F8AA6101BD4BDAB5209500F8732827, VertexParallelism: 1, TaskAttemptID:attempt_1452796325066_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4DC837C5A2E24967BA11FAB4B8FDB061, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3CC4E422586B47D18912ED7EED1484FF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:05,242 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796325066_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:05,242 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:05,243 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:05,243 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:05,243 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:05,244 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796325066_0001_00_000001
2016-01-14 18:32:05,244 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325066_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:05,245 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796325066_0001_00_000001
2016-01-14 18:32:05,245 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:05,246 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325066_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:05,246 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796325066_0001_00_000001, launchTime=1452796325246
2016-01-14 18:32:05,246 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:05,247 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796325066_0001_00_000001
2016-01-14 18:32:05,247 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796325066_0001_1_00_000000_0] to container: [container_1452796325066_0001_00_000001]
2016-01-14 18:32:05,247 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325066_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:05,248 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796325066_0001_00_000001 given task: attempt_1452796325066_0001_1_00_000000_0
2016-01-14 18:32:05,248 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796325066_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796325066_0001_1_00_000000_0
2016-01-14 18:32:05,248 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796325066_0001_1_00_000000_0] started. Is using containerId: [container_1452796325066_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:05,248 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F1F8AA6101BD4BDAB5209500F8732827, taskAttemptId=attempt_1452796325066_0001_1_00_000000_0, startTime=1452796325248, containerId=container_1452796325066_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796325066_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:05,248 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796325066_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:05,249 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:05,249 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796325066_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:05 Starting to run new task attempt: attempt_1452796325066_0001_1_00_000000_0
2016-01-14 18:32:05,249 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796325066_0001_1_00_000000_0
2016-01-14 18:32:05,249 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:05,250 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:05,250 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:05,250 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:05,250 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:05,250 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:05,250 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67] every.every/(1/1) ...'field'_RESULTS.0_ARGS_-1, VertexName: F1F8AA6101BD4BDAB5209500F8732827, VertexParallelism: 1, TaskAttemptID:attempt_1452796325066_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4DC837C5A2E24967BA11FAB4B8FDB061, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3CC4E422586B47D18912ED7EED1484FF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:05,250 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:05,252 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796325066_0001_1_00_000000_0
2016-01-14 18:32:05,252 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:05,252 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:05,252 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796325066_0001, with dag id: dag_1452796325066_0001_1
2016-01-14 18:32:05,257 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796325066_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:05,257 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=3CC4E422586B47D18912ED7EED1484FF, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:05,257 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=4DC837C5A2E24967BA11FAB4B8FDB061, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:05,257 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:05,259 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:05,259 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 4DC837C5A2E24967BA11FAB4B8FDB061
2016-01-14 18:32:05,259 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 4DC837C5A2E24967BA11FAB4B8FDB061
2016-01-14 18:32:05,258 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:05,261 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 3CC4E422586B47D18912ED7EED1484FF
2016-01-14 18:32:05,261 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:05,262 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:05,263 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 4DC837C5A2E24967BA11FAB4B8FDB061
2016-01-14 18:32:05,263 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 4DC837C5A2E24967BA11FAB4B8FDB061
2016-01-14 18:32:05,261 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:05,264 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 3CC4E422586B47D18912ED7EED1484FF
2016-01-14 18:32:05,268 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F1F8AA6101BD4BDAB5209500F8732827, ordinal: 0
2016-01-14 18:32:05,268 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F1F8AA6101BD4BDAB5209500F8732827, mem on start (mb), free: 211, total: 388, max: 672
2016-01-14 18:32:05,268 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:05,269 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:05,269 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:05,271 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:05,271 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 3CC4E422586B47D18912ED7EED1484FF
2016-01-14 18:32:05,272 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:05,272 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:05,272 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:05,272 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:05,272 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:05,273 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:05,273 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:05,273 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:05,274 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 4DC837C5A2E24967BA11FAB4B8FDB061, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:05,274 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 3CC4E422586B47D18912ED7EED1484FF, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:05,275 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:05,275 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 4DC837C5A2E24967BA11FAB4B8FDB061 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:05,276 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:05,276 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:05,276 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 4DC837C5A2E24967BA11FAB4B8FDB061
2016-01-14 18:32:05,277 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:05,277 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 4DC837C5A2E24967BA11FAB4B8FDB061
2016-01-14 18:32:05,278 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:05,278 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796325066_0001_1_00_000000_0
2016-01-14 18:32:05,278 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:05,279 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@26f86592
2016-01-14 18:32:05,280 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@26f86592
2016-01-14 18:32:05,280 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:05,280 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:05,282 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:05,282 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 4DC837C5A2E24967BA11FAB4B8FDB061
2016-01-14 18:32:05,283 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_-1"], id: 3CC4E422586B47D18912ED7EED1484FF
2016-01-14 18:32:05,283 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_-1"]
2016-01-14 18:32:05,283 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:05,283 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:05,284 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F1F8AA6101BD4BDAB5209500F8732827, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:05,287 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:05,287 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:05,288 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796325066_0001_1_00_000000_0
2016-01-14 18:32:05,288 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796325066_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:05,288 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796325066_0001_1_00_000000_0
2016-01-14 18:32:05,289 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F1F8AA6101BD4BDAB5209500F8732827, mem on close (mb), free: 208, total: 388, max: 672
2016-01-14 18:32:05 Completed running task attempt: attempt_1452796325066_0001_1_00_000000_0
2016-01-14 18:32:05,289 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796325066_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:05,290 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796325284, Process_Duration=4, Process_End_Time=1452796325288, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:05,291 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:05,291 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:05,291 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:05,291 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F1F8AA6101BD4BDAB5209500F8732827, taskAttemptId=attempt_1452796325066_0001_1_00_000000_0, startTime=1452796325248, finishTime=1452796325290, timeTaken=42, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796325284, Process_Duration=4, Process_End_Time=1452796325288, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:05,291 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796325066_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:05,291 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796325066_0001_00_000001
2016-01-14 18:32:05,291 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:05,291 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796325066_0001_1_00_000000_0
2016-01-14 18:32:05,294 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:05,294 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:TASK_FINISHED]: vertexName=F1F8AA6101BD4BDAB5209500F8732827, taskId=task_1452796325066_0001_1_00_000000, startTime=1452796325248, finishTime=1452796325293, timeTaken=45, status=SUCCEEDED, successfulAttemptID=attempt_1452796325066_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796325284, Process_Duration=4, Process_End_Time=1452796325288, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:05,294 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796325066_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:05,294 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827] : 1
2016-01-14 18:32:05,294 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,295 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:05,295 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:VERTEX_FINISHED]: vertexName=F1F8AA6101BD4BDAB5209500F8732827, vertexId=vertex_1452796325066_0001_1_00, initRequestedTime=1452796325230, initedTime=1452796325239, startRequestedTime=1452796325240, startedTime=1452796325240, finishTime=1452796325294, timeTaken=54, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796325284, Process_Duration=4, Process_End_Time=1452796325288, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796325248, firstTasksToStart=[ task_1452796325066_0001_1_00_000000 ], lastTaskFinishTime=1452796325290, lastTasksToFinish=[ task_1452796325066_0001_1_00_000000 ], minTaskDuration=42, maxTaskDuration=42, avgTaskDuration=42.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796325066_0001_1_00_000000 ], longestDurationTasks=[ task_1452796325066_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:05,295 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:05,295 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325066_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:05,296 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796325066_0001_00_000001, stoppedTime=1452796325296, exitStatus=0
2016-01-14 18:32:05,296 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:05,296 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325066_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:05,296 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:05,296 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796325066_0001_1
2016-01-14 18:32:05,296 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796325066_0001_1
2016-01-14 18:32:05,296 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 3CC4E422586B47D18912ED7EED1484FF for vertex: vertex_1452796325066_0001_1_00 [F1F8AA6101BD4BDAB5209500F8732827]
2016-01-14 18:32:05,305 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796325066_0001_1, queueSize=0
2016-01-14 18:32:05,305 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:05,305 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796325066_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:05,305 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796325066_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:05,306 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325066_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796325066_0001_1, startTime=1452796325229, finishTime=1452796325304, timeTaken=75, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406847488, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796325284, Process_Duration=4, Process_End_Time=1452796325288, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:05,306 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796325066_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:05,306 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796325066_0001_00_000001, Exiting
2016-01-14 18:32:05,306 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796325066_0001_00_000001
2016-01-14 18:32:05,306 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796325066_0001_00_000001
2016-01-14 18:32:05,307 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796325066_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:05,307 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796325066_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:05,307 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796325066_0001_00_000001 completed successfully
2016-01-14 18:32:05,307 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796325066_0001_00_000001
2016-01-14 18:32:05 Completed Dag: dag_1452796325066_0001_1
2016-01-14 18:32:05,308 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796325066_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:05,309 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796325066_0001_1_post
2016-01-14 18:32:05,309 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:05,310 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:05,311 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325066_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 18:32:05,311 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325066_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 18:32:05,314 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'field'_RESULTS.0_ARGS_-1, applicationId=application_1452796325066_0001
2016-01-14 18:32:05,315 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:05,316 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:05,316 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:05,316 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:05,316 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:05,316 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:05,317 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:05,317 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:05,317 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:05,317 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:05,317 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:05,317 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:05,318 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:05,321 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/CBEF25F8FB6E4FD5B2580BE010C5082C/E7752776031149549570BC5250251C67/.tez/application_1452796325066_0001
2016-01-14 18:32:05,322 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.282
2016-01-14 18:32:05,393 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_ARGS_-1
2016-01-14 18:32:05,416 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:05,417 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:05,445 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.003
2016-01-14 18:32:05,449 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.006
2016-01-14 18:32:05,449 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:05,449 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:05,449 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_ARGS_'field2'
2016-01-14 18:32:05,473 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:05,473 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:05,511 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 18:32:05,518 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 18:32:05,519 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:05,519 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:05,520 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:05,540 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:05,541 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_RESULTS
2016-01-14 18:32:05,555 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:05,556 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:05,557 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_RESULTS"]
2016-01-14 18:32:05,558 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:05,558 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:05,559 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:05,559 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.0_ARGS_RESULTS
2016-01-14 18:32:05,560 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:05,575 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:05,580 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:05,580 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:05,580 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:05,591 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3/.tez/application_1452796325580_0001 doesn't exist and is created
2016-01-14 18:32:05,606 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:05,607 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:05,607 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3/.tez/application_1452796325580_0001
2016-01-14 18:32:05,609 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796325580_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:05,620 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:05,621 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:05,622 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:05,622 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:05,623 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3/.tez/application_1452796325580_0001/localmode-log-dir
2016-01-14 18:32:05,623 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3/.tez/application_1452796325580_0001/localmode-log-dir/history.txt.appattempt_1452796325580_0001_000000, maxErrors=10
2016-01-14 18:32:05,623 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:05,623 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796325580_0001_000000, appSubmitTime=1452796325608, launchTime=1452796325609
2016-01-14 18:32:05,640 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:05,646 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:39834
2016-01-14 18:32:05,647 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:05,647 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:05,648 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:05,651 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:05,653 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:05,653 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796325580_0001_000000, startTime=1452796325653
2016-01-14 18:32:05,653 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:05,704 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:05,704 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:05,707 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:05,707 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:05,707 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_ARGS_RESULTS, applicationId=application_1452796325580_0001, dagName=[5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS
2016-01-14 18:32:05,725 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS
2016-01-14 18:32:05,727 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796325580_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3/.tez/application_1452796325580_0001/localmode-log-dir/dag_1452796325580_0001_1.dot
2016-01-14 18:32:05,727 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3/.tez/application_1452796325580_0001/localmode-log-dir/dag_1452796325580_0001_1-tez-dag.pb.txt
2016-01-14 18:32:05,732 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796325580_0001_1
2016-01-14 18:32:05,732 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:05,732 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS
2016-01-14 18:32:05 Running Dag: dag_1452796325580_0001_1
2016-01-14 18:32:05,741 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:05,742 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796325580_0001_1, submitTime=1452796325726
2016-01-14 18:32:05,742 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AD4A93198868481890D6191CB8606F54
2016-01-14 18:32:05,742 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:05,742 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:05,743 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796325580_0001_1, initTime=1452796325742
2016-01-14 18:32:05,743 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796325580_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:05,743 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:DAG_STARTED]: dagID=dag_1452796325580_0001_1, startTime=1452796325743
2016-01-14 18:32:05,743 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:05,743 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:05,743 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796325580_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:05,743 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AD4A93198868481890D6191CB8606F54 : {6715790B853E458DADE9133A3B2D51F7={InputName=6715790B853E458DADE9133A3B2D51F7}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:05,743 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 6715790B853E458DADE9133A3B2D51F7, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:05,743 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,744 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,744 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,744 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]. Starting root input initializers: 1
2016-01-14 18:32:05,744 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:05,744 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 6715790B853E458DADE9133A3B2D51F7 on vertex vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,745 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_ARGS_RESULTS, applicationId=application_1452796325580_0001, dagName=[5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS
2016-01-14 18:32:05,748 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:05,748 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 6715790B853E458DADE9133A3B2D51F7 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:05,748 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:05,749 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:05,750 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:05,751 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 6715790B853E458DADE9133A3B2D51F7 on vertex vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,751 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:05,751 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {6715790B853E458DADE9133A3B2D51F7=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:05,751 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54] parallelism set to 1
2016-01-14 18:32:05,751 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:05,752 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796325580_0001_1_00, eventCount=1
2016-01-14 18:32:05,752 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,752 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=EA29AB81925D4F86A4143210408743EA, vertexId=vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:05,752 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=EA29AB81925D4F86A4143210408743EA, vertexId=vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,754 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=EA29AB81925D4F86A4143210408743EA, vertexName=AD4A93198868481890D6191CB8606F54, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:05,754 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=EA29AB81925D4F86A4143210408743EA, vertexId=vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,755 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:05,755 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AD4A93198868481890D6191CB8606F54, vertexId=vertex_1452796325580_0001_1_00, initRequestedTime=1452796325743, initedTime=1452796325755, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:05,756 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54] with distanceFromRoot: 0
2016-01-14 18:32:05,756 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:05,756 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AD4A93198868481890D6191CB8606F54
2016-01-14 18:32:05,756 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,757 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:05,757 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796325580_0001_1_00, startRequestedTime=1452796325756, startedTime=1452796325756
2016-01-14 18:32:05,757 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:05,758 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:05,758 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:TASK_STARTED]: vertexName=AD4A93198868481890D6191CB8606F54, taskId=task_1452796325580_0001_1_00_000000, scheduledTime=1452796325757, launchTime=1452796325757
2016-01-14 18:32:05,758 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796325580_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:05,758 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,759 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS, VertexName: AD4A93198868481890D6191CB8606F54, VertexParallelism: 1, TaskAttemptID:attempt_1452796325580_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6715790B853E458DADE9133A3B2D51F7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=EA29AB81925D4F86A4143210408743EA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:05,759 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796325580_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:05,759 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:05,760 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:05,760 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:05,761 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:05,761 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796325580_0001_00_000001
2016-01-14 18:32:05,761 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325580_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:05,763 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796325580_0001_00_000001
2016-01-14 18:32:05,763 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:05,764 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325580_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:05,764 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796325580_0001, with dag id: dag_1452796325580_0001_1
2016-01-14 18:32:05,765 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:05,765 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796325580_0001_00_000001, launchTime=1452796325764
2016-01-14 18:32:05,766 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796325580_0001_00_000001
2016-01-14 18:32:05,767 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796325580_0001_1_00_000000_0] to container: [container_1452796325580_0001_00_000001]
2016-01-14 18:32:05,767 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325580_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:05,767 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796325580_0001_00_000001 given task: attempt_1452796325580_0001_1_00_000000_0
2016-01-14 18:32:05,767 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796325580_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796325580_0001_1_00_000000_0
2016-01-14 18:32:05,767 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796325580_0001_1_00_000000_0] started. Is using containerId: [container_1452796325580_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:05 Starting to run new task attempt: attempt_1452796325580_0001_1_00_000000_0
2016-01-14 18:32:05,768 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796325580_0001_1_00_000000_0
2016-01-14 18:32:05,768 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AD4A93198868481890D6191CB8606F54, taskAttemptId=attempt_1452796325580_0001_1_00_000000_0, startTime=1452796325767, containerId=container_1452796325580_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796325580_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:05,768 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796325580_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:05,768 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796325580_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:05,768 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:05,769 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:05,769 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:05,769 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:05,769 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:05,769 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:05,770 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:05,770 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3] every.every/(1/1) ...d'_RESULTS.0_ARGS_RESULTS, VertexName: AD4A93198868481890D6191CB8606F54, VertexParallelism: 1, TaskAttemptID:attempt_1452796325580_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=6715790B853E458DADE9133A3B2D51F7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=EA29AB81925D4F86A4143210408743EA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:05,770 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:05,771 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796325580_0001_1_00_000000_0
2016-01-14 18:32:05,771 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:05,772 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:05,774 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796325580_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:05,774 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:05,774 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=6715790B853E458DADE9133A3B2D51F7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:05,774 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=EA29AB81925D4F86A4143210408743EA, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:05,775 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:05,775 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:05,775 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 6715790B853E458DADE9133A3B2D51F7
2016-01-14 18:32:05,775 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 6715790B853E458DADE9133A3B2D51F7
2016-01-14 18:32:05,776 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: EA29AB81925D4F86A4143210408743EA
2016-01-14 18:32:05,777 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:05,777 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: EA29AB81925D4F86A4143210408743EA
2016-01-14 18:32:05,777 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:05,777 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:05,781 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 6715790B853E458DADE9133A3B2D51F7
2016-01-14 18:32:05,783 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 6715790B853E458DADE9133A3B2D51F7
2016-01-14 18:32:05,789 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AD4A93198868481890D6191CB8606F54, ordinal: 0
2016-01-14 18:32:05,789 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:05,789 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: EA29AB81925D4F86A4143210408743EA
2016-01-14 18:32:05,789 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AD4A93198868481890D6191CB8606F54, mem on start (mb), free: 312, total: 389, max: 672
2016-01-14 18:32:05,790 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:05,790 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:05,790 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:05,790 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:05,790 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:05,791 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:05,791 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:05,791 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:05,791 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:05,792 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:05,792 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:05,792 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 6715790B853E458DADE9133A3B2D51F7, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:05,792 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, EA29AB81925D4F86A4143210408743EA, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:05,792 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:05,793 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 6715790B853E458DADE9133A3B2D51F7 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:05,793 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:05,793 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 6715790B853E458DADE9133A3B2D51F7
2016-01-14 18:32:05,793 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:05,793 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 6715790B853E458DADE9133A3B2D51F7
2016-01-14 18:32:05,793 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:05,794 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:05,794 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796325580_0001_1_00_000000_0
2016-01-14 18:32:05,794 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:05,795 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@19fbb5ae
2016-01-14 18:32:05,796 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@19fbb5ae
2016-01-14 18:32:05,796 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:05,796 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:05,799 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:05,799 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 6715790B853E458DADE9133A3B2D51F7
2016-01-14 18:32:05,800 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_RESULTS"], id: EA29AB81925D4F86A4143210408743EA
2016-01-14 18:32:05,800 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_ARGS_RESULTS"]
2016-01-14 18:32:05,800 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:05,800 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:05,800 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AD4A93198868481890D6191CB8606F54, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:05,803 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:05,803 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:05,804 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796325580_0001_1_00_000000_0
2016-01-14 18:32:05,804 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796325580_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:05,804 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796325580_0001_1_00_000000_0
2016-01-14 18:32:05,804 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AD4A93198868481890D6191CB8606F54, mem on close (mb), free: 310, total: 389, max: 672
2016-01-14 18:32:05 Completed running task attempt: attempt_1452796325580_0001_1_00_000000_0
2016-01-14 18:32:05,805 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796325580_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:05,806 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407896064, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796325801, Process_Duration=3, Process_End_Time=1452796325804, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:05,807 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:05,807 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AD4A93198868481890D6191CB8606F54, taskAttemptId=attempt_1452796325580_0001_1_00_000000_0, startTime=1452796325767, finishTime=1452796325806, timeTaken=39, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407896064, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796325801, Process_Duration=3, Process_End_Time=1452796325804, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:05,807 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796325580_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:05,807 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796325580_0001_1_00_000000_0
2016-01-14 18:32:05,807 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:05,807 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796325580_0001_00_000001
2016-01-14 18:32:05,808 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:TASK_FINISHED]: vertexName=AD4A93198868481890D6191CB8606F54, taskId=task_1452796325580_0001_1_00_000000, startTime=1452796325767, finishTime=1452796325807, timeTaken=40, status=SUCCEEDED, successfulAttemptID=attempt_1452796325580_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407896064, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796325801, Process_Duration=3, Process_End_Time=1452796325804, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:05,808 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796325580_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:05,808 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:05,808 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54] : 1
2016-01-14 18:32:05,808 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,809 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:05,809 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:05,809 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:VERTEX_FINISHED]: vertexName=AD4A93198868481890D6191CB8606F54, vertexId=vertex_1452796325580_0001_1_00, initRequestedTime=1452796325743, initedTime=1452796325755, startRequestedTime=1452796325756, startedTime=1452796325756, finishTime=1452796325808, timeTaken=52, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407896064, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796325801, Process_Duration=3, Process_End_Time=1452796325804, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796325767, firstTasksToStart=[ task_1452796325580_0001_1_00_000000 ], lastTaskFinishTime=1452796325806, lastTasksToFinish=[ task_1452796325580_0001_1_00_000000 ], minTaskDuration=39, maxTaskDuration=39, avgTaskDuration=39.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796325580_0001_1_00_000000 ], longestDurationTasks=[ task_1452796325580_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:05,810 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:05,810 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:05,811 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:05,811 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796325580_0001_1
2016-01-14 18:32:05,811 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796325580_0001_1
2016-01-14 18:32:05,811 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: EA29AB81925D4F86A4143210408743EA for vertex: vertex_1452796325580_0001_1_00 [AD4A93198868481890D6191CB8606F54]
2016-01-14 18:32:05,819 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796325580_0001_1, queueSize=0
2016-01-14 18:32:05,819 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:05,820 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796325580_0001_1, startTime=1452796325743, finishTime=1452796325818, timeTaken=75, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407896064, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796325801, Process_Duration=3, Process_End_Time=1452796325804, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:05,820 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796325580_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:05,820 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796325580_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:05,820 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325580_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:05,821 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:05,821 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796325580_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796325580_0001_00_000001, stoppedTime=1452796325820, exitStatus=0
2016-01-14 18:32:05,821 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325580_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:05 Completed Dag: dag_1452796325580_0001_1
2016-01-14 18:32:05,822 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796325580_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:05,822 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796325580_0001_1_post
2016-01-14 18:32:05,822 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:05,823 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:05,823 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452796325580_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 18:32:05,823 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796325580_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 18:32:05,829 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.0_ARGS_RESULTS, applicationId=application_1452796325580_0001
2016-01-14 18:32:05,831 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:05,831 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:05,831 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:05,831 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:05,831 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:05,831 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:05,832 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:05,832 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:05,832 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:05,832 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:05,832 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:05,833 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:05,833 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:05,834 INFO task.TezChild (TezChild.java:run(198)) - Interrupted while waiting for new work for container container_1452796325580_0001_00_000001
2016-01-14 18:32:05,834 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796325580_0001_00_000001
2016-01-14 18:32:05,834 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796325580_0001_00_000001
2016-01-14 18:32:05,835 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796325580_0001_00_000001 = ContainerExecutionResult{exitStatus=INTERRUPTED, throwable=java.lang.InterruptedException, errorMessage='Interrupted while waiting for new work'}
2016-01-14 18:32:05,838 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452796325580_0001_00_000001 completed but with errors
2016-01-14 18:32:05,838 WARN event.AsyncDispatcher (AsyncDispatcher.java:handle(243)) - AsyncDispatcher thread interrupted
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219)
at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340)
at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338)
at org.apache.hadoop.yarn.event.AsyncDispatcher$GenericEventHandler.handle(AsyncDispatcher.java:240)
at org.apache.tez.dag.app.launcher.LocalContainerLauncher$RunningTaskCallback.onSuccess(LocalContainerLauncher.java:280)
at org.apache.tez.dag.app.launcher.LocalContainerLauncher$RunningTaskCallback.onSuccess(LocalContainerLauncher.java:256)
at com.google.common.util.concurrent.Futures$6.run(Futures.java:975)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:32:05,840 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onFailure(294)) - Container: container_1452796325580_0001_00_000001: Execution Failed:
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.InterruptedException
at org.apache.hadoop.yarn.event.AsyncDispatcher$GenericEventHandler.handle(AsyncDispatcher.java:245)
at org.apache.tez.dag.app.launcher.LocalContainerLauncher$RunningTaskCallback.onSuccess(LocalContainerLauncher.java:280)
at org.apache.tez.dag.app.launcher.LocalContainerLauncher$RunningTaskCallback.onSuccess(LocalContainerLauncher.java:256)
at com.google.common.util.concurrent.Futures$6.run(Futures.java:975)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219)
at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340)
at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338)
at org.apache.hadoop.yarn.event.AsyncDispatcher$GenericEventHandler.handle(AsyncDispatcher.java:240)
... 6 more
2016-01-14 18:32:05,845 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/5701066919674C74A0CA596860935722/B20BBA49EA6B409FBEAD1DD335BA4CB3/.tez/application_1452796325580_0001
2016-01-14 18:32:05,846 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.290
2016-01-14 18:32:05,915 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_ARGS_RESULTS
2016-01-14 18:32:05,937 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:05,937 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:05,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2016-01-14 18:32:05,969 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.007
2016-01-14 18:32:05,970 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:05,970 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:05,971 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_ARGS_ALL
2016-01-14 18:32:05,997 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:05,997 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:06,028 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.007
2016-01-14 18:32:06,035 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 18:32:06,036 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:06,036 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:06,037 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:06,051 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:06,052 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_-1
2016-01-14 18:32:06,061 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:06,061 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:06,061 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_-1"]
2016-01-14 18:32:06,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:06,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:06,062 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:06,063 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...'_RESULTS.ALL_'field2'_-1
2016-01-14 18:32:06,063 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:06,076 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:06,080 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:06,081 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:06,081 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:06,090 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007/.tez/application_1452796326081_0001 doesn't exist and is created
2016-01-14 18:32:06,105 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:06,105 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:06,106 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007/.tez/application_1452796326081_0001
2016-01-14 18:32:06,108 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796326081_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:06,119 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:06,120 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:06,121 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:06,121 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:06,121 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007/.tez/application_1452796326081_0001/localmode-log-dir
2016-01-14 18:32:06,121 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007/.tez/application_1452796326081_0001/localmode-log-dir/history.txt.appattempt_1452796326081_0001_000000, maxErrors=10
2016-01-14 18:32:06,121 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:06,122 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796326081_0001_000000, appSubmitTime=1452796326108, launchTime=1452796326108
2016-01-14 18:32:06,135 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:06,138 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:06,138 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:06,139 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:06,140 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:51016
2016-01-14 18:32:06,144 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:06,146 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796326081_0001_000000, startTime=1452796326146
2016-01-14 18:32:06,146 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:06,146 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:06,168 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:06,168 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:06,205 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:06,206 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:06,206 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'_RESULTS.ALL_'field2'_-1, applicationId=application_1452796326081_0001, dagName=[6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1
2016-01-14 18:32:06,222 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1
2016-01-14 18:32:06,224 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796326081_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007/.tez/application_1452796326081_0001/localmode-log-dir/dag_1452796326081_0001_1.dot
2016-01-14 18:32:06,225 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007/.tez/application_1452796326081_0001/localmode-log-dir/dag_1452796326081_0001_1-tez-dag.pb.txt
2016-01-14 18:32:06,229 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796326081_0001_1
2016-01-14 18:32:06,229 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:06,231 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1
2016-01-14 18:32:06 Running Dag: dag_1452796326081_0001_1
2016-01-14 18:32:06,241 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796326081_0001_1, submitTime=1452796326223
2016-01-14 18:32:06,241 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:06,242 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex DE0C3242173540A5A05F8C978CF8F2FC
2016-01-14 18:32:06,242 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:06,243 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796326081_0001_1, initTime=1452796326241
2016-01-14 18:32:06,243 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:06,243 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796326081_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:06,243 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:DAG_STARTED]: dagID=dag_1452796326081_0001_1, startTime=1452796326243
2016-01-14 18:32:06,244 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:06,243 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:06,244 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796326081_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:06,245 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: DE0C3242173540A5A05F8C978CF8F2FC : {95DA04446DF247AF818A428888D6DD4F={InputName=95DA04446DF247AF818A428888D6DD4F}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:06,245 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 95DA04446DF247AF818A428888D6DD4F, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:06,245 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,246 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,246 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,246 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]. Starting root input initializers: 1
2016-01-14 18:32:06,246 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'_RESULTS.ALL_'field2'_-1, applicationId=application_1452796326081_0001, dagName=[6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1
2016-01-14 18:32:06,251 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:06,252 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 95DA04446DF247AF818A428888D6DD4F on vertex vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,255 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:06,255 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 95DA04446DF247AF818A428888D6DD4F asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:06,257 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:06,257 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:06,260 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:06,260 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 95DA04446DF247AF818A428888D6DD4F on vertex vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,262 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:06,262 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {95DA04446DF247AF818A428888D6DD4F=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:06,262 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC] parallelism set to 1
2016-01-14 18:32:06,262 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:06,263 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796326081_0001_1_00, eventCount=1
2016-01-14 18:32:06,263 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,263 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=7C14A5E215B94AE09E20617CECFFDC28, vertexId=vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:06,263 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=7C14A5E215B94AE09E20617CECFFDC28, vertexId=vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,265 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=7C14A5E215B94AE09E20617CECFFDC28, vertexName=DE0C3242173540A5A05F8C978CF8F2FC, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:06,265 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=7C14A5E215B94AE09E20617CECFFDC28, vertexId=vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,267 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:VERTEX_INITIALIZED]: vertexName=DE0C3242173540A5A05F8C978CF8F2FC, vertexId=vertex_1452796326081_0001_1_00, initRequestedTime=1452796326245, initedTime=1452796326266, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:06,267 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC] with distanceFromRoot: 0
2016-01-14 18:32:06,267 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:06,267 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:06,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796326081_0001, with dag id: dag_1452796326081_0001_1
2016-01-14 18:32:06,267 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in DE0C3242173540A5A05F8C978CF8F2FC
2016-01-14 18:32:06,268 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,268 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796326081_0001_1_00, startRequestedTime=1452796326267, startedTime=1452796326267
2016-01-14 18:32:06,268 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:06,268 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:06,269 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:06,269 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:TASK_STARTED]: vertexName=DE0C3242173540A5A05F8C978CF8F2FC, taskId=task_1452796326081_0001_1_00_000000, scheduledTime=1452796326268, launchTime=1452796326268
2016-01-14 18:32:06,269 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796326081_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:06,269 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,270 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1, VertexName: DE0C3242173540A5A05F8C978CF8F2FC, VertexParallelism: 1, TaskAttemptID:attempt_1452796326081_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=95DA04446DF247AF818A428888D6DD4F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=7C14A5E215B94AE09E20617CECFFDC28, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:06,270 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796326081_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:06,270 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:06,271 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:06,272 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:06,272 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:06,272 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796326081_0001_00_000001
2016-01-14 18:32:06,273 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326081_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:06,274 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796326081_0001_00_000001
2016-01-14 18:32:06,274 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:06,275 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326081_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:06,276 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:06,276 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796326081_0001_00_000001, launchTime=1452796326275
2016-01-14 18:32:06,277 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796326081_0001_00_000001
2016-01-14 18:32:06,277 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796326081_0001_1_00_000000_0] to container: [container_1452796326081_0001_00_000001]
2016-01-14 18:32:06,278 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326081_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:06,278 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796326081_0001_1_00_000000_0] started. Is using containerId: [container_1452796326081_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:06,279 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=DE0C3242173540A5A05F8C978CF8F2FC, taskAttemptId=attempt_1452796326081_0001_1_00_000000_0, startTime=1452796326278, containerId=container_1452796326081_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796326081_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:06,279 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796326081_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:06,279 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796326081_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:06,279 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:06,280 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796326081_0001_00_000001 given task: attempt_1452796326081_0001_1_00_000000_0
2016-01-14 18:32:06,280 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796326081_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796326081_0001_1_00_000000_0
2016-01-14 18:32:06 Starting to run new task attempt: attempt_1452796326081_0001_1_00_000000_0
2016-01-14 18:32:06,281 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796326081_0001_1_00_000000_0
2016-01-14 18:32:06,281 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:06,281 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:06,281 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:06,281 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:06,281 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:06,281 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:06,281 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007] every.every/(1/1) ...'_RESULTS.ALL_'field2'_-1, VertexName: DE0C3242173540A5A05F8C978CF8F2FC, VertexParallelism: 1, TaskAttemptID:attempt_1452796326081_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=95DA04446DF247AF818A428888D6DD4F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=7C14A5E215B94AE09E20617CECFFDC28, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:06,282 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:06,282 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796326081_0001_1_00_000000_0
2016-01-14 18:32:06,282 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:06,282 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:06,283 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796326081_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:06,284 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=95DA04446DF247AF818A428888D6DD4F, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:06,285 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=7C14A5E215B94AE09E20617CECFFDC28, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:06,284 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:06,285 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:06,285 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 7C14A5E215B94AE09E20617CECFFDC28
2016-01-14 18:32:06,285 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:06,286 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 7C14A5E215B94AE09E20617CECFFDC28
2016-01-14 18:32:06,289 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:06,285 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:06,293 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 95DA04446DF247AF818A428888D6DD4F
2016-01-14 18:32:06,294 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 95DA04446DF247AF818A428888D6DD4F
2016-01-14 18:32:06,296 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:06,296 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 95DA04446DF247AF818A428888D6DD4F
2016-01-14 18:32:06,296 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 95DA04446DF247AF818A428888D6DD4F
2016-01-14 18:32:06,297 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:06,297 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 7C14A5E215B94AE09E20617CECFFDC28
2016-01-14 18:32:06,301 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: DE0C3242173540A5A05F8C978CF8F2FC, ordinal: 0
2016-01-14 18:32:06,301 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DE0C3242173540A5A05F8C978CF8F2FC, mem on start (mb), free: 199, total: 389, max: 672
2016-01-14 18:32:06,301 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:06,301 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:06,301 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:06,302 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:06,302 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:06,302 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:06,303 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:06,303 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:06,303 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:06,304 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:06,304 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:06,304 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 7C14A5E215B94AE09E20617CECFFDC28, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:06,304 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 95DA04446DF247AF818A428888D6DD4F, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:06,305 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:06,305 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 95DA04446DF247AF818A428888D6DD4F
2016-01-14 18:32:06,305 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:06,305 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 95DA04446DF247AF818A428888D6DD4F
2016-01-14 18:32:06,309 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 95DA04446DF247AF818A428888D6DD4F being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:06,309 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:06,310 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:06,310 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:06,310 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796326081_0001_1_00_000000_0
2016-01-14 18:32:06,314 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:06,314 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 95DA04446DF247AF818A428888D6DD4F
2016-01-14 18:32:06,314 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_-1"], id: 7C14A5E215B94AE09E20617CECFFDC28
2016-01-14 18:32:06,315 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_-1"]
2016-01-14 18:32:06,315 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:06,315 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:06,316 INFO input.MRInput (MRInput.java:checkAndAwaitRecordReaderInitialization(597)) - Awaiting RecordReader initialization
2016-01-14 18:32:06,316 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:06,316 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@6d3eccb9
2016-01-14 18:32:06,318 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@6d3eccb9
2016-01-14 18:32:06,318 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:06,318 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:06,318 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: DE0C3242173540A5A05F8C978CF8F2FC, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:06,321 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:06,322 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:06,322 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796326081_0001_1_00_000000_0
2016-01-14 18:32:06,322 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796326081_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:06,323 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796326081_0001_1_00_000000_0
2016-01-14 18:32:06,324 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DE0C3242173540A5A05F8C978CF8F2FC, mem on close (mb), free: 197, total: 389, max: 672
2016-01-14 18:32:06 Completed running task attempt: attempt_1452796326081_0001_1_00_000000_0
2016-01-14 18:32:06,325 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796326081_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:06,326 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:06,326 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=DE0C3242173540A5A05F8C978CF8F2FC, taskAttemptId=attempt_1452796326081_0001_1_00_000000_0, startTime=1452796326278, finishTime=1452796326326, timeTaken=48, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407896064, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796326318, Process_Duration=5, Process_End_Time=1452796326323, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:06,327 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796326081_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:06,327 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:06,327 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796326081_0001_1_00_000000_0
2016-01-14 18:32:06,327 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:06,327 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:TASK_FINISHED]: vertexName=DE0C3242173540A5A05F8C978CF8F2FC, taskId=task_1452796326081_0001_1_00_000000, startTime=1452796326278, finishTime=1452796326327, timeTaken=49, status=SUCCEEDED, successfulAttemptID=attempt_1452796326081_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407896064, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796326318, Process_Duration=5, Process_End_Time=1452796326323, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:06,328 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796326081_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:06,328 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC] : 1
2016-01-14 18:32:06,328 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,329 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:06,329 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:VERTEX_FINISHED]: vertexName=DE0C3242173540A5A05F8C978CF8F2FC, vertexId=vertex_1452796326081_0001_1_00, initRequestedTime=1452796326245, initedTime=1452796326266, startRequestedTime=1452796326267, startedTime=1452796326267, finishTime=1452796326328, timeTaken=61, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407896064, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796326318, Process_Duration=5, Process_End_Time=1452796326323, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796326278, firstTasksToStart=[ task_1452796326081_0001_1_00_000000 ], lastTaskFinishTime=1452796326326, lastTasksToFinish=[ task_1452796326081_0001_1_00_000000 ], minTaskDuration=48, maxTaskDuration=48, avgTaskDuration=48.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796326081_0001_1_00_000000 ], longestDurationTasks=[ task_1452796326081_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:06,329 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:06,332 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326081_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:06,332 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:06,332 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796326081_0001_1
2016-01-14 18:32:06,332 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796326081_0001_1
2016-01-14 18:32:06,333 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 7C14A5E215B94AE09E20617CECFFDC28 for vertex: vertex_1452796326081_0001_1_00 [DE0C3242173540A5A05F8C978CF8F2FC]
2016-01-14 18:32:06,333 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407896064, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796326318, Process_Duration=5, Process_End_Time=1452796326323, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:06,334 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:06,334 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:06,334 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796326081_0001_00_000001
2016-01-14 18:32:06,341 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796326081_0001_1, queueSize=0
2016-01-14 18:32:06,341 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:06,341 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796326081_0001_1, startTime=1452796326243, finishTime=1452796326340, timeTaken=97, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=407896064, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796326318, Process_Duration=5, Process_End_Time=1452796326323, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:06,342 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796326081_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:06,342 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796326081_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:06,342 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326081_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796326081_0001_00_000001, stoppedTime=1452796326342, exitStatus=0
2016-01-14 18:32:06,342 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:06,342 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326081_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:06 Completed Dag: dag_1452796326081_0001_1
2016-01-14 18:32:06,345 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796326081_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:06,345 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796326081_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:06,346 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796326081_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:06,346 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796326081_0001_00_000001, Exiting
2016-01-14 18:32:06,346 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796326081_0001_00_000001
2016-01-14 18:32:06,346 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796326081_0001_00_000001
2016-01-14 18:32:06,347 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796326081_0001_1_post
2016-01-14 18:32:06,347 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:06,347 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:06,348 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452796326081_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 18:32:06,348 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326081_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 18:32:06,351 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796326081_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:06,351 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796326081_0001_00_000001 completed successfully
2016-01-14 18:32:06,351 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'_RESULTS.ALL_'field2'_-1, applicationId=application_1452796326081_0001
2016-01-14 18:32:06,351 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326081_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 18:32:06,353 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:06,353 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:06,353 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:06,353 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:06,353 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:06,354 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:06,354 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:06,354 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:06,354 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:06,355 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:06,355 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:06,355 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:06,355 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:06,360 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/6055A756A8BE4CDD97F4BC0689A098F8/C7F317BECFF045529B87A3265C10B007/.tez/application_1452796326081_0001
2016-01-14 18:32:06,360 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.299
2016-01-14 18:32:06,432 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_'field2'_-1
2016-01-14 18:32:06,454 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:06,454 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:06,492 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 18:32:06,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 18:32:06,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:06,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:06,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:06,508 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:06,509 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field2'
2016-01-14 18:32:06,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:06,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:06,522 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field2'"]
2016-01-14 18:32:06,522 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:06,522 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:06,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:06,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...LTS.ALL_'field2'_'field2'
2016-01-14 18:32:06,523 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:06,539 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:06,544 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:06,544 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:06,544 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:06,556 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260/.tez/application_1452796326544_0001 doesn't exist and is created
2016-01-14 18:32:06,571 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:06,572 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:06,572 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260/.tez/application_1452796326544_0001
2016-01-14 18:32:06,574 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796326544_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:06,591 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:06,591 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:06,593 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:06,593 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:06,593 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260/.tez/application_1452796326544_0001/localmode-log-dir
2016-01-14 18:32:06,594 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260/.tez/application_1452796326544_0001/localmode-log-dir/history.txt.appattempt_1452796326544_0001_000000, maxErrors=10
2016-01-14 18:32:06,594 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:06,594 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796326544_0001_000000, appSubmitTime=1452796326573, launchTime=1452796326573
2016-01-14 18:32:06,598 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:06,600 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:06,601 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:06,601 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:06,605 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:37916
2016-01-14 18:32:06,618 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:06,620 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:06,620 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796326544_0001_000000, startTime=1452796326620
2016-01-14 18:32:06,620 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:06,672 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:06,672 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:06,672 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...LTS.ALL_'field2'_'field2', applicationId=application_1452796326544_0001, dagName=[B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260] every.every/(1/1) ...LTS.ALL_'field2'_'field2'
2016-01-14 18:32:06,685 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:06,685 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:06,690 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260] every.every/(1/1) ...LTS.ALL_'field2'_'field2'
2016-01-14 18:32:06,691 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796326544_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260/.tez/application_1452796326544_0001/localmode-log-dir/dag_1452796326544_0001_1.dot
2016-01-14 18:32:06,691 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260/.tez/application_1452796326544_0001/localmode-log-dir/dag_1452796326544_0001_1-tez-dag.pb.txt
2016-01-14 18:32:06,710 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796326544_0001_1
2016-01-14 18:32:06,710 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:06,710 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260] every.every/(1/1) ...LTS.ALL_'field2'_'field2'
2016-01-14 18:32:06 Running Dag: dag_1452796326544_0001_1
2016-01-14 18:32:06,722 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796326544_0001_1, submitTime=1452796326690
2016-01-14 18:32:06,722 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:06,722 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex DC5EA38CC6A34D9F8ADB2491B6804339
2016-01-14 18:32:06,722 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:06,723 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796326544_0001_1, initTime=1452796326722
2016-01-14 18:32:06,723 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:06,723 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796326544_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:06,723 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:06,723 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:DAG_STARTED]: dagID=dag_1452796326544_0001_1, startTime=1452796326723
2016-01-14 18:32:06,724 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:06,724 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796326544_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:06,724 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: DC5EA38CC6A34D9F8ADB2491B6804339 : {A3634CEBC9574060961CAB87BC7061F7={InputName=A3634CEBC9574060961CAB87BC7061F7}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:06,724 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: A3634CEBC9574060961CAB87BC7061F7, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:06,724 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,724 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,725 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,725 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]. Starting root input initializers: 1
2016-01-14 18:32:06,726 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...LTS.ALL_'field2'_'field2', applicationId=application_1452796326544_0001, dagName=[B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260] every.every/(1/1) ...LTS.ALL_'field2'_'field2'
2016-01-14 18:32:06,730 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:06,731 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: A3634CEBC9574060961CAB87BC7061F7 on vertex vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,734 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:06,735 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input A3634CEBC9574060961CAB87BC7061F7 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:06,735 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:06,737 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:06,739 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:06,740 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: A3634CEBC9574060961CAB87BC7061F7 on vertex vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,740 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:06,741 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {A3634CEBC9574060961CAB87BC7061F7=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:06,741 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339] parallelism set to 1
2016-01-14 18:32:06,741 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:06,741 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796326544_0001_1_00, eventCount=1
2016-01-14 18:32:06,741 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,741 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6942A699D6EC41D38A5FCCCBF24FE21B, vertexId=vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:06,742 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6942A699D6EC41D38A5FCCCBF24FE21B, vertexId=vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,744 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6942A699D6EC41D38A5FCCCBF24FE21B, vertexName=DC5EA38CC6A34D9F8ADB2491B6804339, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:06,744 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6942A699D6EC41D38A5FCCCBF24FE21B, vertexId=vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,744 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:VERTEX_INITIALIZED]: vertexName=DC5EA38CC6A34D9F8ADB2491B6804339, vertexId=vertex_1452796326544_0001_1_00, initRequestedTime=1452796326724, initedTime=1452796326744, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:06,745 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339] with distanceFromRoot: 0
2016-01-14 18:32:06,744 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:06,745 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:06,745 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in DC5EA38CC6A34D9F8ADB2491B6804339
2016-01-14 18:32:06,746 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,746 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796326544_0001_1_00, startRequestedTime=1452796326745, startedTime=1452796326745
2016-01-14 18:32:06,746 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:06,746 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:06,747 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:06,747 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:TASK_STARTED]: vertexName=DC5EA38CC6A34D9F8ADB2491B6804339, taskId=task_1452796326544_0001_1_00_000000, scheduledTime=1452796326747, launchTime=1452796326747
2016-01-14 18:32:06,747 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796326544_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:06,747 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,748 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260] every.every/(1/1) ...LTS.ALL_'field2'_'field2', VertexName: DC5EA38CC6A34D9F8ADB2491B6804339, VertexParallelism: 1, TaskAttemptID:attempt_1452796326544_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A3634CEBC9574060961CAB87BC7061F7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6942A699D6EC41D38A5FCCCBF24FE21B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:06,748 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796326544_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:06,748 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:06,748 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796326544_0001, with dag id: dag_1452796326544_0001_1
2016-01-14 18:32:06,749 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:06,750 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:06,750 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:06,751 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796326544_0001_00_000001
2016-01-14 18:32:06,751 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326544_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:06,753 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796326544_0001_00_000001
2016-01-14 18:32:06,753 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:06,754 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326544_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:06,755 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:06,755 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796326544_0001_00_000001, launchTime=1452796326754
2016-01-14 18:32:06,756 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796326544_0001_00_000001
2016-01-14 18:32:06,757 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796326544_0001_1_00_000000_0] to container: [container_1452796326544_0001_00_000001]
2016-01-14 18:32:06,757 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326544_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:06,758 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796326544_0001_1_00_000000_0] started. Is using containerId: [container_1452796326544_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:06,758 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:06,758 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=DC5EA38CC6A34D9F8ADB2491B6804339, taskAttemptId=attempt_1452796326544_0001_1_00_000000_0, startTime=1452796326757, containerId=container_1452796326544_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796326544_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:06,758 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796326544_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:06,759 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796326544_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:06,759 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796326544_0001_00_000001 given task: attempt_1452796326544_0001_1_00_000000_0
2016-01-14 18:32:06,759 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796326544_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796326544_0001_1_00_000000_0
2016-01-14 18:32:06 Starting to run new task attempt: attempt_1452796326544_0001_1_00_000000_0
2016-01-14 18:32:06,760 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796326544_0001_1_00_000000_0
2016-01-14 18:32:06,760 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:06,760 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:06,760 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:06,761 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:06,761 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:06,761 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:06,761 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260] every.every/(1/1) ...LTS.ALL_'field2'_'field2', VertexName: DC5EA38CC6A34D9F8ADB2491B6804339, VertexParallelism: 1, TaskAttemptID:attempt_1452796326544_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=A3634CEBC9574060961CAB87BC7061F7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6942A699D6EC41D38A5FCCCBF24FE21B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:06,761 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:06,763 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796326544_0001_1_00_000000_0
2016-01-14 18:32:06,763 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:06,764 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:06,765 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=A3634CEBC9574060961CAB87BC7061F7, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:06,766 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:06,766 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: A3634CEBC9574060961CAB87BC7061F7
2016-01-14 18:32:06,766 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: A3634CEBC9574060961CAB87BC7061F7
2016-01-14 18:32:06,769 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:06,769 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: A3634CEBC9574060961CAB87BC7061F7
2016-01-14 18:32:06,769 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: A3634CEBC9574060961CAB87BC7061F7
2016-01-14 18:32:06,770 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:06,773 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796326544_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:06,774 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:06,776 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6942A699D6EC41D38A5FCCCBF24FE21B, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:06,776 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:06,777 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6942A699D6EC41D38A5FCCCBF24FE21B
2016-01-14 18:32:06,777 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:06,777 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6942A699D6EC41D38A5FCCCBF24FE21B
2016-01-14 18:32:06,782 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: DC5EA38CC6A34D9F8ADB2491B6804339, ordinal: 0
2016-01-14 18:32:06,782 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DC5EA38CC6A34D9F8ADB2491B6804339, mem on start (mb), free: 321, total: 389, max: 672
2016-01-14 18:32:06,782 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:06,782 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:06,782 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:06,785 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:06,785 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6942A699D6EC41D38A5FCCCBF24FE21B
2016-01-14 18:32:06,785 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:06,785 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:06,786 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:06,786 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:06,786 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:06,786 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:06,786 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:06,786 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:06,786 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, A3634CEBC9574060961CAB87BC7061F7, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:06,787 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6942A699D6EC41D38A5FCCCBF24FE21B, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:06,787 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:06,787 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: A3634CEBC9574060961CAB87BC7061F7 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:06,787 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:06,787 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:06,787 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: A3634CEBC9574060961CAB87BC7061F7
2016-01-14 18:32:06,787 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:06,787 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: A3634CEBC9574060961CAB87BC7061F7
2016-01-14 18:32:06,787 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:06,788 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796326544_0001_1_00_000000_0
2016-01-14 18:32:06,789 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:06,790 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7deffe7a
2016-01-14 18:32:06,791 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7deffe7a
2016-01-14 18:32:06,791 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:06,792 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:06,791 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:06,793 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: A3634CEBC9574060961CAB87BC7061F7
2016-01-14 18:32:06,793 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field2'"], id: 6942A699D6EC41D38A5FCCCBF24FE21B
2016-01-14 18:32:06,793 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field2'"]
2016-01-14 18:32:06,793 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:06,793 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:06,794 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: DC5EA38CC6A34D9F8ADB2491B6804339, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:06,797 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:06,797 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:06,798 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796326544_0001_1_00_000000_0
2016-01-14 18:32:06,798 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796326544_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:06,799 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796326544_0001_1_00_000000_0
2016-01-14 18:32:06,799 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: DC5EA38CC6A34D9F8ADB2491B6804339, mem on close (mb), free: 319, total: 389, max: 672
2016-01-14 18:32:06 Completed running task attempt: attempt_1452796326544_0001_1_00_000000_0
2016-01-14 18:32:06,804 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796326544_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:06,806 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796326794, Process_Duration=5, Process_End_Time=1452796326799, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:06,806 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=DC5EA38CC6A34D9F8ADB2491B6804339, taskAttemptId=attempt_1452796326544_0001_1_00_000000_0, startTime=1452796326757, finishTime=1452796326806, timeTaken=49, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796326794, Process_Duration=5, Process_End_Time=1452796326799, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:06,806 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:06,806 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796326544_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:06,807 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:06,807 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796326544_0001_1_00_000000_0
2016-01-14 18:32:06,807 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:06,807 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796326544_0001_00_000001
2016-01-14 18:32:06,808 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:TASK_FINISHED]: vertexName=DC5EA38CC6A34D9F8ADB2491B6804339, taskId=task_1452796326544_0001_1_00_000000, startTime=1452796326757, finishTime=1452796326807, timeTaken=50, status=SUCCEEDED, successfulAttemptID=attempt_1452796326544_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796326794, Process_Duration=5, Process_End_Time=1452796326799, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:06,808 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796326544_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:06,809 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339] : 1
2016-01-14 18:32:06,809 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,808 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:06,810 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:VERTEX_FINISHED]: vertexName=DC5EA38CC6A34D9F8ADB2491B6804339, vertexId=vertex_1452796326544_0001_1_00, initRequestedTime=1452796326724, initedTime=1452796326744, startRequestedTime=1452796326745, startedTime=1452796326745, finishTime=1452796326809, timeTaken=64, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796326794, Process_Duration=5, Process_End_Time=1452796326799, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796326757, firstTasksToStart=[ task_1452796326544_0001_1_00_000000 ], lastTaskFinishTime=1452796326806, lastTasksToFinish=[ task_1452796326544_0001_1_00_000000 ], minTaskDuration=49, maxTaskDuration=49, avgTaskDuration=49.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796326544_0001_1_00_000000 ], longestDurationTasks=[ task_1452796326544_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:06,810 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:06,810 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:06,810 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326544_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:06,810 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796326544_0001_00_000001, stoppedTime=1452796326810, exitStatus=0
2016-01-14 18:32:06,810 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:06,811 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796326544_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:06,810 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326544_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:06,811 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:06,811 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796326544_0001_1
2016-01-14 18:32:06,811 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796326544_0001_1
2016-01-14 18:32:06,811 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:06,811 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 6942A699D6EC41D38A5FCCCBF24FE21B for vertex: vertex_1452796326544_0001_1_00 [DC5EA38CC6A34D9F8ADB2491B6804339]
2016-01-14 18:32:06,811 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796326544_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:06,819 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796326544_0001_00_000001, Exiting
2016-01-14 18:32:06,819 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796326544_0001_00_000001
2016-01-14 18:32:06,819 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796326544_0001_00_000001
2016-01-14 18:32:06,820 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796326544_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:06,820 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796326544_0001_00_000001 completed successfully
2016-01-14 18:32:06,822 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796326544_0001_1, queueSize=0
2016-01-14 18:32:06,822 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:06,823 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796326544_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796326544_0001_1, startTime=1452796326723, finishTime=1452796326821, timeTaken=98, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796326794, Process_Duration=5, Process_End_Time=1452796326799, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:06,823 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796326544_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:06,823 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796326544_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:06,823 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796326544_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:06,823 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796326544_0001_00_000001
2016-01-14 18:32:06 Completed Dag: dag_1452796326544_0001_1
2016-01-14 18:32:06,823 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796326544_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:06,823 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796326544_0001_1_post
2016-01-14 18:32:06,824 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:06,824 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:06,831 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...LTS.ALL_'field2'_'field2', applicationId=application_1452796326544_0001
2016-01-14 18:32:06,833 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:06,833 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:06,833 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:06,833 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:06,833 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:06,834 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:06,834 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:06,834 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:06,834 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:06,834 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:06,835 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:06,835 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:06,835 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:06,840 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/B4388A3BECD44421AD4F189988916AC2/AF471E70F6E54229B28E875D2B358260/.tez/application_1452796326544_0001
2016-01-14 18:32:06,840 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.319
2016-01-14 18:32:06,911 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_'field2'_'field2'
2016-01-14 18:32:06,935 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:06,935 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:06,972 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.010
2016-01-14 18:32:06,976 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 18:32:06,977 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:06,977 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:06,977 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:06,996 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:06,997 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field'
2016-01-14 18:32:07,006 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:07,006 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:07,006 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field'"]
2016-01-14 18:32:07,006 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:07,006 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:07,006 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:07,007 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ULTS.ALL_'field2'_'field'
2016-01-14 18:32:07,007 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:07,022 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:07,029 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:07,030 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:07,030 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:07,041 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E/.tez/application_1452796327029_0001 doesn't exist and is created
2016-01-14 18:32:07,056 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:07,057 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:07,058 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E/.tez/application_1452796327029_0001
2016-01-14 18:32:07,060 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796327029_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:07,071 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:07,071 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:07,073 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:07,073 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:07,073 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E/.tez/application_1452796327029_0001/localmode-log-dir
2016-01-14 18:32:07,073 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E/.tez/application_1452796327029_0001/localmode-log-dir/history.txt.appattempt_1452796327029_0001_000000, maxErrors=10
2016-01-14 18:32:07,073 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:07,074 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796327029_0001_000000, appSubmitTime=1452796327059, launchTime=1452796327060
2016-01-14 18:32:07,077 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:07,079 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:07,080 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:07,081 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:07,081 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:52780
2016-01-14 18:32:07,082 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:07,084 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796327029_0001_000000, startTime=1452796327084
2016-01-14 18:32:07,084 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:07,084 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:07,154 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:07,154 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:07,157 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:07,157 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:07,157 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ULTS.ALL_'field2'_'field', applicationId=application_1452796327029_0001, dagName=[DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E] every.every/(1/1) ...ULTS.ALL_'field2'_'field'
2016-01-14 18:32:07,173 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E] every.every/(1/1) ...ULTS.ALL_'field2'_'field'
2016-01-14 18:32:07,175 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796327029_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E/.tez/application_1452796327029_0001/localmode-log-dir/dag_1452796327029_0001_1.dot
2016-01-14 18:32:07,175 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E/.tez/application_1452796327029_0001/localmode-log-dir/dag_1452796327029_0001_1-tez-dag.pb.txt
2016-01-14 18:32:07,179 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796327029_0001_1
2016-01-14 18:32:07,179 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:07,180 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E] every.every/(1/1) ...ULTS.ALL_'field2'_'field'
2016-01-14 18:32:07 Running Dag: dag_1452796327029_0001_1
2016-01-14 18:32:07,189 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796327029_0001_1, submitTime=1452796327174
2016-01-14 18:32:07,189 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:07,190 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex FBD596D3B4CF485EB9F75D44EB23D05E
2016-01-14 18:32:07,190 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:07,190 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796327029_0001_1, initTime=1452796327189
2016-01-14 18:32:07,191 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:07,191 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796327029_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:07,191 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:DAG_STARTED]: dagID=dag_1452796327029_0001_1, startTime=1452796327191
2016-01-14 18:32:07,191 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:07,191 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:07,191 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796327029_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:07,192 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: FBD596D3B4CF485EB9F75D44EB23D05E : {33D5EE5A35BF4DC098E86D167D55D77B={InputName=33D5EE5A35BF4DC098E86D167D55D77B}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:07,192 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 33D5EE5A35BF4DC098E86D167D55D77B, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:07,192 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,192 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,192 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,193 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]. Starting root input initializers: 1
2016-01-14 18:32:07,193 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ULTS.ALL_'field2'_'field', applicationId=application_1452796327029_0001, dagName=[DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E] every.every/(1/1) ...ULTS.ALL_'field2'_'field'
2016-01-14 18:32:07,193 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:07,193 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 33D5EE5A35BF4DC098E86D167D55D77B on vertex vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,196 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:07,196 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 33D5EE5A35BF4DC098E86D167D55D77B asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:07,197 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:07,197 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:07,199 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:07,199 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 33D5EE5A35BF4DC098E86D167D55D77B on vertex vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,199 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:07,199 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {33D5EE5A35BF4DC098E86D167D55D77B=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:07,199 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E] parallelism set to 1
2016-01-14 18:32:07,200 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:07,200 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796327029_0001_1_00, eventCount=1
2016-01-14 18:32:07,200 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,200 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=F52D8425F8FD488C8AD74DCCFD69D8E3, vertexId=vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:07,200 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=F52D8425F8FD488C8AD74DCCFD69D8E3, vertexId=vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,202 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=F52D8425F8FD488C8AD74DCCFD69D8E3, vertexName=FBD596D3B4CF485EB9F75D44EB23D05E, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:07,202 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=F52D8425F8FD488C8AD74DCCFD69D8E3, vertexId=vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,203 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:07,203 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FBD596D3B4CF485EB9F75D44EB23D05E, vertexId=vertex_1452796327029_0001_1_00, initRequestedTime=1452796327192, initedTime=1452796327203, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:07,203 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E] with distanceFromRoot: 0
2016-01-14 18:32:07,203 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:07,204 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in FBD596D3B4CF485EB9F75D44EB23D05E
2016-01-14 18:32:07,204 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,204 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:07,204 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796327029_0001_1_00, startRequestedTime=1452796327204, startedTime=1452796327204
2016-01-14 18:32:07,204 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:07,205 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:07,205 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:TASK_STARTED]: vertexName=FBD596D3B4CF485EB9F75D44EB23D05E, taskId=task_1452796327029_0001_1_00_000000, scheduledTime=1452796327205, launchTime=1452796327205
2016-01-14 18:32:07,205 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796327029_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:07,205 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,205 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E] every.every/(1/1) ...ULTS.ALL_'field2'_'field', VertexName: FBD596D3B4CF485EB9F75D44EB23D05E, VertexParallelism: 1, TaskAttemptID:attempt_1452796327029_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=33D5EE5A35BF4DC098E86D167D55D77B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=F52D8425F8FD488C8AD74DCCFD69D8E3, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:07,206 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796327029_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:07,206 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:07,206 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:07,207 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:07,207 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:07,207 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796327029_0001_00_000001
2016-01-14 18:32:07,207 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327029_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:07,209 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796327029_0001_00_000001
2016-01-14 18:32:07,209 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:07,209 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327029_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:07,210 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:07,210 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796327029_0001, with dag id: dag_1452796327029_0001_1
2016-01-14 18:32:07,210 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796327029_0001_00_000001, launchTime=1452796327210
2016-01-14 18:32:07,211 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796327029_0001_00_000001
2016-01-14 18:32:07,211 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796327029_0001_1_00_000000_0] to container: [container_1452796327029_0001_00_000001]
2016-01-14 18:32:07,212 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327029_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:07,213 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796327029_0001_1_00_000000_0] started. Is using containerId: [container_1452796327029_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:07,213 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FBD596D3B4CF485EB9F75D44EB23D05E, taskAttemptId=attempt_1452796327029_0001_1_00_000000_0, startTime=1452796327212, containerId=container_1452796327029_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796327029_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:07,213 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796327029_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:07,213 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796327029_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:07,213 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:07,213 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796327029_0001_00_000001 given task: attempt_1452796327029_0001_1_00_000000_0
2016-01-14 18:32:07,214 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796327029_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796327029_0001_1_00_000000_0
2016-01-14 18:32:07 Starting to run new task attempt: attempt_1452796327029_0001_1_00_000000_0
2016-01-14 18:32:07,214 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796327029_0001_1_00_000000_0
2016-01-14 18:32:07,214 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:07,215 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:07,215 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:07,215 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:07,215 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:07,215 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:07,215 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E] every.every/(1/1) ...ULTS.ALL_'field2'_'field', VertexName: FBD596D3B4CF485EB9F75D44EB23D05E, VertexParallelism: 1, TaskAttemptID:attempt_1452796327029_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=33D5EE5A35BF4DC098E86D167D55D77B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=F52D8425F8FD488C8AD74DCCFD69D8E3, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:07,215 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:07,220 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796327029_0001_1_00_000000_0
2016-01-14 18:32:07,220 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:07,220 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:07,221 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=33D5EE5A35BF4DC098E86D167D55D77B, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:07,221 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:07,222 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 33D5EE5A35BF4DC098E86D167D55D77B
2016-01-14 18:32:07,222 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 33D5EE5A35BF4DC098E86D167D55D77B
2016-01-14 18:32:07,224 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:07,224 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 33D5EE5A35BF4DC098E86D167D55D77B
2016-01-14 18:32:07,224 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 33D5EE5A35BF4DC098E86D167D55D77B
2016-01-14 18:32:07,225 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:07,226 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=F52D8425F8FD488C8AD74DCCFD69D8E3, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:07,226 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:07,226 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: F52D8425F8FD488C8AD74DCCFD69D8E3
2016-01-14 18:32:07,226 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:07,226 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: F52D8425F8FD488C8AD74DCCFD69D8E3
2016-01-14 18:32:07,228 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:07,232 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796327029_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:07,239 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FBD596D3B4CF485EB9F75D44EB23D05E, ordinal: 0
2016-01-14 18:32:07,240 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FBD596D3B4CF485EB9F75D44EB23D05E, mem on start (mb), free: 230, total: 389, max: 672
2016-01-14 18:32:07,240 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:07,240 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:07,240 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:07,245 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:07,245 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: F52D8425F8FD488C8AD74DCCFD69D8E3
2016-01-14 18:32:07,246 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:07,246 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:07,246 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:07,246 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:07,246 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:07,246 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:07,246 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:07,247 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:07,247 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 33D5EE5A35BF4DC098E86D167D55D77B, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:07,247 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, F52D8425F8FD488C8AD74DCCFD69D8E3, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:07,247 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:07,247 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 33D5EE5A35BF4DC098E86D167D55D77B being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:07,247 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:07,247 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:07,247 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 33D5EE5A35BF4DC098E86D167D55D77B
2016-01-14 18:32:07,247 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:07,248 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 33D5EE5A35BF4DC098E86D167D55D77B
2016-01-14 18:32:07,248 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:07,248 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796327029_0001_1_00_000000_0
2016-01-14 18:32:07,251 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:07,252 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 33D5EE5A35BF4DC098E86D167D55D77B
2016-01-14 18:32:07,252 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field'"], id: F52D8425F8FD488C8AD74DCCFD69D8E3
2016-01-14 18:32:07,252 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_'field'"]
2016-01-14 18:32:07,253 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:07,253 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:07,253 INFO input.MRInput (MRInput.java:checkAndAwaitRecordReaderInitialization(597)) - Awaiting RecordReader initialization
2016-01-14 18:32:07,253 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:07,254 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@38236e88
2016-01-14 18:32:07,254 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@38236e88
2016-01-14 18:32:07,254 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:07,255 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:07,255 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FBD596D3B4CF485EB9F75D44EB23D05E, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:07,257 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:07,258 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:07,258 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796327029_0001_1_00_000000_0
2016-01-14 18:32:07,259 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796327029_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:07,259 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796327029_0001_1_00_000000_0
2016-01-14 18:32:07,259 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FBD596D3B4CF485EB9F75D44EB23D05E, mem on close (mb), free: 229, total: 389, max: 672
2016-01-14 18:32:07 Completed running task attempt: attempt_1452796327029_0001_1_00_000000_0
2016-01-14 18:32:07,261 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796327029_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:07,262 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FBD596D3B4CF485EB9F75D44EB23D05E, taskAttemptId=attempt_1452796327029_0001_1_00_000000_0, startTime=1452796327212, finishTime=1452796327262, timeTaken=50, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796327255, Process_Duration=4, Process_End_Time=1452796327259, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:07,262 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796327029_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:07,262 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796327029_0001_1_00_000000_0
2016-01-14 18:32:07,263 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:TASK_FINISHED]: vertexName=FBD596D3B4CF485EB9F75D44EB23D05E, taskId=task_1452796327029_0001_1_00_000000, startTime=1452796327212, finishTime=1452796327263, timeTaken=51, status=SUCCEEDED, successfulAttemptID=attempt_1452796327029_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796327255, Process_Duration=4, Process_End_Time=1452796327259, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:07,263 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796327029_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:07,263 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E] : 1
2016-01-14 18:32:07,263 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,264 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:VERTEX_FINISHED]: vertexName=FBD596D3B4CF485EB9F75D44EB23D05E, vertexId=vertex_1452796327029_0001_1_00, initRequestedTime=1452796327192, initedTime=1452796327203, startRequestedTime=1452796327204, startedTime=1452796327204, finishTime=1452796327264, timeTaken=60, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796327255, Process_Duration=4, Process_End_Time=1452796327259, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796327212, firstTasksToStart=[ task_1452796327029_0001_1_00_000000 ], lastTaskFinishTime=1452796327262, lastTasksToFinish=[ task_1452796327029_0001_1_00_000000 ], minTaskDuration=50, maxTaskDuration=50, avgTaskDuration=50.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796327029_0001_1_00_000000 ], longestDurationTasks=[ task_1452796327029_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:07,265 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:07,265 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:07,265 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:07,266 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:07,267 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:07,271 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:07,271 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796327029_0001_1
2016-01-14 18:32:07,271 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796327029_0001_1
2016-01-14 18:32:07,271 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: F52D8425F8FD488C8AD74DCCFD69D8E3 for vertex: vertex_1452796327029_0001_1_00 [FBD596D3B4CF485EB9F75D44EB23D05E]
2016-01-14 18:32:07,279 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796327029_0001_1, queueSize=0
2016-01-14 18:32:07,279 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:07,279 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796327029_0001_1, startTime=1452796327191, finishTime=1452796327278, timeTaken=87, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796327255, Process_Duration=4, Process_End_Time=1452796327259, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:07,279 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796327029_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:07,279 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796327029_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:07,280 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796327255, Process_Duration=4, Process_End_Time=1452796327259, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:07,280 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327029_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:07,280 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327029_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796327029_0001_00_000001, stoppedTime=1452796327280, exitStatus=0
2016-01-14 18:32:07,280 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327029_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:07 Completed Dag: dag_1452796327029_0001_1
2016-01-14 18:32:07,281 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796327029_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:07,281 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:07,281 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:07,281 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:07,281 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796327029_0001_00_000001
2016-01-14 18:32:07,281 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796327029_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:07,281 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796327029_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:07,282 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796327029_0001_00_000001, Exiting
2016-01-14 18:32:07,282 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796327029_0001_00_000001
2016-01-14 18:32:07,282 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796327029_0001_00_000001
2016-01-14 18:32:07,281 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796327029_0001_1_post
2016-01-14 18:32:07,282 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:07,283 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:07,283 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452796327029_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 18:32:07,284 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327029_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 18:32:07,284 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796327029_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:07,284 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796327029_0001_00_000001 completed successfully
2016-01-14 18:32:07,285 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327029_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 18:32:07,289 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ULTS.ALL_'field2'_'field', applicationId=application_1452796327029_0001
2016-01-14 18:32:07,291 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:07,291 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:07,292 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:07,292 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:07,292 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:07,293 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:07,293 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:07,293 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:07,294 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:07,293 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:07,294 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:07,295 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:07,295 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:07,299 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/DC6F007BC38B466DBCEEF251AE0E8F88/F6FC6ECF86824F89BA996315FF71F23E/.tez/application_1452796327029_0001
2016-01-14 18:32:07,300 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.294
2016-01-14 18:32:07,368 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_'field2'_'field'
2016-01-14 18:32:07,391 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:07,392 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:07,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.008
2016-01-14 18:32:07,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 18:32:07,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:07,432 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:07,432 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:07,445 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:07,446 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_RESULTS
2016-01-14 18:32:07,454 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:07,454 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:07,455 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_RESULTS"]
2016-01-14 18:32:07,455 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:07,455 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:07,455 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:07,456 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ULTS.ALL_'field2'_RESULTS
2016-01-14 18:32:07,457 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:07,470 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:07,474 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:07,475 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:07,475 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:07,484 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4/.tez/application_1452796327474_0001 doesn't exist and is created
2016-01-14 18:32:07,498 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:07,498 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:07,498 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4/.tez/application_1452796327474_0001
2016-01-14 18:32:07,500 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796327474_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:07,510 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:07,511 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:07,512 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:07,512 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:07,513 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4/.tez/application_1452796327474_0001/localmode-log-dir
2016-01-14 18:32:07,513 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4/.tez/application_1452796327474_0001/localmode-log-dir/history.txt.appattempt_1452796327474_0001_000000, maxErrors=10
2016-01-14 18:32:07,513 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:07,513 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796327474_0001_000000, appSubmitTime=1452796327500, launchTime=1452796327500
2016-01-14 18:32:07,517 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:07,519 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:07,520 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:07,520 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:07,520 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:50770
2016-01-14 18:32:07,522 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:07,524 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796327474_0001_000000, startTime=1452796327524
2016-01-14 18:32:07,524 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:07,524 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:07,598 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:07,598 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:07,598 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ULTS.ALL_'field2'_RESULTS, applicationId=application_1452796327474_0001, dagName=[092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS
2016-01-14 18:32:07,614 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:07,614 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:07,614 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS
2016-01-14 18:32:07,615 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796327474_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4/.tez/application_1452796327474_0001/localmode-log-dir/dag_1452796327474_0001_1.dot
2016-01-14 18:32:07,616 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4/.tez/application_1452796327474_0001/localmode-log-dir/dag_1452796327474_0001_1-tez-dag.pb.txt
2016-01-14 18:32:07,620 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796327474_0001_1
2016-01-14 18:32:07,620 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:07,621 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS
2016-01-14 18:32:07 Running Dag: dag_1452796327474_0001_1
2016-01-14 18:32:07,630 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796327474_0001_1, submitTime=1452796327614
2016-01-14 18:32:07,630 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:07,630 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BA9A6409A72C44D6B85DCC6F0BD18C3E
2016-01-14 18:32:07,630 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:07,631 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796327474_0001_1, initTime=1452796327630
2016-01-14 18:32:07,631 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796327474_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:07,631 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:07,631 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:DAG_STARTED]: dagID=dag_1452796327474_0001_1, startTime=1452796327631
2016-01-14 18:32:07,631 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:07,631 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796327474_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:07,631 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:07,632 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BA9A6409A72C44D6B85DCC6F0BD18C3E : {8235D7BDA6E34C859287A6F0BC1D8694={InputName=8235D7BDA6E34C859287A6F0BC1D8694}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:07,632 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8235D7BDA6E34C859287A6F0BC1D8694, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:07,632 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,632 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,632 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,632 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]. Starting root input initializers: 1
2016-01-14 18:32:07,633 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:07,633 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8235D7BDA6E34C859287A6F0BC1D8694 on vertex vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,633 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ULTS.ALL_'field2'_RESULTS, applicationId=application_1452796327474_0001, dagName=[092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS
2016-01-14 18:32:07,635 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:07,635 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8235D7BDA6E34C859287A6F0BC1D8694 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:07,636 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:07,636 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:07,637 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:07,638 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8235D7BDA6E34C859287A6F0BC1D8694 on vertex vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,638 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:07,638 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8235D7BDA6E34C859287A6F0BC1D8694=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:07,638 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E] parallelism set to 1
2016-01-14 18:32:07,639 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:07,639 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796327474_0001_1_00, eventCount=1
2016-01-14 18:32:07,639 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,639 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=C8634E239133493BB4A0034F8C37DD81, vertexId=vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:07,639 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=C8634E239133493BB4A0034F8C37DD81, vertexId=vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,641 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=C8634E239133493BB4A0034F8C37DD81, vertexName=BA9A6409A72C44D6B85DCC6F0BD18C3E, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:07,641 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=C8634E239133493BB4A0034F8C37DD81, vertexId=vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,642 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BA9A6409A72C44D6B85DCC6F0BD18C3E, vertexId=vertex_1452796327474_0001_1_00, initRequestedTime=1452796327632, initedTime=1452796327642, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:07,642 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:07,642 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E] with distanceFromRoot: 0
2016-01-14 18:32:07,643 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:07,644 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BA9A6409A72C44D6B85DCC6F0BD18C3E
2016-01-14 18:32:07,644 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,645 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:07,645 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796327474_0001_1_00, startRequestedTime=1452796327644, startedTime=1452796327644
2016-01-14 18:32:07,645 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:07,646 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:07,646 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:TASK_STARTED]: vertexName=BA9A6409A72C44D6B85DCC6F0BD18C3E, taskId=task_1452796327474_0001_1_00_000000, scheduledTime=1452796327646, launchTime=1452796327646
2016-01-14 18:32:07,647 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796327474_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:07,647 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,647 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS, VertexName: BA9A6409A72C44D6B85DCC6F0BD18C3E, VertexParallelism: 1, TaskAttemptID:attempt_1452796327474_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8235D7BDA6E34C859287A6F0BC1D8694, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C8634E239133493BB4A0034F8C37DD81, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:07,647 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796327474_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:07,648 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:07,648 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:07,649 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:07,649 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:07,649 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796327474_0001_00_000001
2016-01-14 18:32:07,649 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327474_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:07,651 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796327474_0001_00_000001
2016-01-14 18:32:07,652 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:07,652 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327474_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:07,653 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796327474_0001_00_000001, launchTime=1452796327652
2016-01-14 18:32:07,652 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:07,654 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796327474_0001_00_000001
2016-01-14 18:32:07,654 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796327474_0001_1_00_000000_0] to container: [container_1452796327474_0001_00_000001]
2016-01-14 18:32:07,654 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327474_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:07,655 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796327474_0001_1_00_000000_0] started. Is using containerId: [container_1452796327474_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:07,655 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BA9A6409A72C44D6B85DCC6F0BD18C3E, taskAttemptId=attempt_1452796327474_0001_1_00_000000_0, startTime=1452796327654, containerId=container_1452796327474_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796327474_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:07,655 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796327474_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:07,655 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:07,655 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796327474_0001_00_000001 given task: attempt_1452796327474_0001_1_00_000000_0
2016-01-14 18:32:07,655 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796327474_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:07,656 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796327474_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796327474_0001_1_00_000000_0
2016-01-14 18:32:07 Starting to run new task attempt: attempt_1452796327474_0001_1_00_000000_0
2016-01-14 18:32:07,656 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796327474_0001_1_00_000000_0
2016-01-14 18:32:07,656 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:07,656 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:07,657 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:07,657 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:07,657 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:07,657 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:07,657 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4] every.every/(1/1) ...ULTS.ALL_'field2'_RESULTS, VertexName: BA9A6409A72C44D6B85DCC6F0BD18C3E, VertexParallelism: 1, TaskAttemptID:attempt_1452796327474_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8235D7BDA6E34C859287A6F0BC1D8694, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C8634E239133493BB4A0034F8C37DD81, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:07,657 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:07,657 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796327474_0001, with dag id: dag_1452796327474_0001_1
2016-01-14 18:32:07,658 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796327474_0001_1_00_000000_0
2016-01-14 18:32:07,658 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:07,658 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:07,659 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=8235D7BDA6E34C859287A6F0BC1D8694, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:07,659 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:07,659 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:07,659 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 8235D7BDA6E34C859287A6F0BC1D8694
2016-01-14 18:32:07,660 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 8235D7BDA6E34C859287A6F0BC1D8694
2016-01-14 18:32:07,661 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796327474_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:07,662 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:07,663 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=C8634E239133493BB4A0034F8C37DD81, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:07,663 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:07,664 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: C8634E239133493BB4A0034F8C37DD81
2016-01-14 18:32:07,664 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:07,664 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:07,664 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 8235D7BDA6E34C859287A6F0BC1D8694
2016-01-14 18:32:07,664 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 8235D7BDA6E34C859287A6F0BC1D8694
2016-01-14 18:32:07,664 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: C8634E239133493BB4A0034F8C37DD81
2016-01-14 18:32:07,671 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BA9A6409A72C44D6B85DCC6F0BD18C3E, ordinal: 0
2016-01-14 18:32:07,672 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BA9A6409A72C44D6B85DCC6F0BD18C3E, mem on start (mb), free: 140, total: 389, max: 672
2016-01-14 18:32:07,672 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:07,672 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:07,672 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:07,674 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:07,674 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: C8634E239133493BB4A0034F8C37DD81
2016-01-14 18:32:07,676 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:07,677 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:07,677 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:07,677 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:07,678 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:07,678 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:07,678 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:07,679 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:07,679 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 8235D7BDA6E34C859287A6F0BC1D8694, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:07,679 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, C8634E239133493BB4A0034F8C37DD81, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:07,679 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:07,680 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 8235D7BDA6E34C859287A6F0BC1D8694
2016-01-14 18:32:07,680 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:07,680 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 8235D7BDA6E34C859287A6F0BC1D8694
2016-01-14 18:32:07,680 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 8235D7BDA6E34C859287A6F0BC1D8694 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:07,680 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:07,681 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:07,681 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:07,681 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796327474_0001_1_00_000000_0
2016-01-14 18:32:07,681 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:07,682 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@244da0ed
2016-01-14 18:32:07,683 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@244da0ed
2016-01-14 18:32:07,683 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:07,683 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:07,684 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:07,685 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 8235D7BDA6E34C859287A6F0BC1D8694
2016-01-14 18:32:07,685 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_RESULTS"], id: C8634E239133493BB4A0034F8C37DD81
2016-01-14 18:32:07,685 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_RESULTS"]
2016-01-14 18:32:07,686 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:07,686 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:07,686 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BA9A6409A72C44D6B85DCC6F0BD18C3E, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:07,690 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:07,690 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:07,690 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796327474_0001_1_00_000000_0
2016-01-14 18:32:07,690 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796327474_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:07,692 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796327474_0001_1_00_000000_0
2016-01-14 18:32:07,692 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BA9A6409A72C44D6B85DCC6F0BD18C3E, mem on close (mb), free: 138, total: 389, max: 672
2016-01-14 18:32:07 Completed running task attempt: attempt_1452796327474_0001_1_00_000000_0
2016-01-14 18:32:07,692 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796327474_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:07,694 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796327686, Process_Duration=6, Process_End_Time=1452796327692, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:07,694 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:07,694 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BA9A6409A72C44D6B85DCC6F0BD18C3E, taskAttemptId=attempt_1452796327474_0001_1_00_000000_0, startTime=1452796327654, finishTime=1452796327693, timeTaken=39, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796327686, Process_Duration=6, Process_End_Time=1452796327692, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:07,694 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796327474_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:07,694 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:07,694 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796327474_0001_1_00_000000_0
2016-01-14 18:32:07,695 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:07,695 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:TASK_FINISHED]: vertexName=BA9A6409A72C44D6B85DCC6F0BD18C3E, taskId=task_1452796327474_0001_1_00_000000, startTime=1452796327654, finishTime=1452796327694, timeTaken=40, status=SUCCEEDED, successfulAttemptID=attempt_1452796327474_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796327686, Process_Duration=6, Process_End_Time=1452796327692, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:07,695 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796327474_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:07,695 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E] : 1
2016-01-14 18:32:07,694 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:07,695 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:07,696 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796327474_0001_00_000001
2016-01-14 18:32:07,695 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,697 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:07,697 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:VERTEX_FINISHED]: vertexName=BA9A6409A72C44D6B85DCC6F0BD18C3E, vertexId=vertex_1452796327474_0001_1_00, initRequestedTime=1452796327632, initedTime=1452796327642, startRequestedTime=1452796327644, startedTime=1452796327644, finishTime=1452796327696, timeTaken=52, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796327686, Process_Duration=6, Process_End_Time=1452796327692, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796327654, firstTasksToStart=[ task_1452796327474_0001_1_00_000000 ], lastTaskFinishTime=1452796327693, lastTasksToFinish=[ task_1452796327474_0001_1_00_000000 ], minTaskDuration=39, maxTaskDuration=39, avgTaskDuration=39.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796327474_0001_1_00_000000 ], longestDurationTasks=[ task_1452796327474_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:07,697 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:07,697 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327474_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:07,697 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796327474_0001_00_000001, stoppedTime=1452796327697, exitStatus=0
2016-01-14 18:32:07,697 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:07,697 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327474_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:07,698 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:07,698 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796327474_0001_1
2016-01-14 18:32:07,698 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796327474_0001_1
2016-01-14 18:32:07,698 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: C8634E239133493BB4A0034F8C37DD81 for vertex: vertex_1452796327474_0001_1_00 [BA9A6409A72C44D6B85DCC6F0BD18C3E]
2016-01-14 18:32:07,706 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796327474_0001_1, queueSize=0
2016-01-14 18:32:07,706 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796327474_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:07,706 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796327474_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:07,706 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:07,706 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796327474_0001_00_000001, Exiting
2016-01-14 18:32:07,707 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796327474_0001_00_000001
2016-01-14 18:32:07,706 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327474_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796327474_0001_1, startTime=1452796327631, finishTime=1452796327705, timeTaken=74, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796327686, Process_Duration=6, Process_End_Time=1452796327692, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:07,707 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796327474_0001_00_000001
2016-01-14 18:32:07,707 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796327474_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:07,708 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796327474_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:07,708 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796327474_0001_00_000001 completed successfully
2016-01-14 18:32:07,708 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796327474_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:07,709 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796327474_0001_00_000001
2016-01-14 18:32:07 Completed Dag: dag_1452796327474_0001_1
2016-01-14 18:32:07,710 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796327474_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:07,710 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796327474_0001_1_post
2016-01-14 18:32:07,710 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:07,711 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:07,711 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327474_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:07,714 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ULTS.ALL_'field2'_RESULTS, applicationId=application_1452796327474_0001
2016-01-14 18:32:07,715 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:07,715 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:07,715 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:07,716 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:07,716 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:07,716 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:07,716 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:07,716 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:07,717 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:07,717 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:07,717 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:07,717 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:07,717 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:07,721 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/092C2D363F1B4C36BF3FD579162D9744/D5BC7D6CB1DF46B19A500BCFC6FFBCB4/.tez/application_1452796327474_0001
2016-01-14 18:32:07,722 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.267
2016-01-14 18:32:07,799 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_'field2'_RESULTS
2016-01-14 18:32:07,823 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:07,823 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:07,853 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.006
2016-01-14 18:32:07,859 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 18:32:07,860 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:07,860 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:07,860 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:07,875 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:07,876 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_ALL
2016-01-14 18:32:07,887 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:07,887 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:07,887 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_ALL"]
2016-01-14 18:32:07,887 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:07,888 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:07,888 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:07,889 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ..._RESULTS.ALL_'field2'_ALL
2016-01-14 18:32:07,889 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:07,902 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:07,906 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:07,906 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:07,906 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:07,915 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5/.tez/application_1452796327906_0001 doesn't exist and is created
2016-01-14 18:32:07,929 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:07,930 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:07,930 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5/.tez/application_1452796327906_0001
2016-01-14 18:32:07,932 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796327906_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:07,943 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:07,943 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:07,945 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:07,945 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:07,945 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5/.tez/application_1452796327906_0001/localmode-log-dir
2016-01-14 18:32:07,945 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5/.tez/application_1452796327906_0001/localmode-log-dir/history.txt.appattempt_1452796327906_0001_000000, maxErrors=10
2016-01-14 18:32:07,945 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:07,945 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796327906_0001_000000, appSubmitTime=1452796327931, launchTime=1452796327931
2016-01-14 18:32:07,950 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:59489
2016-01-14 18:32:07,951 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:07,954 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:07,955 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:07,956 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:07,956 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:07,958 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796327906_0001_000000, startTime=1452796327958
2016-01-14 18:32:07,958 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:07,958 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:08,030 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:08,030 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:08,030 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ..._RESULTS.ALL_'field2'_ALL, applicationId=application_1452796327906_0001, dagName=[A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL
2016-01-14 18:32:08,045 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL
2016-01-14 18:32:08,047 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796327906_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5/.tez/application_1452796327906_0001/localmode-log-dir/dag_1452796327906_0001_1.dot
2016-01-14 18:32:08,047 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5/.tez/application_1452796327906_0001/localmode-log-dir/dag_1452796327906_0001_1-tez-dag.pb.txt
2016-01-14 18:32:08,052 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796327906_0001_1
2016-01-14 18:32:08,052 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:08,052 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL
2016-01-14 18:32:08 Running Dag: dag_1452796327906_0001_1
2016-01-14 18:32:08,061 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:08,061 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796327906_0001_1, submitTime=1452796328046
2016-01-14 18:32:08,062 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E5D0667C4C2B403A869DAEDCCBEEFEA0
2016-01-14 18:32:08,062 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:08,062 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:08,062 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796327906_0001_1, initTime=1452796328061
2016-01-14 18:32:08,062 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796327906_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:08,063 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:DAG_STARTED]: dagID=dag_1452796327906_0001_1, startTime=1452796328063
2016-01-14 18:32:08,063 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:08,063 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ..._RESULTS.ALL_'field2'_ALL, applicationId=application_1452796327906_0001, dagName=[A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL
2016-01-14 18:32:08,063 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:08,064 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796327906_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:08,064 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E5D0667C4C2B403A869DAEDCCBEEFEA0 : {1F280D47CC784FCA875BCAC32F636AF9={InputName=1F280D47CC784FCA875BCAC32F636AF9}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:08,064 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 1F280D47CC784FCA875BCAC32F636AF9, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:08,064 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,065 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,065 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,065 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]. Starting root input initializers: 1
2016-01-14 18:32:08,065 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:08,066 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 1F280D47CC784FCA875BCAC32F636AF9 on vertex vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,067 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:08,068 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 1F280D47CC784FCA875BCAC32F636AF9 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:08,068 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:08,068 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:08,069 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:08,070 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 1F280D47CC784FCA875BCAC32F636AF9 on vertex vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,070 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:08,070 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {1F280D47CC784FCA875BCAC32F636AF9=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:08,070 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0] parallelism set to 1
2016-01-14 18:32:08,070 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:08,071 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796327906_0001_1_00, eventCount=1
2016-01-14 18:32:08,071 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,071 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6A29DAB7642E42FFA39C9A986FB2EEFB, vertexId=vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:08,071 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6A29DAB7642E42FFA39C9A986FB2EEFB, vertexId=vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,073 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6A29DAB7642E42FFA39C9A986FB2EEFB, vertexName=E5D0667C4C2B403A869DAEDCCBEEFEA0, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:08,073 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6A29DAB7642E42FFA39C9A986FB2EEFB, vertexId=vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,074 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:08,074 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E5D0667C4C2B403A869DAEDCCBEEFEA0, vertexId=vertex_1452796327906_0001_1_00, initRequestedTime=1452796328064, initedTime=1452796328074, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:08,074 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0] with distanceFromRoot: 0
2016-01-14 18:32:08,074 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:08,074 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E5D0667C4C2B403A869DAEDCCBEEFEA0
2016-01-14 18:32:08,075 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,075 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:08,075 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796327906_0001_1_00, startRequestedTime=1452796328074, startedTime=1452796328074
2016-01-14 18:32:08,075 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:08,076 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:08,076 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:TASK_STARTED]: vertexName=E5D0667C4C2B403A869DAEDCCBEEFEA0, taskId=task_1452796327906_0001_1_00_000000, scheduledTime=1452796328075, launchTime=1452796328075
2016-01-14 18:32:08,076 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796327906_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:08,076 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,077 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL, VertexName: E5D0667C4C2B403A869DAEDCCBEEFEA0, VertexParallelism: 1, TaskAttemptID:attempt_1452796327906_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1F280D47CC784FCA875BCAC32F636AF9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6A29DAB7642E42FFA39C9A986FB2EEFB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:08,077 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796327906_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:08,077 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:08,078 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:08,078 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:08,079 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:08,079 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796327906_0001_00_000001
2016-01-14 18:32:08,079 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327906_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:08,081 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796327906_0001_00_000001
2016-01-14 18:32:08,081 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:08,081 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796327906_0001, with dag id: dag_1452796327906_0001_1
2016-01-14 18:32:08,085 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:08,085 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327906_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:08,086 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796327906_0001_00_000001, launchTime=1452796328085
2016-01-14 18:32:08,087 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796327906_0001_00_000001
2016-01-14 18:32:08,088 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796327906_0001_1_00_000000_0] to container: [container_1452796327906_0001_00_000001]
2016-01-14 18:32:08,088 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327906_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:08,088 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796327906_0001_00_000001 given task: attempt_1452796327906_0001_1_00_000000_0
2016-01-14 18:32:08,089 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796327906_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796327906_0001_1_00_000000_0
2016-01-14 18:32:08,089 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796327906_0001_1_00_000000_0] started. Is using containerId: [container_1452796327906_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:08,089 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E5D0667C4C2B403A869DAEDCCBEEFEA0, taskAttemptId=attempt_1452796327906_0001_1_00_000000_0, startTime=1452796328089, containerId=container_1452796327906_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796327906_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:08 Starting to run new task attempt: attempt_1452796327906_0001_1_00_000000_0
2016-01-14 18:32:08,089 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:08,089 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796327906_0001_1_00_000000_0
2016-01-14 18:32:08,090 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:08,089 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796327906_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:08,090 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:08,090 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:08,090 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796327906_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:08,091 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:08,091 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:08,091 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:08,091 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5] every.every/(1/1) ..._RESULTS.ALL_'field2'_ALL, VertexName: E5D0667C4C2B403A869DAEDCCBEEFEA0, VertexParallelism: 1, TaskAttemptID:attempt_1452796327906_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1F280D47CC784FCA875BCAC32F636AF9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6A29DAB7642E42FFA39C9A986FB2EEFB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:08,092 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:08,093 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796327906_0001_1_00_000000_0
2016-01-14 18:32:08,093 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:08,093 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:08,093 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796327906_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:08,094 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:08,094 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=1F280D47CC784FCA875BCAC32F636AF9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:08,094 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:08,094 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 1F280D47CC784FCA875BCAC32F636AF9
2016-01-14 18:32:08,095 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 1F280D47CC784FCA875BCAC32F636AF9
2016-01-14 18:32:08,097 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:08,103 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:08,103 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 1F280D47CC784FCA875BCAC32F636AF9
2016-01-14 18:32:08,104 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 1F280D47CC784FCA875BCAC32F636AF9
2016-01-14 18:32:08,103 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6A29DAB7642E42FFA39C9A986FB2EEFB, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:08,104 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E5D0667C4C2B403A869DAEDCCBEEFEA0, ordinal: 0
2016-01-14 18:32:08,105 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E5D0667C4C2B403A869DAEDCCBEEFEA0, mem on start (mb), free: 267, total: 389, max: 672
2016-01-14 18:32:08,105 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:08,105 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:08,105 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:08,105 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:08,106 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6A29DAB7642E42FFA39C9A986FB2EEFB
2016-01-14 18:32:08,106 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:08,106 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6A29DAB7642E42FFA39C9A986FB2EEFB
2016-01-14 18:32:08,114 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:08,114 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6A29DAB7642E42FFA39C9A986FB2EEFB
2016-01-14 18:32:08,114 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:08,114 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:08,114 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:08,114 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:08,114 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:08,114 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:08,115 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:08,115 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:08,115 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 1F280D47CC784FCA875BCAC32F636AF9, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:08,115 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6A29DAB7642E42FFA39C9A986FB2EEFB, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:08,115 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:08,115 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 1F280D47CC784FCA875BCAC32F636AF9 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:08,115 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 1F280D47CC784FCA875BCAC32F636AF9
2016-01-14 18:32:08,116 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:08,116 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 1F280D47CC784FCA875BCAC32F636AF9
2016-01-14 18:32:08,116 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:08,117 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:08,118 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:08,118 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796327906_0001_1_00_000000_0
2016-01-14 18:32:08,118 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:08,119 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@67a1d22a
2016-01-14 18:32:08,120 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@67a1d22a
2016-01-14 18:32:08,120 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:08,120 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:08,122 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:08,122 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 1F280D47CC784FCA875BCAC32F636AF9
2016-01-14 18:32:08,122 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_ALL"], id: 6A29DAB7642E42FFA39C9A986FB2EEFB
2016-01-14 18:32:08,123 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_'field2'_ALL"]
2016-01-14 18:32:08,123 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:08,123 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:08,123 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E5D0667C4C2B403A869DAEDCCBEEFEA0, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:08,125 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:08,125 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:08,127 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:08,127 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:08,128 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796327906_0001_1_00_000000_0
2016-01-14 18:32:08,128 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796327906_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:08,129 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796327906_0001_1_00_000000_0
2016-01-14 18:32:08,129 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E5D0667C4C2B403A869DAEDCCBEEFEA0, mem on close (mb), free: 264, total: 389, max: 672
2016-01-14 18:32:08 Completed running task attempt: attempt_1452796327906_0001_1_00_000000_0
2016-01-14 18:32:08,130 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796327906_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:08,130 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796328124, Process_Duration=5, Process_End_Time=1452796328129, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:08,131 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:08,131 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:08,131 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E5D0667C4C2B403A869DAEDCCBEEFEA0, taskAttemptId=attempt_1452796327906_0001_1_00_000000_0, startTime=1452796328089, finishTime=1452796328130, timeTaken=41, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796328124, Process_Duration=5, Process_End_Time=1452796328129, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:08,131 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:08,131 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796327906_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:08,131 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:08,131 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796327906_0001_00_000001
2016-01-14 18:32:08,131 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796327906_0001_1_00_000000_0
2016-01-14 18:32:08,132 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:08,132 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:TASK_FINISHED]: vertexName=E5D0667C4C2B403A869DAEDCCBEEFEA0, taskId=task_1452796327906_0001_1_00_000000, startTime=1452796328089, finishTime=1452796328132, timeTaken=43, status=SUCCEEDED, successfulAttemptID=attempt_1452796327906_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796328124, Process_Duration=5, Process_End_Time=1452796328129, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:08,132 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796327906_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:08,132 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0] : 1
2016-01-14 18:32:08,132 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,133 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:08,133 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:VERTEX_FINISHED]: vertexName=E5D0667C4C2B403A869DAEDCCBEEFEA0, vertexId=vertex_1452796327906_0001_1_00, initRequestedTime=1452796328064, initedTime=1452796328074, startRequestedTime=1452796328074, startedTime=1452796328074, finishTime=1452796328132, timeTaken=58, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796328124, Process_Duration=5, Process_End_Time=1452796328129, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796328089, firstTasksToStart=[ task_1452796327906_0001_1_00_000000 ], lastTaskFinishTime=1452796328130, lastTasksToFinish=[ task_1452796327906_0001_1_00_000000 ], minTaskDuration=41, maxTaskDuration=41, avgTaskDuration=41.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796327906_0001_1_00_000000 ], longestDurationTasks=[ task_1452796327906_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:08,133 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:08,133 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327906_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:08,133 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796327906_0001_00_000001, stoppedTime=1452796328133, exitStatus=0
2016-01-14 18:32:08,133 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:08,134 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327906_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:08,134 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:08,134 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796327906_0001_1
2016-01-14 18:32:08,134 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796327906_0001_1
2016-01-14 18:32:08,134 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 6A29DAB7642E42FFA39C9A986FB2EEFB for vertex: vertex_1452796327906_0001_1_00 [E5D0667C4C2B403A869DAEDCCBEEFEA0]
2016-01-14 18:32:08,136 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796327906_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:08,136 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796327906_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:08,137 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796327906_0001_00_000001, Exiting
2016-01-14 18:32:08,137 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796327906_0001_00_000001
2016-01-14 18:32:08,137 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796327906_0001_00_000001
2016-01-14 18:32:08,138 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796327906_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:08,138 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796327906_0001_00_000001 completed successfully
2016-01-14 18:32:08,142 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796327906_0001_1, queueSize=0
2016-01-14 18:32:08,142 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:08,142 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796327906_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796327906_0001_1, startTime=1452796328063, finishTime=1452796328141, timeTaken=78, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796328124, Process_Duration=5, Process_End_Time=1452796328129, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:08,142 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796327906_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:08,142 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796327906_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:08,142 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796327906_0001_00_000001
2016-01-14 18:32:08,142 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796327906_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:08 Completed Dag: dag_1452796327906_0001_1
2016-01-14 18:32:08,143 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796327906_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:08,143 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796327906_0001_1_post
2016-01-14 18:32:08,143 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:08,143 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:08,148 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ..._RESULTS.ALL_'field2'_ALL, applicationId=application_1452796327906_0001
2016-01-14 18:32:08,150 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:08,150 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:08,150 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:08,150 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:08,150 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:08,150 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:08,151 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:08,152 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:08,152 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:08,152 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:08,152 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:08,153 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:08,153 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:08,156 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/A981332C856C45B28C047810E11CDBE5/A827B6DA311C45949C0098C6DD344FB5/.tez/application_1452796327906_0001
2016-01-14 18:32:08,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.269
2016-01-14 18:32:08,228 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_'field2'_ALL
2016-01-14 18:32:08,250 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:08,251 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:08,282 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.006
2016-01-14 18:32:08,289 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 18:32:08,289 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:08,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:32:08,291 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:32:08,306 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 18:32:08,307 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 18:32:08,316 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 18:32:08,316 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:08,316 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_UNKNOWN_-1"]
2016-01-14 18:32:08,317 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] parallel execution of steps is enabled: false
2016-01-14 18:32:08,317 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executing total steps: 1
2016-01-14 18:32:08,317 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] allocating management threads: 1
2016-01-14 18:32:08,318 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 18:32:08,318 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 18:32:08,331 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 18:32:08,335 INFO client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:08,336 INFO client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 18:32:08,336 INFO client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since 'tez.ignore.lib.uris' is set to true
2016-01-14 18:32:08,344 INFO client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648/.tez/application_1452796328335_0001 doesn't exist and is created
2016-01-14 18:32:08,358 INFO client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 18:32:08,358 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 18:32:08,359 INFO client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648/.tez/application_1452796328335_0001
2016-01-14 18:32:08,360 INFO app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452796328335_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 18:32:08,371 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 18:32:08,371 INFO app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 18:32:08,373 INFO node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 18:32:08,373 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 18:32:08,373 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648/.tez/application_1452796328335_0001/localmode-log-dir
2016-01-14 18:32:08,373 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648/.tez/application_1452796328335_0001/localmode-log-dir/history.txt.appattempt_1452796328335_0001_000000, maxErrors=10
2016-01-14 18:32:08,373 INFO recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 18:32:08,374 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452796328335_0001_000000, appSubmitTime=1452796328360, launchTime=1452796328360
2016-01-14 18:32:08,379 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 18:32:08,380 INFO client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:56820
2016-01-14 18:32:08,381 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 18:32:08,381 INFO recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 18:32:08,382 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 18:32:08,382 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 18:32:08,384 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452796328335_0001_000000, startTime=1452796328384
2016-01-14 18:32:08,384 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 18:32:08,384 INFO app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 18:32:08,459 INFO client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 18:32:08,459 INFO client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 18:32:08,459 INFO client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1, applicationId=application_1452796328335_0001, dagName=[620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 18:32:08,475 INFO app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 18:32:08,476 INFO app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452796328335_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648/.tez/application_1452796328335_0001/localmode-log-dir/dag_1452796328335_0001_1.dot
2016-01-14 18:32:08,476 INFO app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648/.tez/application_1452796328335_0001/localmode-log-dir/dag_1452796328335_0001_1-tez-dag.pb.txt
2016-01-14 18:32:08,480 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796328335_0001_1
2016-01-14 18:32:08,481 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:08,481 INFO app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 18:32:08 Running Dag: dag_1452796328335_0001_1
2016-01-14 18:32:08,490 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 18:32:08,490 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452796328335_0001_1, submitTime=1452796328475
2016-01-14 18:32:08,490 INFO impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C82F050CD01248A9983D3C441FA72C0E
2016-01-14 18:32:08,491 INFO impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 18:32:08,491 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 18:32:08,491 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452796328335_0001_1, initTime=1452796328490
2016-01-14 18:32:08,491 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796328335_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 18:32:08,491 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:DAG_STARTED]: dagID=dag_1452796328335_0001_1, startTime=1452796328491
2016-01-14 18:32:08,492 INFO impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 18:32:08,492 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796328335_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 18:32:08,492 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C82F050CD01248A9983D3C441FA72C0E : {1889A98DF2A4410EBB366448AB137F46={InputName=1889A98DF2A4410EBB366448AB137F46}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 18:32:08,492 INFO impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 1889A98DF2A4410EBB366448AB137F46, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 18:32:08,492 INFO impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,492 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,492 INFO impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,492 INFO impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]. Starting root input initializers: 1
2016-01-14 18:32:08,493 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 18:32:08,493 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 18:32:08,493 INFO client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1, applicationId=application_1452796328335_0001, dagName=[620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 18:32:08,493 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 1889A98DF2A4410EBB366448AB137F46 on vertex vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,498 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 18:32:08,499 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 1889A98DF2A4410EBB366448AB137F46 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 18:32:08,499 INFO common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 18:32:08,499 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 18:32:08,501 INFO hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 18:32:08,501 INFO dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 1889A98DF2A4410EBB366448AB137F46 on vertex vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,502 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:08,502 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {1889A98DF2A4410EBB366448AB137F46=forAllWorkUnits=true, update=[1]}
2016-01-14 18:32:08,502 INFO impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E] parallelism set to 1
2016-01-14 18:32:08,502 INFO impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 18:32:08,502 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452796328335_0001_1_00, eventCount=1
2016-01-14 18:32:08,503 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,503 INFO impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=D264DF146949483B90317B807C696F1E, vertexId=vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 18:32:08,503 INFO impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=D264DF146949483B90317B807C696F1E, vertexId=vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,505 INFO committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=D264DF146949483B90317B807C696F1E, vertexName=C82F050CD01248A9983D3C441FA72C0E, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 18:32:08,505 INFO impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=D264DF146949483B90317B807C696F1E, vertexId=vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,506 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C82F050CD01248A9983D3C441FA72C0E, vertexId=vertex_1452796328335_0001_1_00, initRequestedTime=1452796328492, initedTime=1452796328506, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 18:32:08,507 INFO impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E] with distanceFromRoot: 0
2016-01-14 18:32:08,506 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 18:32:08,507 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 18:32:08,507 INFO impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C82F050CD01248A9983D3C441FA72C0E
2016-01-14 18:32:08,508 INFO impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,508 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452796328335_0001_1_00, startRequestedTime=1452796328507, startedTime=1452796328507
2016-01-14 18:32:08,508 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 18:32:08,508 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E] transitioned from INITED to RUNNING due to event V_START
2016-01-14 18:32:08,510 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 18:32:08,510 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:TASK_STARTED]: vertexName=C82F050CD01248A9983D3C441FA72C0E, taskId=task_1452796328335_0001_1_00_000000, scheduledTime=1452796328510, launchTime=1452796328510
2016-01-14 18:32:08,510 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796328335_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 18:32:08,511 INFO impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,511 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1, VertexName: C82F050CD01248A9983D3C441FA72C0E, VertexParallelism: 1, TaskAttemptID:attempt_1452796328335_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1889A98DF2A4410EBB366448AB137F46, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D264DF146949483B90317B807C696F1E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:08,512 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796328335_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 18:32:08,512 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 18:32:08,513 INFO node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 18:32:08,514 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 18:32:08,514 INFO container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 18:32:08,513 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452796328335_0001, with dag id: dag_1452796328335_0001_1
2016-01-14 18:32:08,514 INFO container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452796328335_0001_00_000001
2016-01-14 18:32:08,514 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796328335_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 18:32:08,516 INFO task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier: null, container_1452796328335_0001_00_000001
2016-01-14 18:32:08,516 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DAGAppMaster metrics system already initialized!
2016-01-14 18:32:08,517 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796328335_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 18:32:08,518 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 18:32:08,518 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452796328335_0001_00_000001, launchTime=1452796328517
2016-01-14 18:32:08,519 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796328335_0001_00_000001
2016-01-14 18:32:08,520 INFO container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452796328335_0001_1_00_000000_0] to container: [container_1452796328335_0001_00_000001]
2016-01-14 18:32:08,520 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796328335_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 18:32:08,521 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452796328335_0001_1_00_000000_0] started. Is using containerId: [container_1452796328335_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 18:32:08,521 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C82F050CD01248A9983D3C441FA72C0E, taskAttemptId=attempt_1452796328335_0001_1_00_000000_0, startTime=1452796328521, containerId=container_1452796328335_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452796328335_0001_00_000001/teamcity, completedLogs=
2016-01-14 18:32:08,521 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796328335_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 18:32:08,522 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796328335_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 18:32:08,522 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 18:32:08,522 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452796328335_0001_00_000001 given task: attempt_1452796328335_0001_1_00_000000_0
2016-01-14 18:32:08,522 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796328335_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452796328335_0001_1_00_000000_0
2016-01-14 18:32:08 Starting to run new task attempt: attempt_1452796328335_0001_1_00_000000_0
2016-01-14 18:32:08,523 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452796328335_0001_1_00_000000_0
2016-01-14 18:32:08,523 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:08,523 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 18:32:08,523 INFO task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 18:32:08,524 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 18:32:08,524 INFO task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 18:32:08,524 INFO metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) - Using ResourceCalculatorProcessTree : [ ]
2016-01-14 18:32:08,524 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648] every.every/(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1, VertexName: C82F050CD01248A9983D3C441FA72C0E, VertexParallelism: 1, TaskAttemptID:attempt_1452796328335_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=1889A98DF2A4410EBB366448AB137F46, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D264DF146949483B90317B807C696F1E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 18:32:08,524 INFO resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 18:32:08,525 INFO task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452796328335_0001_1_00_000000_0
2016-01-14 18:32:08,526 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 18:32:08,526 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:08,526 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=1889A98DF2A4410EBB366448AB137F46, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 18:32:08,528 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 18:32:08,528 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 1889A98DF2A4410EBB366448AB137F46
2016-01-14 18:32:08,528 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 1889A98DF2A4410EBB366448AB137F46
2016-01-14 18:32:08,529 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:08,529 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=D264DF146949483B90317B807C696F1E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 18:32:08,529 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 18:32:08,529 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: D264DF146949483B90317B807C696F1E
2016-01-14 18:32:08,530 INFO output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 18:32:08,530 INFO resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: D264DF146949483B90317B807C696F1E
2016-01-14 18:32:08,531 INFO impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452796328335_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 18:32:08,533 INFO tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 18:32:08,536 INFO input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 18:32:08,538 INFO input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 1889A98DF2A4410EBB366448AB137F46
2016-01-14 18:32:08,538 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 1889A98DF2A4410EBB366448AB137F46
2016-01-14 18:32:08,545 INFO tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C82F050CD01248A9983D3C441FA72C0E, ordinal: 0
2016-01-14 18:32:08,545 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C82F050CD01248A9983D3C441FA72C0E, mem on start (mb), free: 174, total: 389, max: 672
2016-01-14 18:32:08,545 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 18:32:08,545 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 18:32:08,545 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 18:32:08,547 INFO output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 18:32:08,547 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: D264DF146949483B90317B807C696F1E
2016-01-14 18:32:08,548 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 18:32:08,548 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 18:32:08,548 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 18:32:08,548 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:08,548 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 18:32:08,548 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 18:32:08,548 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 18:32:08,549 INFO resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 18:32:08,549 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 1889A98DF2A4410EBB366448AB137F46, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 18:32:08,549 INFO resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, D264DF146949483B90317B807C696F1E, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 18:32:08,549 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 18:32:08,549 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 1889A98DF2A4410EBB366448AB137F46 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 18:32:08,549 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 1889A98DF2A4410EBB366448AB137F46
2016-01-14 18:32:08,549 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:08,549 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 1889A98DF2A4410EBB366448AB137F46
2016-01-14 18:32:08,549 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 18:32:08,550 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 18:32:08,550 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 18:32:08,550 INFO task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452796328335_0001_1_00_000000_0
2016-01-14 18:32:08,552 INFO input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 18:32:08,553 INFO input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@476c9595
2016-01-14 18:32:08,554 INFO graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:08,554 INFO lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@476c9595
2016-01-14 18:32:08,555 INFO input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 18:32:08,555 INFO input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 18:32:08,555 INFO tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 1889A98DF2A4410EBB366448AB137F46
2016-01-14 18:32:08,555 INFO tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_UNKNOWN_-1"], id: D264DF146949483B90317B807C696F1E
2016-01-14 18:32:08,556 INFO element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.ALL_UNKNOWN_-1"]
2016-01-14 18:32:08,556 INFO element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 18:32:08,556 INFO input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 18:32:08,556 INFO tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C82F050CD01248A9983D3C441FA72C0E, all 1 inputs ready in: 00:00:00.000
2016-01-14 18:32:08,559 INFO output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 18:32:08,560 INFO output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 18:32:08,560 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452796328335_0001_1_00_000000_0
2016-01-14 18:32:08,560 INFO impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452796328335_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 18:32:08,561 INFO task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452796328335_0001_1_00_000000_0
2016-01-14 18:32:08,561 INFO tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C82F050CD01248A9983D3C441FA72C0E, mem on close (mb), free: 172, total: 389, max: 672
2016-01-14 18:32:08 Completed running task attempt: attempt_1452796328335_0001_1_00_000000_0
2016-01-14 18:32:08,562 INFO task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452796328335_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 18:32:08,563 INFO runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452796328556, Process_Duration=5, Process_End_Time=1452796328561, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 18:32:08,563 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C82F050CD01248A9983D3C441FA72C0E, taskAttemptId=attempt_1452796328335_0001_1_00_000000_0, startTime=1452796328521, finishTime=1452796328563, timeTaken=42, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796328556, Process_Duration=5, Process_End_Time=1452796328561, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:08,564 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend:
2016-01-14 18:32:08,564 INFO impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452796328335_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 18:32:08,563 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 18:32:08,564 INFO impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452796328335_0001_1_00_000000_0
2016-01-14 18:32:08,565 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 18:32:08,565 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:TASK_FINISHED]: vertexName=C82F050CD01248A9983D3C441FA72C0E, taskId=task_1452796328335_0001_1_00_000000, startTime=1452796328521, finishTime=1452796328564, timeTaken=43, status=SUCCEEDED, successfulAttemptID=attempt_1452796328335_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796328556, Process_Duration=5, Process_End_Time=1452796328561, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:08,566 INFO impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452796328335_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 18:32:08,566 INFO impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E] : 1
2016-01-14 18:32:08,566 INFO impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,567 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:VERTEX_FINISHED]: vertexName=C82F050CD01248A9983D3C441FA72C0E, vertexId=vertex_1452796328335_0001_1_00, initRequestedTime=1452796328492, initedTime=1452796328506, startRequestedTime=1452796328507, startedTime=1452796328507, finishTime=1452796328566, timeTaken=59, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796328556, Process_Duration=5, Process_End_Time=1452796328561, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452796328521, firstTasksToStart=[ task_1452796328335_0001_1_00_000000 ], lastTaskFinishTime=1452796328563, lastTasksToFinish=[ task_1452796328335_0001_1_00_000000 ], minTaskDuration=42, maxTaskDuration=42, avgTaskDuration=42.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452796328335_0001_1_00_000000 ], longestDurationTasks=[ task_1452796328335_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 18:32:08,567 INFO impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 18:32:08,567 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796328335_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 18:32:08,567 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452796328335_0001_00_000001, stoppedTime=1452796328567, exitStatus=0
2016-01-14 18:32:08,567 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796328335_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 18:32:08,567 INFO impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 18:32:08,567 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452796328335_0001_1
2016-01-14 18:32:08,568 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452796328335_0001_1
2016-01-14 18:32:08,568 INFO impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: D264DF146949483B90317B807C696F1E for vertex: vertex_1452796328335_0001_1_00 [C82F050CD01248A9983D3C441FA72C0E]
2016-01-14 18:32:08,569 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:08,565 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 18:32:08,569 INFO task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452796328335_0001_00_000001
2016-01-14 18:32:08,569 INFO app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452796328335_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 18:32:08,569 INFO task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452796328335_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 18:32:08,569 INFO task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452796328335_0001_00_000001, Exiting
2016-01-14 18:32:08,569 INFO task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452796328335_0001_00_000001
2016-01-14 18:32:08,569 INFO task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452796328335_0001_00_000001
2016-01-14 18:32:08,569 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 18:32:08,570 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 18:32:08,571 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452796328335_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 18:32:08,572 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452796328335_0001_00_000001 completed successfully
2016-01-14 18:32:08,576 INFO recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452796328335_0001_1, queueSize=0
2016-01-14 18:32:08,576 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 18:32:08,576 INFO history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452796328335_0001_1][Event:DAG_FINISHED]: dagId=dag_1452796328335_0001_1, startTime=1452796328491, finishTime=1452796328575, timeTaken=84, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=408420352, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452796328556, Process_Duration=5, Process_End_Time=1452796328561, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 18:32:08,577 INFO impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452796328335_0001_1 finished with state: SUCCEEDED
2016-01-14 18:32:08,577 INFO impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452796328335_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 18:32:08,577 INFO launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452796328335_0001_00_000001
2016-01-14 18:32:08,577 INFO container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452796328335_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 18:32:08 Completed Dag: dag_1452796328335_0001_1
2016-01-14 18:32:08,578 INFO app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452796328335_0001_1, dagState=SUCCEEDED
2016-01-14 18:32:08,578 INFO common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452796328335_0001_1_post
2016-01-14 18:32:08,578 WARN common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 18:32:08,579 INFO app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 18:32:08,584 INFO client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.ALL_UNKNOWN_-1, applicationId=application_1452796328335_0001
2016-01-14 18:32:08,585 INFO client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 18:32:08,586 INFO rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 18:32:08,586 INFO app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 18:32:08,586 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 18:32:08,586 INFO app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 18:32:08,588 INFO app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 18:32:08,588 INFO history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 18:32:08,588 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 18:32:08,588 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 18:32:08,589 INFO recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 18:32:08,589 INFO recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 18:32:08,589 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 18:32:08,590 INFO impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 18:32:08,594 INFO app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/tmp/.staging/620DC4779E2B4748AD34CD8BFDAAA35A/C547D80337FD4525BC64FE130C317648/.tez/application_1452796328335_0001
2016-01-14 18:32:08,595 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] completed in: 00:00.279
2016-01-14 18:32:08,604 INFO app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 18:32:08,604 INFO app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 18:32:08,673 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_UNKNOWN_-1
2016-01-14 18:32:08,696 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:32:08,696 INFO planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 18:32:08,723 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.003
2016-01-14 18:32:08,725 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.005
2016-01-14 18:32:08,725 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:08,725 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 18:32:08,725 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.6.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.ALL_UNKNOWN_'field2'