Class cascading.detail.EveryEveryPipeAssemblyPlatformTest

40

tests

0

failures

0

ignored

18.256s

duration

100%

successful

Tests

Test Duration Result
-1_'field'_RESULTS.-1_'field2'_'field'[hadoop2-tez] 0.665s passed
-1_'field'_RESULTS.-1_'field2'_'field2'[hadoop2-tez] 0.721s passed
-1_'field'_RESULTS.-1_'field2'_-1[hadoop2-tez] 3.520s passed
-1_'field'_RESULTS.-1_'field2'_ALL[hadoop2-tez] 0.555s passed
-1_'field'_RESULTS.-1_'field2'_RESULTS[hadoop2-tez] 0.542s passed
-1_'field'_RESULTS.-1_ARGS_'field2'[hadoop2-tez] 0.062s passed
-1_'field'_RESULTS.-1_ARGS_ALL[hadoop2-tez] 0.056s passed
-1_'field'_RESULTS.-1_ARGS_RESULTS[hadoop2-tez] 0.477s passed
-1_'field'_RESULTS.-1_UNKNOWN_'field'[hadoop2-tez] 0.578s passed
-1_'field'_RESULTS.-1_UNKNOWN_'field2'[hadoop2-tez] 0.090s passed
-1_'field'_RESULTS.-1_UNKNOWN_-1[hadoop2-tez] 0.660s passed
-1_'field'_RESULTS.-1_UNKNOWN_ALL[hadoop2-tez] 0.527s passed
-1_'field'_RESULTS.-1_UNKNOWN_RESULTS[hadoop2-tez] 0.523s passed
-1_'field'_RESULTS.-1_VALUES_'field2'[hadoop2-tez] 0.071s passed
-1_'field'_RESULTS.-1_VALUES_-1[hadoop2-tez] 0.414s passed
-1_'field'_RESULTS.-1_VALUES_ALL[hadoop2-tez] 0.440s passed
-1_'field'_RESULTS.-1_VALUES_RESULTS[hadoop2-tez] 0.428s passed
-1_'field'_RESULTS.0_'field2'_'field2'[hadoop2-tez] 0.453s passed
-1_'field'_RESULTS.0_'field2'_-1[hadoop2-tez] 0.460s passed
-1_'field'_RESULTS.0_'field2'_ALL[hadoop2-tez] 0.448s passed
-1_'field'_RESULTS.0_'field2'_RESULTS[hadoop2-tez] 0.463s passed
-1_'field'_RESULTS.0_ARGS_'field2'[hadoop2-tez] 0.049s passed
-1_'field'_RESULTS.0_ARGS_-1[hadoop2-tez] 0.404s passed
-1_'field'_RESULTS.0_ARGS_ALL[hadoop2-tez] 0.049s passed
-1_'field'_RESULTS.0_ARGS_RESULTS[hadoop2-tez] 0.461s passed
-1_'field'_RESULTS.0_UNKNOWN_'field2'[hadoop2-tez] 0.051s passed
-1_'field'_RESULTS.0_UNKNOWN_-1[hadoop2-tez] 0.487s passed
-1_'field'_RESULTS.0_UNKNOWN_ALL[hadoop2-tez] 0.439s passed
-1_'field'_RESULTS.0_UNKNOWN_RESULTS[hadoop2-tez] 0.428s passed
-1_'field'_RESULTS.0_VALUES_'field2'[hadoop2-tez] 0.073s passed
-1_'field'_RESULTS.0_VALUES_-1[hadoop2-tez] 0.358s passed
-1_'field'_RESULTS.0_VALUES_ALL[hadoop2-tez] 0.366s passed
-1_'field'_RESULTS.0_VALUES_RESULTS[hadoop2-tez] 0.415s passed
-1_'field'_RESULTS.ALL_'field2'_'field'[hadoop2-tez] 0.420s passed
-1_'field'_RESULTS.ALL_'field2'_'field2'[hadoop2-tez] 0.401s passed
-1_'field'_RESULTS.ALL_'field2'_-1[hadoop2-tez] 0.409s passed
-1_'field'_RESULTS.ALL_'field2'_ALL[hadoop2-tez] 0.417s passed
-1_'field'_RESULTS.ALL_'field2'_RESULTS[hadoop2-tez] 0.411s passed
-1_'field'_RESULTS.ALL_UNKNOWN_'field2'[hadoop2-tez] 0.045s passed
-1_'field'_RESULTS.ALL_UNKNOWN_-1[hadoop2-tez] 0.420s passed

Standard output

2016-01-14 16:08:14,983 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 16:08:15,005 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.detail.EveryEveryPipeAssemblyPlatformTest, with platform: hadoop2-tez
2016-01-14 16:08:15,486 INFO  tez.Hadoop2TezPlatform (Hadoop2TezPlatform.java:setUp(136)) - not using cluster
2016-01-14 16:08:15,838 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 16:08:16,170 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-14 16:08:16,356 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:16,358 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:16,483 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 3DAC785768B9442DB1D9F42F5E5329C9
2016-01-14 16:08:16,666 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.062
2016-01-14 16:08:16,678 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.074
2016-01-14 16:08:16,679 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:16,679 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:16,681 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:16,827 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:16,830 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:17,037 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 16:08:17,040 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:17,040 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:17,041 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"]
2016-01-14 16:08:17,041 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:17,041 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:17,042 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:17,043 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:17,043 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:17,071 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:17,232 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:17,238 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:17,238 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:17,284 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001 doesn't exist and is created
2016-01-14 16:08:17,350 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:17,350 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:17,351 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001
2016-01-14 16:08:17,383 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787697237_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:17,428 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:17,443 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:17,451 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: NEW
2016-01-14 16:08:17,451 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(238)) - DAGAppMaster is not started wait for 100ms...
2016-01-14 16:08:17,451 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:17,468 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:17,472 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:17,476 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001/localmode-log-dir
2016-01-14 16:08:17,476 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001/localmode-log-dir/history.txt.appattempt_1452787697237_0001_000000, maxErrors=10
2016-01-14 16:08:17,476 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:17,479 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787697237_0001_000000, appSubmitTime=1452787697369, launchTime=1452787697381
2016-01-14 16:08:17,484 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:17,485 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:17,489 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:17,489 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:17,547 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:33229
2016-01-14 16:08:17,552 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 16:08:17,552 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 16:08:17,552 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:17,590 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:17,652 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: INITED
2016-01-14 16:08:17,653 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(240)) - DAGAppMaster is not startetd wait for 100ms...
2016-01-14 16:08:17,653 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:17,664 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:17,664 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787697237_0001_000000, startTime=1452787697663
2016-01-14 16:08:17,665 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:17,753 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:17,771 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:17,772 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452787697237_0001, dagName=[130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:18,013 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:18,106 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787697237_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001/localmode-log-dir/dag_1452787697237_0001_1.dot
2016-01-14 16:08:18,108 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001/localmode-log-dir/dag_1452787697237_0001_1-tez-dag.pb.txt
2016-01-14 16:08:18,187 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787697237_0001_1
2016-01-14 16:08:18,187 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:18,187 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:18 Running Dag: dag_1452787697237_0001_1
2016-01-14 16:08:18,231 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:18,235 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787697237_0001_1, submitTime=1452787698014
2016-01-14 16:08:18,265 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex A22A3F022D8B47BC885BA516B3D54236
2016-01-14 16:08:18,267 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:18,270 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:18,273 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787697237_0001_1, initTime=1452787698236
2016-01-14 16:08:18,274 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787697237_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:18,275 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:DAG_STARTED]: dagID=dag_1452787697237_0001_1, startTime=1452787698275
2016-01-14 16:08:18,276 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:18,276 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:18,277 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787697237_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:18,278 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: A22A3F022D8B47BC885BA516B3D54236 : {DFACFE4CBED44F3999344566A27E20E0={InputName=DFACFE4CBED44F3999344566A27E20E0}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:18,279 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: DFACFE4CBED44F3999344566A27E20E0, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:18,280 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,288 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,288 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,290 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452787697237_0001, dagName=[130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:18,291 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]. Starting root input initializers: 1
2016-01-14 16:08:18,305 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: DFACFE4CBED44F3999344566A27E20E0 on vertex vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,313 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:18,328 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:18,330 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input DFACFE4CBED44F3999344566A27E20E0 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:18,331 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:18,332 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:18,333 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787697237_0001, with dag id: dag_1452787697237_0001_1
2016-01-14 16:08:18,386 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:18,389 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: DFACFE4CBED44F3999344566A27E20E0 on vertex vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,391 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:18,391 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {DFACFE4CBED44F3999344566A27E20E0=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:18,410 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] parallelism set to 1
2016-01-14 16:08:18,411 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:18,422 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787697237_0001_1_00, eventCount=1
2016-01-14 16:08:18,424 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,424 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=CEE1E11A10F847828338500899E40E2A, vertexId=vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:18,428 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=CEE1E11A10F847828338500899E40E2A, vertexId=vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,445 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=CEE1E11A10F847828338500899E40E2A, vertexName=A22A3F022D8B47BC885BA516B3D54236, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:18,455 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=CEE1E11A10F847828338500899E40E2A, vertexId=vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,457 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:18,457 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:VERTEX_INITIALIZED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, vertexId=vertex_1452787697237_0001_1_00, initRequestedTime=1452787698277, initedTime=1452787698457, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:18,458 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] with distanceFromRoot: 0
2016-01-14 16:08:18,458 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:18,460 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in A22A3F022D8B47BC885BA516B3D54236
2016-01-14 16:08:18,460 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,462 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:18,462 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787697237_0001_1_00, startRequestedTime=1452787698459, startedTime=1452787698459
2016-01-14 16:08:18,463 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:18,484 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:18,485 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:TASK_STARTED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, taskId=task_1452787697237_0001_1_00_000000, scheduledTime=1452787698484, launchTime=1452787698484
2016-01-14 16:08:18,485 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787697237_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:18,488 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,491 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1, VertexName: A22A3F022D8B47BC885BA516B3D54236, VertexParallelism: 1, TaskAttemptID:attempt_1452787697237_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=DFACFE4CBED44F3999344566A27E20E0, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CEE1E11A10F847828338500899E40E2A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:18,493 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787697237_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:18,493 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:18,546 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:18,549 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:18,549 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:18,555 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787697237_0001_00_000001
2016-01-14 16:08:18,555 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:18,567 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787697237_0001_00_000001
2016-01-14 16:08:18,568 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:18,572 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:18,573 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:18,574 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787697237_0001_00_000001, launchTime=1452787698573
2016-01-14 16:08:18,578 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787697237_0001_00_000001
2016-01-14 16:08:18,582 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787697237_0001_1_00_000000_0] to container: [container_1452787697237_0001_00_000001]
2016-01-14 16:08:18,582 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:18,583 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787697237_0001_00_000001 given task: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,583 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787697237_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18 Starting to run new task attempt: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,585 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,585 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:18,585 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787697237_0001_1_00_000000_0] started. Is using containerId: [container_1452787697237_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:18,587 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0, startTime=1452787698583, containerId=container_1452787697237_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787697237_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:18,587 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:18,587 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:18,588 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:18,589 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:18,590 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787697237_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:18,592 INFO  counters.Limits (Limits.java:ensureInitialized(59)) - Counter limits initialized with parameters:  GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2016-01-14 16:08:18,593 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:18,599 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787697237_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:18,617 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:18,618 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8] every.every/(1/1) ...d'_RESULTS.-1_'field2'_-1, VertexName: A22A3F022D8B47BC885BA516B3D54236, VertexParallelism: 1, TaskAttemptID:attempt_1452787697237_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=DFACFE4CBED44F3999344566A27E20E0, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=CEE1E11A10F847828338500899E40E2A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:18,620 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:18,624 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,626 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:18,627 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:18,629 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787697237_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:18,631 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=DFACFE4CBED44F3999344566A27E20E0, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:18,632 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:18,633 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=CEE1E11A10F847828338500899E40E2A, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:18,633 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:18,634 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:18,634 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,634 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: CEE1E11A10F847828338500899E40E2A
2016-01-14 16:08:18,635 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:18,640 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,640 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: CEE1E11A10F847828338500899E40E2A
2016-01-14 16:08:18,657 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:18,658 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,658 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,664 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:18,683 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:18,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: CEE1E11A10F847828338500899E40E2A
2016-01-14 16:08:18,687 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: A22A3F022D8B47BC885BA516B3D54236, ordinal: 0
2016-01-14 16:08:18,688 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A22A3F022D8B47BC885BA516B3D54236, mem on start (mb), free: 218, total: 281, max: 672
2016-01-14 16:08:18,688 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:18,688 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:18,688 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:18,689 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:18,689 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:18,695 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:18,696 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:18,696 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:18,696 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:18,697 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:18,697 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:18,698 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, DFACFE4CBED44F3999344566A27E20E0, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:18,698 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, CEE1E11A10F847828338500899E40E2A, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:18,698 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:18,699 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: DFACFE4CBED44F3999344566A27E20E0 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:18,699 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,700 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:18,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:18,701 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:18,701 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:18,702 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,704 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:18,712 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4c838c64
2016-01-14 16:08:18,723 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4c838c64
2016-01-14 16:08:18,724 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:18,724 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:18,741 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:18,764 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: DFACFE4CBED44F3999344566A27E20E0
2016-01-14 16:08:18,764 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"], id: CEE1E11A10F847828338500899E40E2A
2016-01-14 16:08:18,765 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_-1"]
2016-01-14 16:08:18,767 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:18,767 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:18,771 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: A22A3F022D8B47BC885BA516B3D54236, all 1 inputs ready in: 00:00:00.003
2016-01-14 16:08:18,779 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:18,780 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:18,780 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,781 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787697237_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:18,782 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,782 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: A22A3F022D8B47BC885BA516B3D54236, mem on close (mb), free: 211, total: 281, max: 672
2016-01-14 16:08:18 Completed running task attempt: attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,789 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:18,793 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787698771, Process_Duration=11, Process_End_Time=1452787698782, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:18,793 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:18,794 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:18,795 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:18,795 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787697237_0001_00_000001
2016-01-14 16:08:18,798 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, taskAttemptId=attempt_1452787697237_0001_1_00_000000_0, startTime=1452787698583, finishTime=1452787698790, timeTaken=207, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787698771, Process_Duration=11, Process_End_Time=1452787698782, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:18,799 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787697237_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:18,799 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:18,804 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787697237_0001_1_00_000000_0
2016-01-14 16:08:18,806 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:18,808 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:TASK_FINISHED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, taskId=task_1452787697237_0001_1_00_000000, startTime=1452787698583, finishTime=1452787698805, timeTaken=222, status=SUCCEEDED, successfulAttemptID=attempt_1452787697237_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787698771, Process_Duration=11, Process_End_Time=1452787698782, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:18,812 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787697237_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:18,812 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:18,813 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:18,815 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787697237_0001_00_000001, stoppedTime=1452787698813, exitStatus=0
2016-01-14 16:08:18,816 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:18,816 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] : 1
2016-01-14 16:08:18,817 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,822 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:18,826 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:VERTEX_FINISHED]: vertexName=A22A3F022D8B47BC885BA516B3D54236, vertexId=vertex_1452787697237_0001_1_00, initRequestedTime=1452787698277, initedTime=1452787698457, startRequestedTime=1452787698459, startedTime=1452787698459, finishTime=1452787698817, timeTaken=358, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787698771, Process_Duration=11, Process_End_Time=1452787698782, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787698583, firstTasksToStart=[ task_1452787697237_0001_1_00_000000 ], lastTaskFinishTime=1452787698790, lastTasksToFinish=[ task_1452787697237_0001_1_00_000000 ], minTaskDuration=207, maxTaskDuration=207, avgTaskDuration=207.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787697237_0001_1_00_000000 ], longestDurationTasks=[ task_1452787697237_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:18,827 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:18,827 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:18,828 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787697237_0001_1
2016-01-14 16:08:18,828 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(244)) - Ignoring stop request for containerId container_1452787697237_0001_00_000001. Relying on regular task shutdown for it to end
2016-01-14 16:08:18,830 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787697237_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:18,830 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787697237_0001_00_000001: 35 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:18,830 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787697237_0001_00_000001, Exiting
2016-01-14 16:08:18,830 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787697237_0001_00_000001
2016-01-14 16:08:18,830 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787697237_0001_00_000001
2016-01-14 16:08:18,833 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787697237_0001_1
2016-01-14 16:08:18,833 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: CEE1E11A10F847828338500899E40E2A for vertex: vertex_1452787697237_0001_1_00 [A22A3F022D8B47BC885BA516B3D54236]
2016-01-14 16:08:18,839 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787697237_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:18,840 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787697237_0001_00_000001 completed successfully
2016-01-14 16:08:18,854 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787697237_0001_1, queueSize=0
2016-01-14 16:08:18,854 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:18,855 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787697237_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787697237_0001_1, startTime=1452787698275, finishTime=1452787698848, timeTaken=573, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787698771, Process_Duration=11, Process_End_Time=1452787698782, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:18,858 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787697237_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:18,858 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787697237_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:18,858 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:18,859 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787697237_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:18 Completed Dag: dag_1452787697237_0001_1
2016-01-14 16:08:18,860 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787697237_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:18,860 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787697237_0001_1_post
2016-01-14 16:08:18,861 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:18,861 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:18,870 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.-1_'field2'_-1, applicationId=application_1452787697237_0001
2016-01-14 16:08:18,874 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:18,874 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:18,874 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:18,874 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:18,874 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:18,875 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:18,878 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:18,878 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:18,878 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:18,878 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:18,878 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:18,879 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:18,879 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:18,885 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/130F3144022849A6A31EF194E94539F3/DBF32D7827B94EDA91F389E1499A08B8/.tez/application_1452787697237_0001
2016-01-14 16:08:18,887 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:01.846
2016-01-14 16:08:19,004 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_-1
2016-01-14 16:08:19,045 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:19,046 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:19,119 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 16:08:19,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.045
2016-01-14 16:08:19,141 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:19,141 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:19,142 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:19,165 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:19,167 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,204 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:19,204 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:19,204 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"]
2016-01-14 16:08:19,205 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:19,205 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:19,206 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:19,207 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,207 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:19,231 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:19,237 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:19,237 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:19,237 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:19,248 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001 doesn't exist and is created
2016-01-14 16:08:19,274 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:19,274 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:19,275 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001
2016-01-14 16:08:19,279 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787699237_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:19,298 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:19,299 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:19,301 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:19,302 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:19,302 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001/localmode-log-dir
2016-01-14 16:08:19,302 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001/localmode-log-dir/history.txt.appattempt_1452787699237_0001_000000, maxErrors=10
2016-01-14 16:08:19,303 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:19,303 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787699237_0001_000000, appSubmitTime=1452787699278, launchTime=1452787699279
2016-01-14 16:08:19,311 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:19,340 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:35139
2016-01-14 16:08:19,341 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:19,343 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:19,345 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:19,349 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:19,354 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787699237_0001_000000, startTime=1452787699354
2016-01-14 16:08:19,354 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:19,354 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:19,374 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:19,374 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:19,375 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452787699237_0001, dagName=[3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,410 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,415 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787699237_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001/localmode-log-dir/dag_1452787699237_0001_1.dot
2016-01-14 16:08:19,417 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001/localmode-log-dir/dag_1452787699237_0001_1-tez-dag.pb.txt
2016-01-14 16:08:19,447 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787699237_0001_1
2016-01-14 16:08:19,447 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:19,448 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:19 Running Dag: dag_1452787699237_0001_1
2016-01-14 16:08:19,463 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:19,463 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787699237_0001_1, submitTime=1452787699411
2016-01-14 16:08:19,465 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D113F7F2069D4DC79D81AC459805D0DB
2016-01-14 16:08:19,465 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:19,466 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787699237_0001_1, initTime=1452787699463
2016-01-14 16:08:19,466 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:19,467 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699237_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:19,468 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:DAG_STARTED]: dagID=dag_1452787699237_0001_1, startTime=1452787699468
2016-01-14 16:08:19,469 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:19,469 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452787699237_0001, dagName=[3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,469 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:19,469 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699237_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:19,469 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D113F7F2069D4DC79D81AC459805D0DB : {B0CAEB56B69345B1AC818B8CB3306D74={InputName=B0CAEB56B69345B1AC818B8CB3306D74}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:19,470 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: B0CAEB56B69345B1AC818B8CB3306D74, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:19,470 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,470 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,470 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,470 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]. Starting root input initializers: 1
2016-01-14 16:08:19,472 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:19,472 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: B0CAEB56B69345B1AC818B8CB3306D74 on vertex vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,477 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:19,478 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input B0CAEB56B69345B1AC818B8CB3306D74 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:19,479 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:19,480 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:19,482 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:19,483 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: B0CAEB56B69345B1AC818B8CB3306D74 on vertex vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,483 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:19,483 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {B0CAEB56B69345B1AC818B8CB3306D74=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:19,484 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] parallelism set to 1
2016-01-14 16:08:19,484 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:19,484 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787699237_0001_1_00, eventCount=1
2016-01-14 16:08:19,484 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,485 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=FA50B415C695449F886C68138175778F, vertexId=vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:19,485 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=FA50B415C695449F886C68138175778F, vertexId=vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,491 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=FA50B415C695449F886C68138175778F, vertexName=D113F7F2069D4DC79D81AC459805D0DB, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:19,492 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=FA50B415C695449F886C68138175778F, vertexId=vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,493 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:19,493 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, vertexId=vertex_1452787699237_0001_1_00, initRequestedTime=1452787699469, initedTime=1452787699493, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:19,494 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] with distanceFromRoot: 0
2016-01-14 16:08:19,494 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:19,494 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D113F7F2069D4DC79D81AC459805D0DB
2016-01-14 16:08:19,495 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,496 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:19,496 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787699237_0001_1_00, startRequestedTime=1452787699494, startedTime=1452787699494
2016-01-14 16:08:19,496 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:19,497 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:19,497 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:TASK_STARTED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, taskId=task_1452787699237_0001_1_00_000000, scheduledTime=1452787699497, launchTime=1452787699497
2016-01-14 16:08:19,498 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699237_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:19,498 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,499 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787699237_0001, with dag id: dag_1452787699237_0001_1
2016-01-14 16:08:19,500 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2', VertexName: D113F7F2069D4DC79D81AC459805D0DB, VertexParallelism: 1, TaskAttemptID:attempt_1452787699237_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B0CAEB56B69345B1AC818B8CB3306D74, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=FA50B415C695449F886C68138175778F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:19,500 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699237_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:19,501 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:19,501 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:19,502 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:19,503 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:19,503 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787699237_0001_00_000001
2016-01-14 16:08:19,504 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:19,507 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787699237_0001_00_000001
2016-01-14 16:08:19,508 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:19,509 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:19,509 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:19,511 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787699237_0001_00_000001, launchTime=1452787699509
2016-01-14 16:08:19,511 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787699237_0001_00_000001
2016-01-14 16:08:19,512 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787699237_0001_1_00_000000_0] to container: [container_1452787699237_0001_00_000001]
2016-01-14 16:08:19,513 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:19,514 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787699237_0001_1_00_000000_0] started. Is using containerId: [container_1452787699237_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:19,514 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0, startTime=1452787699513, containerId=container_1452787699237_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787699237_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:19,514 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699237_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:19,514 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:19,514 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699237_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:19,515 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787699237_0001_00_000001 given task: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,515 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787699237_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19 Starting to run new task attempt: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,516 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,516 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:19,516 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:19,516 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:19,516 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:19,516 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:19,517 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:19,517 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70] every.every/(1/1) ...ULTS.-1_'field2'_'field2', VertexName: D113F7F2069D4DC79D81AC459805D0DB, VertexParallelism: 1, TaskAttemptID:attempt_1452787699237_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=B0CAEB56B69345B1AC818B8CB3306D74, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=FA50B415C695449F886C68138175778F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:19,517 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:19,518 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,518 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:19,521 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:19,521 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787699237_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:19,523 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:19,523 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=B0CAEB56B69345B1AC818B8CB3306D74, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:19,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:19,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,524 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,523 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=FA50B415C695449F886C68138175778F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:19,529 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:19,531 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:19,536 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,537 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,531 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:19,539 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: FA50B415C695449F886C68138175778F
2016-01-14 16:08:19,539 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:19,539 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: FA50B415C695449F886C68138175778F
2016-01-14 16:08:19,554 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D113F7F2069D4DC79D81AC459805D0DB, ordinal: 0
2016-01-14 16:08:19,554 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:19,554 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: FA50B415C695449F886C68138175778F
2016-01-14 16:08:19,554 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D113F7F2069D4DC79D81AC459805D0DB, mem on start (mb), free: 236, total: 281, max: 672
2016-01-14 16:08:19,555 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:19,556 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:19,556 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:19,556 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:19,558 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:19,558 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:19,558 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:19,558 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:19,558 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:19,559 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:19,559 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:19,559 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, B0CAEB56B69345B1AC818B8CB3306D74, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:19,559 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, FA50B415C695449F886C68138175778F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:19,559 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:19,560 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,560 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:19,560 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,560 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: B0CAEB56B69345B1AC818B8CB3306D74 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:19,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:19,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:19,561 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:19,561 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,570 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:19,572 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@64763385
2016-01-14 16:08:19,574 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@64763385
2016-01-14 16:08:19,574 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:19,575 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:19,575 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:19,576 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: B0CAEB56B69345B1AC818B8CB3306D74
2016-01-14 16:08:19,576 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"], id: FA50B415C695449F886C68138175778F
2016-01-14 16:08:19,577 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field2'"]
2016-01-14 16:08:19,577 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:19,577 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:19,577 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D113F7F2069D4DC79D81AC459805D0DB, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:19,582 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:19,582 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:19,583 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,583 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787699237_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:19,584 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,584 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D113F7F2069D4DC79D81AC459805D0DB, mem on close (mb), free: 234, total: 281, max: 672
2016-01-14 16:08:19 Completed running task attempt: attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,586 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:19,588 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:19,589 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, taskAttemptId=attempt_1452787699237_0001_1_00_000000_0, startTime=1452787699513, finishTime=1452787699587, timeTaken=74, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787699578, Process_Duration=6, Process_End_Time=1452787699584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:19,589 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787699578, Process_Duration=6, Process_End_Time=1452787699584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:19,589 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699237_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:19,589 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:19,589 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:19,590 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787699237_0001_1_00_000000_0
2016-01-14 16:08:19,590 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:19,590 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:19,591 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787699237_0001_00_000001
2016-01-14 16:08:19,591 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:TASK_FINISHED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, taskId=task_1452787699237_0001_1_00_000000, startTime=1452787699513, finishTime=1452787699590, timeTaken=77, status=SUCCEEDED, successfulAttemptID=attempt_1452787699237_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787699578, Process_Duration=6, Process_End_Time=1452787699584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:19,592 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699237_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:19,592 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] : 1
2016-01-14 16:08:19,592 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,593 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:19,594 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:VERTEX_FINISHED]: vertexName=D113F7F2069D4DC79D81AC459805D0DB, vertexId=vertex_1452787699237_0001_1_00, initRequestedTime=1452787699469, initedTime=1452787699493, startRequestedTime=1452787699494, startedTime=1452787699494, finishTime=1452787699592, timeTaken=98, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787699578, Process_Duration=6, Process_End_Time=1452787699584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787699513, firstTasksToStart=[ task_1452787699237_0001_1_00_000000 ], lastTaskFinishTime=1452787699587, lastTasksToFinish=[ task_1452787699237_0001_1_00_000000 ], minTaskDuration=74, maxTaskDuration=74, avgTaskDuration=74.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787699237_0001_1_00_000000 ], longestDurationTasks=[ task_1452787699237_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:19,595 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:19,595 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:19,595 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787699237_0001_00_000001, stoppedTime=1452787699595, exitStatus=0
2016-01-14 16:08:19,596 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:19,596 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:19,596 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787699237_0001_1
2016-01-14 16:08:19,597 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787699237_0001_1
2016-01-14 16:08:19,597 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: FA50B415C695449F886C68138175778F for vertex: vertex_1452787699237_0001_1_00 [D113F7F2069D4DC79D81AC459805D0DB]
2016-01-14 16:08:19,596 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:19,601 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787699237_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:19,602 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787699237_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:19,602 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787699237_0001_00_000001, Exiting
2016-01-14 16:08:19,602 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787699237_0001_00_000001
2016-01-14 16:08:19,602 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787699237_0001_00_000001
2016-01-14 16:08:19,604 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787699237_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:19,605 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787699237_0001_00_000001 completed successfully
2016-01-14 16:08:19,609 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787699237_0001_1, queueSize=0
2016-01-14 16:08:19,609 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:19,610 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699237_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787699237_0001_1, startTime=1452787699468, finishTime=1452787699608, timeTaken=140, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787699578, Process_Duration=6, Process_End_Time=1452787699584, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:19,610 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787699237_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:19,610 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699237_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:19,610 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787699237_0001_00_000001
2016-01-14 16:08:19,610 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699237_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:19 Completed Dag: dag_1452787699237_0001_1
2016-01-14 16:08:19,612 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787699237_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:19,612 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787699237_0001_1_post
2016-01-14 16:08:19,612 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:19,612 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:19,619 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ULTS.-1_'field2'_'field2', applicationId=application_1452787699237_0001
2016-01-14 16:08:19,622 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:19,622 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:19,622 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:19,622 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:19,622 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:19,623 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:19,624 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:19,624 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:19,624 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:19,625 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:19,625 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:19,626 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:19,626 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:19,632 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3DA1C611A9584B85971B686AC629B375/BA19925CBF9546C4A90304D1996F1A70/.tez/application_1452787699237_0001
2016-01-14 16:08:19,633 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.429
2016-01-14 16:08:19,726 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_'field2'
2016-01-14 16:08:19,763 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:19,763 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:19,832 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 16:08:19,853 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.045
2016-01-14 16:08:19,854 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:19,854 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:19,854 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:19,872 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:19,873 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'
2016-01-14 16:08:19,893 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:19,893 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:19,894 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"]
2016-01-14 16:08:19,894 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:19,895 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:19,896 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:19,896 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:19,897 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:19,912 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:19,917 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:19,918 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:19,918 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:19,928 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001 doesn't exist and is created
2016-01-14 16:08:19,954 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:19,954 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:19,955 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001
2016-01-14 16:08:19,961 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787699917_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:19,974 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:19,975 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:19,977 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:19,978 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:19,978 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001/localmode-log-dir
2016-01-14 16:08:19,979 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001/localmode-log-dir/history.txt.appattempt_1452787699917_0001_000000, maxErrors=10
2016-01-14 16:08:19,979 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:19,979 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787699917_0001_000000, appSubmitTime=1452787699960, launchTime=1452787699961
2016-01-14 16:08:19,984 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:19,989 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:19,991 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:19,991 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:19,994 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:46444
2016-01-14 16:08:19,995 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:19,998 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:19,998 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787699917_0001_000000, startTime=1452787699998
2016-01-14 16:08:19,998 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:20,054 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:20,055 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:20,055 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452787699917_0001, dagName=[57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:20,075 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:20,077 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787699917_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001/localmode-log-dir/dag_1452787699917_0001_1.dot
2016-01-14 16:08:20,078 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001/localmode-log-dir/dag_1452787699917_0001_1-tez-dag.pb.txt
2016-01-14 16:08:20,103 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787699917_0001_1
2016-01-14 16:08:20,103 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,103 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:20 Running Dag: dag_1452787699917_0001_1
2016-01-14 16:08:20,116 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787699917_0001_1, submitTime=1452787700076
2016-01-14 16:08:20,117 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:20,117 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E4D5AA5C295A4ED5A28FF485FE5FB206
2016-01-14 16:08:20,117 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:20,117 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787699917_0001_1, initTime=1452787700117
2016-01-14 16:08:20,117 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:20,118 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699917_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:20,119 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:DAG_STARTED]: dagID=dag_1452787699917_0001_1, startTime=1452787700119
2016-01-14 16:08:20,119 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:20,119 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:20,119 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699917_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:20,119 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E4D5AA5C295A4ED5A28FF485FE5FB206 : {4B93711BE0BD4AAAAC274BD46CF85015={InputName=4B93711BE0BD4AAAAC274BD46CF85015}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:20,119 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 4B93711BE0BD4AAAAC274BD46CF85015, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:20,120 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,120 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,120 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,120 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]. Starting root input initializers: 1
2016-01-14 16:08:20,121 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:20,122 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 4B93711BE0BD4AAAAC274BD46CF85015 on vertex vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,123 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452787699917_0001, dagName=[57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field'
2016-01-14 16:08:20,124 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:20,124 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 4B93711BE0BD4AAAAC274BD46CF85015 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:20,126 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:20,126 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:20,128 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:20,129 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 4B93711BE0BD4AAAAC274BD46CF85015 on vertex vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,129 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:20,129 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {4B93711BE0BD4AAAAC274BD46CF85015=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:20,130 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] parallelism set to 1
2016-01-14 16:08:20,130 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:20,130 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787699917_0001_1_00, eventCount=1
2016-01-14 16:08:20,130 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,131 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=B190C7DE36BA4D8CBE1226ED75F65F11, vertexId=vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:20,131 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=B190C7DE36BA4D8CBE1226ED75F65F11, vertexId=vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,135 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=B190C7DE36BA4D8CBE1226ED75F65F11, vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:20,135 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=B190C7DE36BA4D8CBE1226ED75F65F11, vertexId=vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,137 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:20,137 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, vertexId=vertex_1452787699917_0001_1_00, initRequestedTime=1452787700119, initedTime=1452787700136, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:20,137 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] with distanceFromRoot: 0
2016-01-14 16:08:20,138 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:20,138 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E4D5AA5C295A4ED5A28FF485FE5FB206
2016-01-14 16:08:20,138 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,138 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:20,139 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787699917_0001_1_00, startRequestedTime=1452787700138, startedTime=1452787700138
2016-01-14 16:08:20,139 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:20,140 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:20,140 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:TASK_STARTED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, taskId=task_1452787699917_0001_1_00_000000, scheduledTime=1452787700139, launchTime=1452787700139
2016-01-14 16:08:20,140 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699917_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:20,140 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,141 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field', VertexName: E4D5AA5C295A4ED5A28FF485FE5FB206, VertexParallelism: 1, TaskAttemptID:attempt_1452787699917_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4B93711BE0BD4AAAAC274BD46CF85015, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B190C7DE36BA4D8CBE1226ED75F65F11, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:20,141 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699917_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:20,141 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:20,143 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:20,143 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:20,143 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:20,144 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787699917_0001_00_000001
2016-01-14 16:08:20,144 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:20,146 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787699917_0001_00_000001
2016-01-14 16:08:20,147 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:20,148 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:20,148 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:20,148 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787699917_0001_00_000001, launchTime=1452787700147
2016-01-14 16:08:20,149 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787699917_0001_00_000001
2016-01-14 16:08:20,150 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787699917_0001_1_00_000000_0] to container: [container_1452787699917_0001_00_000001]
2016-01-14 16:08:20,150 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:20,151 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787699917_0001_00_000001 given task: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,151 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787699917_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,151 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787699917_0001_1_00_000000_0] started. Is using containerId: [container_1452787699917_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:20,151 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787699917_0001, with dag id: dag_1452787699917_0001_1
2016-01-14 16:08:20,152 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:20 Starting to run new task attempt: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,151 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0, startTime=1452787700151, containerId=container_1452787699917_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787699917_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:20,152 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,152 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699917_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:20,153 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,155 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:20,155 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:20,155 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:20,156 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:20,156 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:20,156 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699917_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:20,156 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752] every.every/(1/1) ...SULTS.-1_'field2'_'field', VertexName: E4D5AA5C295A4ED5A28FF485FE5FB206, VertexParallelism: 1, TaskAttemptID:attempt_1452787699917_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4B93711BE0BD4AAAAC274BD46CF85015, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=B190C7DE36BA4D8CBE1226ED75F65F11, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:20,157 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:20,157 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:20,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,163 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,163 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=B190C7DE36BA4D8CBE1226ED75F65F11, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:20,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:20,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: B190C7DE36BA4D8CBE1226ED75F65F11
2016-01-14 16:08:20,165 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:20,165 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: B190C7DE36BA4D8CBE1226ED75F65F11
2016-01-14 16:08:20,169 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787699917_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:20,169 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=4B93711BE0BD4AAAAC274BD46CF85015, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:20,170 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:20,172 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:20,172 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,173 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,183 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:20,183 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,183 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,186 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:20,186 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: B190C7DE36BA4D8CBE1226ED75F65F11
2016-01-14 16:08:20,193 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E4D5AA5C295A4ED5A28FF485FE5FB206, ordinal: 0
2016-01-14 16:08:20,193 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E4D5AA5C295A4ED5A28FF485FE5FB206, mem on start (mb), free: 159, total: 281, max: 672
2016-01-14 16:08:20,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:20,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:20,195 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:20,195 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:20,195 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:20,196 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:20,196 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:20,196 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:20,197 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:20,197 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:20,197 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, B190C7DE36BA4D8CBE1226ED75F65F11, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:20,198 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 4B93711BE0BD4AAAAC274BD46CF85015, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:20,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:20,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 4B93711BE0BD4AAAAC274BD46CF85015 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:20,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,199 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:20,199 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,199 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:20,200 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:20,201 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:20,201 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,201 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:20,203 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@22fc32f0
2016-01-14 16:08:20,204 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@22fc32f0
2016-01-14 16:08:20,205 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:20,206 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:20,207 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:20,208 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 4B93711BE0BD4AAAAC274BD46CF85015
2016-01-14 16:08:20,208 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"], id: B190C7DE36BA4D8CBE1226ED75F65F11
2016-01-14 16:08:20,208 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_'field'"]
2016-01-14 16:08:20,209 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:20,210 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:20,210 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E4D5AA5C295A4ED5A28FF485FE5FB206, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:20,213 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:20,214 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:20,214 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,215 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787699917_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:20,216 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,216 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E4D5AA5C295A4ED5A28FF485FE5FB206, mem on close (mb), free: 157, total: 281, max: 672
2016-01-14 16:08:20 Completed running task attempt: attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,218 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:20,221 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787700210, Process_Duration=6, Process_End_Time=1452787700216, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:20,221 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:20,222 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, taskAttemptId=attempt_1452787699917_0001_1_00_000000_0, startTime=1452787700151, finishTime=1452787700221, timeTaken=70, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700210, Process_Duration=6, Process_End_Time=1452787700216, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,222 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787699917_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:20,222 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787699917_0001_1_00_000000_0
2016-01-14 16:08:20,222 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:20,223 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:20,223 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,224 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:20,224 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:TASK_FINISHED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, taskId=task_1452787699917_0001_1_00_000000, startTime=1452787700151, finishTime=1452787700223, timeTaken=72, status=SUCCEEDED, successfulAttemptID=attempt_1452787699917_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700210, Process_Duration=6, Process_End_Time=1452787700216, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,226 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787699917_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:20,226 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] : 1
2016-01-14 16:08:20,226 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,226 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787699917_0001_00_000001
2016-01-14 16:08:20,228 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:20,229 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:VERTEX_FINISHED]: vertexName=E4D5AA5C295A4ED5A28FF485FE5FB206, vertexId=vertex_1452787699917_0001_1_00, initRequestedTime=1452787700119, initedTime=1452787700136, startRequestedTime=1452787700138, startedTime=1452787700138, finishTime=1452787700226, timeTaken=88, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700210, Process_Duration=6, Process_End_Time=1452787700216, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787700151, firstTasksToStart=[ task_1452787699917_0001_1_00_000000 ], lastTaskFinishTime=1452787700221, lastTasksToFinish=[ task_1452787699917_0001_1_00_000000 ], minTaskDuration=70, maxTaskDuration=70, avgTaskDuration=70.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787699917_0001_1_00_000000 ], longestDurationTasks=[ task_1452787699917_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:20,229 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:20,229 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:20,230 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:20,230 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787699917_0001_00_000001, stoppedTime=1452787700230, exitStatus=0
2016-01-14 16:08:20,232 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:20,233 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:20,233 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787699917_0001_1
2016-01-14 16:08:20,233 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787699917_0001_1
2016-01-14 16:08:20,233 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: B190C7DE36BA4D8CBE1226ED75F65F11 for vertex: vertex_1452787699917_0001_1_00 [E4D5AA5C295A4ED5A28FF485FE5FB206]
2016-01-14 16:08:20,237 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787699917_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:20,238 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787699917_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:20,238 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787699917_0001_00_000001, Exiting
2016-01-14 16:08:20,238 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787699917_0001_00_000001
2016-01-14 16:08:20,238 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787699917_0001_00_000001
2016-01-14 16:08:20,242 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787699917_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:20,242 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787699917_0001_00_000001 completed successfully
2016-01-14 16:08:20,248 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787699917_0001_1, queueSize=0
2016-01-14 16:08:20,248 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:20,248 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787699917_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787699917_0001_1, startTime=1452787700119, finishTime=1452787700246, timeTaken=127, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=295174144, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700210, Process_Duration=6, Process_End_Time=1452787700216, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,249 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787699917_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:20,249 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787699917_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:20,250 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787699917_0001_00_000001
2016-01-14 16:08:20,250 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787699917_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:20 Completed Dag: dag_1452787699917_0001_1
2016-01-14 16:08:20,253 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787699917_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:20,253 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787699917_0001_1_post
2016-01-14 16:08:20,253 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,254 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:20,260 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.-1_'field2'_'field', applicationId=application_1452787699917_0001
2016-01-14 16:08:20,262 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:20,263 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:20,263 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:20,263 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:20,263 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:20,263 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:20,264 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:20,264 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:20,264 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:20,264 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:20,264 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:20,265 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:20,265 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:20,270 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/57134815AAE1481FAC248A5107BB94D3/F83DE7FB389C498798AB2637A1987752/.tez/application_1452787699917_0001
2016-01-14 16:08:20,271 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.378
2016-01-14 16:08:20,392 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_'field'
2016-01-14 16:08:20,418 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:20,419 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:20,469 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 16:08:20,474 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 16:08:20,475 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:20,476 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:20,476 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:20,495 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:20,496 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:20,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:20,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"]
2016-01-14 16:08:20,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:20,514 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:20,515 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:20,515 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,516 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:20,531 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:20,536 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:20,537 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:20,537 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:20,547 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001 doesn't exist and is created
2016-01-14 16:08:20,565 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:20,565 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:20,566 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001
2016-01-14 16:08:20,570 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787700536_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:20,582 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:20,583 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:20,584 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:20,585 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:20,585 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001/localmode-log-dir
2016-01-14 16:08:20,585 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001/localmode-log-dir/history.txt.appattempt_1452787700536_0001_000000, maxErrors=10
2016-01-14 16:08:20,585 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:20,586 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787700536_0001_000000, appSubmitTime=1452787700570, launchTime=1452787700570
2016-01-14 16:08:20,592 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:20,593 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:55570
2016-01-14 16:08:20,595 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:20,596 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:20,596 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:20,597 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:20,599 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787700536_0001_000000, startTime=1452787700599
2016-01-14 16:08:20,599 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:20,600 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:20,666 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:20,666 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:20,666 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452787700536_0001, dagName=[3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,685 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,687 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787700536_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001/localmode-log-dir/dag_1452787700536_0001_1.dot
2016-01-14 16:08:20,688 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001/localmode-log-dir/dag_1452787700536_0001_1-tez-dag.pb.txt
2016-01-14 16:08:20,711 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787700536_0001_1
2016-01-14 16:08:20,711 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,711 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20 Running Dag: dag_1452787700536_0001_1
2016-01-14 16:08:20,725 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787700536_0001_1, submitTime=1452787700685
2016-01-14 16:08:20,725 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:20,725 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B62DA04B2C114C44B408B32F00886226
2016-01-14 16:08:20,725 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:20,726 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787700536_0001_1, initTime=1452787700725
2016-01-14 16:08:20,726 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787700536_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:20,726 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:20,727 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:DAG_STARTED]: dagID=dag_1452787700536_0001_1, startTime=1452787700727
2016-01-14 16:08:20,727 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:20,727 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:20,728 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787700536_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:20,728 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B62DA04B2C114C44B408B32F00886226 : {3446956DAEA74FC688039AA475862FA6={InputName=3446956DAEA74FC688039AA475862FA6}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:20,728 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 3446956DAEA74FC688039AA475862FA6, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:20,728 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,728 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,728 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,729 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]. Starting root input initializers: 1
2016-01-14 16:08:20,729 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:20,729 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 3446956DAEA74FC688039AA475862FA6 on vertex vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,730 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452787700536_0001, dagName=[3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,731 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:20,731 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 3446956DAEA74FC688039AA475862FA6 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:20,732 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:20,733 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:20,735 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:20,735 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 3446956DAEA74FC688039AA475862FA6 on vertex vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,735 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:20,735 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {3446956DAEA74FC688039AA475862FA6=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:20,736 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] parallelism set to 1
2016-01-14 16:08:20,736 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:20,737 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787700536_0001_1_00, eventCount=1
2016-01-14 16:08:20,737 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,737 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=07A28693682745118BDE55BF4ADA3676, vertexId=vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:20,738 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=07A28693682745118BDE55BF4ADA3676, vertexId=vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,739 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=07A28693682745118BDE55BF4ADA3676, vertexName=B62DA04B2C114C44B408B32F00886226, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:20,739 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=07A28693682745118BDE55BF4ADA3676, vertexId=vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,741 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:20,741 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B62DA04B2C114C44B408B32F00886226, vertexId=vertex_1452787700536_0001_1_00, initRequestedTime=1452787700728, initedTime=1452787700740, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:20,741 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] with distanceFromRoot: 0
2016-01-14 16:08:20,741 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:20,741 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B62DA04B2C114C44B408B32F00886226
2016-01-14 16:08:20,741 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,742 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:20,742 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787700536_0001_1_00, startRequestedTime=1452787700741, startedTime=1452787700741
2016-01-14 16:08:20,742 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:20,743 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:20,743 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:TASK_STARTED]: vertexName=B62DA04B2C114C44B408B32F00886226, taskId=task_1452787700536_0001_1_00_000000, scheduledTime=1452787700743, launchTime=1452787700743
2016-01-14 16:08:20,744 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787700536_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:20,744 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,744 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS, VertexName: B62DA04B2C114C44B408B32F00886226, VertexParallelism: 1, TaskAttemptID:attempt_1452787700536_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3446956DAEA74FC688039AA475862FA6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=07A28693682745118BDE55BF4ADA3676, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:20,745 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787700536_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:20,745 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:20,748 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:20,749 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:20,749 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:20,749 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787700536_0001_00_000001
2016-01-14 16:08:20,749 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:20,751 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787700536_0001_00_000001
2016-01-14 16:08:20,752 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:20,753 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:20,753 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:20,754 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787700536_0001_00_000001, launchTime=1452787700753
2016-01-14 16:08:20,754 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787700536_0001_00_000001
2016-01-14 16:08:20,755 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787700536_0001, with dag id: dag_1452787700536_0001_1
2016-01-14 16:08:20,755 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787700536_0001_1_00_000000_0] to container: [container_1452787700536_0001_00_000001]
2016-01-14 16:08:20,755 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:20,757 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787700536_0001_00_000001 given task: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,757 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787700536_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,757 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787700536_0001_1_00_000000_0] started. Is using containerId: [container_1452787700536_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:20,758 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B62DA04B2C114C44B408B32F00886226, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0, startTime=1452787700757, containerId=container_1452787700536_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787700536_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:20,758 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787700536_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:20,758 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787700536_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:20,758 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:20 Starting to run new task attempt: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,761 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,761 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,761 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:20,761 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:20,761 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:20,762 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:20,762 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:20,762 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81] every.every/(1/1) ...SULTS.-1_'field2'_RESULTS, VertexName: B62DA04B2C114C44B408B32F00886226, VertexParallelism: 1, TaskAttemptID:attempt_1452787700536_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=3446956DAEA74FC688039AA475862FA6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=07A28693682745118BDE55BF4ADA3676, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:20,763 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:20,763 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,764 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:20,764 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,765 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,765 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=3446956DAEA74FC688039AA475862FA6, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:20,768 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:20,768 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:20,767 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=07A28693682745118BDE55BF4ADA3676, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:20,766 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787700536_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:20,769 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,771 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,771 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:20,772 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 07A28693682745118BDE55BF4ADA3676
2016-01-14 16:08:20,772 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:20,772 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 07A28693682745118BDE55BF4ADA3676
2016-01-14 16:08:20,777 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:20,777 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,778 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,784 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B62DA04B2C114C44B408B32F00886226, ordinal: 0
2016-01-14 16:08:20,785 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B62DA04B2C114C44B408B32F00886226, mem on start (mb), free: 298, total: 387, max: 672
2016-01-14 16:08:20,785 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:20,785 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:20,786 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:20,793 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:20,793 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 07A28693682745118BDE55BF4ADA3676
2016-01-14 16:08:20,793 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:20,793 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:20,793 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:20,793 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:20,793 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:20,793 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:20,793 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:20,794 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:20,794 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 3446956DAEA74FC688039AA475862FA6, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:20,794 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 07A28693682745118BDE55BF4ADA3676, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:20,794 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:20,795 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 3446956DAEA74FC688039AA475862FA6 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:20,795 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:20,795 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:20,795 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,796 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:20,796 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,796 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:20,797 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,798 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:20,799 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@5b52e370
2016-01-14 16:08:20,800 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:20,801 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 3446956DAEA74FC688039AA475862FA6
2016-01-14 16:08:20,801 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"], id: 07A28693682745118BDE55BF4ADA3676
2016-01-14 16:08:20,801 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@5b52e370
2016-01-14 16:08:20,801 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:20,801 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:20,801 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_RESULTS"]
2016-01-14 16:08:20,802 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:20,803 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:20,803 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B62DA04B2C114C44B408B32F00886226, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:20,805 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:20,806 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:20,807 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,807 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787700536_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:20,808 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,808 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B62DA04B2C114C44B408B32F00886226, mem on close (mb), free: 296, total: 387, max: 672
2016-01-14 16:08:20 Completed running task attempt: attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,810 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:20,811 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787700803, Process_Duration=5, Process_End_Time=1452787700808, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:20,811 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:20,812 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:20,812 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B62DA04B2C114C44B408B32F00886226, taskAttemptId=attempt_1452787700536_0001_1_00_000000_0, startTime=1452787700757, finishTime=1452787700811, timeTaken=54, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700803, Process_Duration=5, Process_End_Time=1452787700808, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,813 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787700536_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:20,813 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,813 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:20,813 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787700536_0001_00_000001
2016-01-14 16:08:20,813 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787700536_0001_1_00_000000_0
2016-01-14 16:08:20,816 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:20,816 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:TASK_FINISHED]: vertexName=B62DA04B2C114C44B408B32F00886226, taskId=task_1452787700536_0001_1_00_000000, startTime=1452787700757, finishTime=1452787700815, timeTaken=58, status=SUCCEEDED, successfulAttemptID=attempt_1452787700536_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700803, Process_Duration=5, Process_End_Time=1452787700808, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,816 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787700536_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:20,816 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] : 1
2016-01-14 16:08:20,816 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,817 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:20,818 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:VERTEX_FINISHED]: vertexName=B62DA04B2C114C44B408B32F00886226, vertexId=vertex_1452787700536_0001_1_00, initRequestedTime=1452787700728, initedTime=1452787700740, startRequestedTime=1452787700741, startedTime=1452787700741, finishTime=1452787700817, timeTaken=76, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700803, Process_Duration=5, Process_End_Time=1452787700808, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787700757, firstTasksToStart=[ task_1452787700536_0001_1_00_000000 ], lastTaskFinishTime=1452787700811, lastTasksToFinish=[ task_1452787700536_0001_1_00_000000 ], minTaskDuration=54, maxTaskDuration=54, avgTaskDuration=54.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787700536_0001_1_00_000000 ], longestDurationTasks=[ task_1452787700536_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:20,818 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:20,819 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:20,819 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787700536_0001_00_000001, stoppedTime=1452787700819, exitStatus=0
2016-01-14 16:08:20,819 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:20,819 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:20,820 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787700536_0001_1
2016-01-14 16:08:20,821 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787700536_0001_1
2016-01-14 16:08:20,821 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 07A28693682745118BDE55BF4ADA3676 for vertex: vertex_1452787700536_0001_1_00 [B62DA04B2C114C44B408B32F00886226]
2016-01-14 16:08:20,819 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:20,825 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787700536_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:20,826 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787700536_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:20,826 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787700536_0001_00_000001, Exiting
2016-01-14 16:08:20,826 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787700536_0001_00_000001
2016-01-14 16:08:20,826 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787700536_0001_00_000001
2016-01-14 16:08:20,828 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787700536_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:20,828 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787700536_0001_00_000001 completed successfully
2016-01-14 16:08:20,832 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787700536_0001_1, queueSize=0
2016-01-14 16:08:20,832 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:20,833 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787700536_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787700536_0001_1, startTime=1452787700727, finishTime=1452787700831, timeTaken=104, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787700803, Process_Duration=5, Process_End_Time=1452787700808, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:20,833 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787700536_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:20,833 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787700536_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:20,833 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787700536_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:20,833 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787700536_0001_00_000001
2016-01-14 16:08:20 Completed Dag: dag_1452787700536_0001_1
2016-01-14 16:08:20,834 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787700536_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:20,835 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787700536_0001_1_post
2016-01-14 16:08:20,835 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:20,835 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:20,842 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.-1_'field2'_RESULTS, applicationId=application_1452787700536_0001
2016-01-14 16:08:20,847 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:20,847 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:20,847 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:20,847 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:20,847 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:20,848 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:20,848 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:20,848 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:20,850 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:20,850 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:20,850 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:20,851 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:20,851 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:20,857 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/3F7936CAAFB849B497DE82DACC8545D3/CBAFA570D66246C6B585C4F6CB334E81/.tez/application_1452787700536_0001
2016-01-14 16:08:20,857 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.343
2016-01-14 16:08:20,935 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_RESULTS
2016-01-14 16:08:20,960 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:20,961 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:21,017 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 16:08:21,030 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-01-14 16:08:21,031 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:21,031 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:21,031 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:21,050 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:21,051 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,062 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:21,063 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,063 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"]
2016-01-14 16:08:21,064 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:21,064 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:21,064 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:21,066 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,066 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:21,079 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:21,083 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:21,083 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:21,083 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:21,093 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001 doesn't exist and is created
2016-01-14 16:08:21,109 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:21,109 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:21,109 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001
2016-01-14 16:08:21,113 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787701083_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:21,125 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:21,126 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:21,128 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:21,128 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:21,128 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001/localmode-log-dir
2016-01-14 16:08:21,128 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001/localmode-log-dir/history.txt.appattempt_1452787701083_0001_000000, maxErrors=10
2016-01-14 16:08:21,128 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:21,129 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787701083_0001_000000, appSubmitTime=1452787701112, launchTime=1452787701112
2016-01-14 16:08:21,133 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:21,136 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:21,137 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:58619
2016-01-14 16:08:21,137 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:21,139 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:21,140 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:21,142 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787701083_0001_000000, startTime=1452787701142
2016-01-14 16:08:21,142 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:21,142 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:21,209 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:21,209 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:21,210 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452787701083_0001, dagName=[35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,231 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,233 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787701083_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001/localmode-log-dir/dag_1452787701083_0001_1.dot
2016-01-14 16:08:21,234 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001/localmode-log-dir/dag_1452787701083_0001_1-tez-dag.pb.txt
2016-01-14 16:08:21,253 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787701083_0001_1
2016-01-14 16:08:21,254 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,254 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21 Running Dag: dag_1452787701083_0001_1
2016-01-14 16:08:21,267 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787701083_0001_1, submitTime=1452787701231
2016-01-14 16:08:21,267 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:21,267 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BBFD17641189442CA3522A7F85558F2E
2016-01-14 16:08:21,268 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:21,268 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787701083_0001_1, initTime=1452787701267
2016-01-14 16:08:21,269 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701083_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:21,269 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:21,270 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:DAG_STARTED]: dagID=dag_1452787701083_0001_1, startTime=1452787701269
2016-01-14 16:08:21,270 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:21,270 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:21,270 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701083_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:21,270 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BBFD17641189442CA3522A7F85558F2E : {C26AEA7100A1422CBCE82357896F09C1={InputName=C26AEA7100A1422CBCE82357896F09C1}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:21,270 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: C26AEA7100A1422CBCE82357896F09C1, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:21,271 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,271 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,271 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,272 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452787701083_0001, dagName=[35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,272 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]. Starting root input initializers: 1
2016-01-14 16:08:21,272 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:21,273 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: C26AEA7100A1422CBCE82357896F09C1 on vertex vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,275 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:21,275 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input C26AEA7100A1422CBCE82357896F09C1 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:21,276 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:21,276 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:21,279 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:21,279 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: C26AEA7100A1422CBCE82357896F09C1 on vertex vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,280 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:21,280 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {C26AEA7100A1422CBCE82357896F09C1=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:21,280 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] parallelism set to 1
2016-01-14 16:08:21,280 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:21,280 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787701083_0001_1_00, eventCount=1
2016-01-14 16:08:21,281 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,281 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=C0222321DC6B409A9579B76958B0856F, vertexId=vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:21,281 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=C0222321DC6B409A9579B76958B0856F, vertexId=vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,283 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=C0222321DC6B409A9579B76958B0856F, vertexName=BBFD17641189442CA3522A7F85558F2E, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:21,284 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=C0222321DC6B409A9579B76958B0856F, vertexId=vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,285 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:21,286 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BBFD17641189442CA3522A7F85558F2E, vertexId=vertex_1452787701083_0001_1_00, initRequestedTime=1452787701270, initedTime=1452787701285, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:21,286 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] with distanceFromRoot: 0
2016-01-14 16:08:21,286 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:21,286 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BBFD17641189442CA3522A7F85558F2E
2016-01-14 16:08:21,287 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,287 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:21,287 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787701083_0001_1_00, startRequestedTime=1452787701286, startedTime=1452787701286
2016-01-14 16:08:21,288 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:21,288 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:21,288 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:TASK_STARTED]: vertexName=BBFD17641189442CA3522A7F85558F2E, taskId=task_1452787701083_0001_1_00_000000, scheduledTime=1452787701288, launchTime=1452787701288
2016-01-14 16:08:21,289 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701083_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:21,289 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,289 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL, VertexName: BBFD17641189442CA3522A7F85558F2E, VertexParallelism: 1, TaskAttemptID:attempt_1452787701083_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C26AEA7100A1422CBCE82357896F09C1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C0222321DC6B409A9579B76958B0856F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:21,290 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701083_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:21,290 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:21,291 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:21,292 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:21,292 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:21,293 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787701083_0001_00_000001
2016-01-14 16:08:21,293 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:21,296 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787701083_0001_00_000001
2016-01-14 16:08:21,296 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:21,297 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:21,297 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787701083_0001_00_000001, launchTime=1452787701297
2016-01-14 16:08:21,297 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:21,298 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787701083_0001_00_000001
2016-01-14 16:08:21,299 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787701083_0001_1_00_000000_0] to container: [container_1452787701083_0001_00_000001]
2016-01-14 16:08:21,299 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:21,299 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787701083_0001_00_000001 given task: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,299 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787701083_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,300 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787701083_0001_1_00_000000_0] started. Is using containerId: [container_1452787701083_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:21,300 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BBFD17641189442CA3522A7F85558F2E, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0, startTime=1452787701299, containerId=container_1452787701083_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787701083_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:21 Starting to run new task attempt: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,300 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701083_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:21,300 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,300 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,300 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:21,301 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:21,300 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701083_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:21,301 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:21,301 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:21,301 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:21,301 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:21,301 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F] every.every/(1/1) ...'_RESULTS.-1_'field2'_ALL, VertexName: BBFD17641189442CA3522A7F85558F2E, VertexParallelism: 1, TaskAttemptID:attempt_1452787701083_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C26AEA7100A1422CBCE82357896F09C1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C0222321DC6B409A9579B76958B0856F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:21,302 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:21,302 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,304 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:21,304 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,305 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=C26AEA7100A1422CBCE82357896F09C1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:21,305 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=C0222321DC6B409A9579B76958B0856F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:21,306 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:21,305 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,306 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,307 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,307 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787701083_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:21,309 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787701083_0001, with dag id: dag_1452787701083_0001_1
2016-01-14 16:08:21,306 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:21,310 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: C0222321DC6B409A9579B76958B0856F
2016-01-14 16:08:21,310 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:21,310 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: C0222321DC6B409A9579B76958B0856F
2016-01-14 16:08:21,316 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:21,317 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:21,317 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,317 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,329 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:21,330 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: C0222321DC6B409A9579B76958B0856F
2016-01-14 16:08:21,335 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BBFD17641189442CA3522A7F85558F2E, ordinal: 0
2016-01-14 16:08:21,335 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BBFD17641189442CA3522A7F85558F2E, mem on start (mb), free: 217, total: 387, max: 672
2016-01-14 16:08:21,335 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,335 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:21,335 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:21,335 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:21,336 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:21,336 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:21,337 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:21,337 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:21,337 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:21,338 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:21,338 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:21,338 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, C26AEA7100A1422CBCE82357896F09C1, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:21,339 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, C0222321DC6B409A9579B76958B0856F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:21,339 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:21,339 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,339 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:21,339 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,340 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: C26AEA7100A1422CBCE82357896F09C1 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:21,340 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:21,340 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:21,341 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:21,341 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,341 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:21,342 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@20ea1c31
2016-01-14 16:08:21,344 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@20ea1c31
2016-01-14 16:08:21,344 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:21,344 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:21,346 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,347 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: C26AEA7100A1422CBCE82357896F09C1
2016-01-14 16:08:21,347 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"], id: C0222321DC6B409A9579B76958B0856F
2016-01-14 16:08:21,348 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_'field2'_ALL"]
2016-01-14 16:08:21,348 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,348 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:21,348 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BBFD17641189442CA3522A7F85558F2E, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:21,351 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:21,351 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:21,352 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,352 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787701083_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:21,353 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,353 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BBFD17641189442CA3522A7F85558F2E, mem on close (mb), free: 215, total: 387, max: 672
2016-01-14 16:08:21 Completed running task attempt: attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,354 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:21,355 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787701349, Process_Duration=4, Process_End_Time=1452787701353, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:21,356 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BBFD17641189442CA3522A7F85558F2E, taskAttemptId=attempt_1452787701083_0001_1_00_000000_0, startTime=1452787701299, finishTime=1452787701355, timeTaken=56, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701349, Process_Duration=4, Process_End_Time=1452787701353, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:21,356 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:21,357 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701083_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:21,356 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:21,357 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,357 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:21,357 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787701083_0001_1_00_000000_0
2016-01-14 16:08:21,359 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:TASK_FINISHED]: vertexName=BBFD17641189442CA3522A7F85558F2E, taskId=task_1452787701083_0001_1_00_000000, startTime=1452787701299, finishTime=1452787701358, timeTaken=59, status=SUCCEEDED, successfulAttemptID=attempt_1452787701083_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701349, Process_Duration=4, Process_End_Time=1452787701353, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:21,359 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701083_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:21,360 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] : 1
2016-01-14 16:08:21,360 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,360 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:21,360 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787701083_0001_00_000001
2016-01-14 16:08:21,362 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:21,363 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:VERTEX_FINISHED]: vertexName=BBFD17641189442CA3522A7F85558F2E, vertexId=vertex_1452787701083_0001_1_00, initRequestedTime=1452787701270, initedTime=1452787701285, startRequestedTime=1452787701286, startedTime=1452787701286, finishTime=1452787701360, timeTaken=74, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701349, Process_Duration=4, Process_End_Time=1452787701353, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787701299, firstTasksToStart=[ task_1452787701083_0001_1_00_000000 ], lastTaskFinishTime=1452787701355, lastTasksToFinish=[ task_1452787701083_0001_1_00_000000 ], minTaskDuration=56, maxTaskDuration=56, avgTaskDuration=56.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787701083_0001_1_00_000000 ], longestDurationTasks=[ task_1452787701083_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:21,363 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:21,363 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:21,363 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787701083_0001_00_000001, stoppedTime=1452787701363, exitStatus=0
2016-01-14 16:08:21,363 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:21,364 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:21,364 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:21,364 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787701083_0001_1
2016-01-14 16:08:21,365 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787701083_0001_1
2016-01-14 16:08:21,365 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: C0222321DC6B409A9579B76958B0856F for vertex: vertex_1452787701083_0001_1_00 [BBFD17641189442CA3522A7F85558F2E]
2016-01-14 16:08:21,372 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787701083_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:21,372 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787701083_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:21,372 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787701083_0001_00_000001, Exiting
2016-01-14 16:08:21,372 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787701083_0001_00_000001
2016-01-14 16:08:21,372 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787701083_0001_00_000001
2016-01-14 16:08:21,375 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787701083_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:21,376 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787701083_0001_00_000001 completed successfully
2016-01-14 16:08:21,376 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787701083_0001_1, queueSize=0
2016-01-14 16:08:21,376 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:21,376 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701083_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787701083_0001_1, startTime=1452787701269, finishTime=1452787701374, timeTaken=105, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=792, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=406323200, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701349, Process_Duration=4, Process_End_Time=1452787701353, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=1, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:21,377 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787701083_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:21,377 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701083_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:21,377 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787701083_0001_00_000001
2016-01-14 16:08:21,377 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701083_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:21 Completed Dag: dag_1452787701083_0001_1
2016-01-14 16:08:21,379 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787701083_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:21,379 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787701083_0001_1_post
2016-01-14 16:08:21,379 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,380 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:21,384 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'_RESULTS.-1_'field2'_ALL, applicationId=application_1452787701083_0001
2016-01-14 16:08:21,386 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:21,386 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:21,387 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:21,387 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:21,387 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:21,388 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:21,388 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:21,388 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:21,388 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:21,389 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:21,389 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:21,390 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:21,390 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:21,395 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/35F036E1608C497D9FC78F412F094A69/EE831E57EFDA4805854FFAEC7E58360F/.tez/application_1452787701083_0001
2016-01-14 16:08:21,395 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.333
2016-01-14 16:08:21,489 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_'field2'_ALL
2016-01-14 16:08:21,524 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:21,526 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:21,583 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 16:08:21,589 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 16:08:21,590 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:21,590 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:21,591 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:21,614 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:21,616 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21,630 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:21,630 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,631 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"]
2016-01-14 16:08:21,631 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:21,631 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:21,631 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:21,632 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21,632 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:21,650 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:21,656 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:21,657 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:21,657 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:21,667 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001 doesn't exist and is created
2016-01-14 16:08:21,685 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:21,685 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:21,685 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001
2016-01-14 16:08:21,689 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787701656_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:21,705 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:21,706 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:21,708 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:21,708 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:21,709 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001/localmode-log-dir
2016-01-14 16:08:21,709 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001/localmode-log-dir/history.txt.appattempt_1452787701656_0001_000000, maxErrors=10
2016-01-14 16:08:21,709 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:21,710 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787701656_0001_000000, appSubmitTime=1452787701689, launchTime=1452787701689
2016-01-14 16:08:21,714 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:21,716 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:21,717 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:21,718 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:21,722 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:43625
2016-01-14 16:08:21,725 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:21,728 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787701656_0001_000000, startTime=1452787701728
2016-01-14 16:08:21,728 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:21,728 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:21,785 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:21,785 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:21,786 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452787701656_0001, dagName=[175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21,811 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21,813 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787701656_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001/localmode-log-dir/dag_1452787701656_0001_1.dot
2016-01-14 16:08:21,814 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001/localmode-log-dir/dag_1452787701656_0001_1-tez-dag.pb.txt
2016-01-14 16:08:21,862 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787701656_0001_1
2016-01-14 16:08:21,863 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,863 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21 Running Dag: dag_1452787701656_0001_1
2016-01-14 16:08:21,880 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787701656_0001_1, submitTime=1452787701811
2016-01-14 16:08:21,880 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:21,881 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex FA5EC746EBF84D1494D061EF6FBA33ED
2016-01-14 16:08:21,881 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:21,882 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787701656_0001_1, initTime=1452787701880
2016-01-14 16:08:21,882 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:21,883 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701656_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:21,883 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:DAG_STARTED]: dagID=dag_1452787701656_0001_1, startTime=1452787701883
2016-01-14 16:08:21,884 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:21,883 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:21,884 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701656_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:21,885 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: FA5EC746EBF84D1494D061EF6FBA33ED : {D347A587508E49818C096A89A533073E={InputName=D347A587508E49818C096A89A533073E}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:21,885 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: D347A587508E49818C096A89A533073E, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:21,885 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,885 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,885 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,886 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]. Starting root input initializers: 1
2016-01-14 16:08:21,886 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:21,887 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: D347A587508E49818C096A89A533073E on vertex vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,889 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452787701656_0001, dagName=[175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:21,889 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:21,889 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input D347A587508E49818C096A89A533073E asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:21,890 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:21,890 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:21,893 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:21,895 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: D347A587508E49818C096A89A533073E on vertex vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,896 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:21,896 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {D347A587508E49818C096A89A533073E=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:21,896 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] parallelism set to 1
2016-01-14 16:08:21,896 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:21,897 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787701656_0001_1_00, eventCount=1
2016-01-14 16:08:21,897 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,898 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=102790C3E0694CAB8CFD774F8CCBB7B4, vertexId=vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:21,898 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=102790C3E0694CAB8CFD774F8CCBB7B4, vertexId=vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,901 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=102790C3E0694CAB8CFD774F8CCBB7B4, vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:21,901 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=102790C3E0694CAB8CFD774F8CCBB7B4, vertexId=vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,903 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:21,903 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:VERTEX_INITIALIZED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, vertexId=vertex_1452787701656_0001_1_00, initRequestedTime=1452787701885, initedTime=1452787701902, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:21,903 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] with distanceFromRoot: 0
2016-01-14 16:08:21,904 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:21,904 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in FA5EC746EBF84D1494D061EF6FBA33ED
2016-01-14 16:08:21,904 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,905 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:21,905 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787701656_0001_1_00, startRequestedTime=1452787701904, startedTime=1452787701904
2016-01-14 16:08:21,905 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:21,906 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:21,906 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:TASK_STARTED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, taskId=task_1452787701656_0001_1_00_000000, scheduledTime=1452787701906, launchTime=1452787701906
2016-01-14 16:08:21,907 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701656_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:21,907 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,907 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, VertexName: FA5EC746EBF84D1494D061EF6FBA33ED, VertexParallelism: 1, TaskAttemptID:attempt_1452787701656_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D347A587508E49818C096A89A533073E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=102790C3E0694CAB8CFD774F8CCBB7B4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:21,908 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701656_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:21,908 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:21,909 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:21,910 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:21,910 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:21,911 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787701656_0001_00_000001
2016-01-14 16:08:21,911 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:21,917 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787701656_0001_00_000001
2016-01-14 16:08:21,917 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:21,918 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:21,918 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:21,918 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787701656_0001_00_000001, launchTime=1452787701918
2016-01-14 16:08:21,919 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787701656_0001_00_000001
2016-01-14 16:08:21,921 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787701656_0001_1_00_000000_0] to container: [container_1452787701656_0001_00_000001]
2016-01-14 16:08:21,921 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:21,921 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787701656_0001_00_000001 given task: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,922 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787701656_0001_00_000001: 1 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,922 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787701656_0001_1_00_000000_0] started. Is using containerId: [container_1452787701656_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:21 Starting to run new task attempt: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,922 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0, startTime=1452787701922, containerId=container_1452787701656_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787701656_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:21,922 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,922 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701656_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:21,923 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701656_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:21,923 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:21,923 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:21,923 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:21,923 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:21,923 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:21,924 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:21,924 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:21,924 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9] every.every/(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, VertexName: FA5EC746EBF84D1494D061EF6FBA33ED, VertexParallelism: 1, TaskAttemptID:attempt_1452787701656_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D347A587508E49818C096A89A533073E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=102790C3E0694CAB8CFD774F8CCBB7B4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:21,924 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:21,926 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787701656_0001, with dag id: dag_1452787701656_0001_1
2016-01-14 16:08:21,929 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,929 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:21,930 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,931 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787701656_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:21,934 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=D347A587508E49818C096A89A533073E, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:21,935 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:21,936 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,935 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,937 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=102790C3E0694CAB8CFD774F8CCBB7B4, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:21,940 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:21,940 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:21,942 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 102790C3E0694CAB8CFD774F8CCBB7B4
2016-01-14 16:08:21,943 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:21,943 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,943 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 102790C3E0694CAB8CFD774F8CCBB7B4
2016-01-14 16:08:21,952 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:21,952 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,953 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,957 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: FA5EC746EBF84D1494D061EF6FBA33ED, ordinal: 0
2016-01-14 16:08:21,957 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FA5EC746EBF84D1494D061EF6FBA33ED, mem on start (mb), free: 341, total: 386, max: 672
2016-01-14 16:08:21,957 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:21,958 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:21,958 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:21,963 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:21,963 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 102790C3E0694CAB8CFD774F8CCBB7B4
2016-01-14 16:08:21,963 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:21,964 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:21,964 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:21,964 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:21,964 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:21,965 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:21,965 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:21,965 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:21,965 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, D347A587508E49818C096A89A533073E, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:21,965 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 102790C3E0694CAB8CFD774F8CCBB7B4, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:21,965 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:21,966 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: D347A587508E49818C096A89A533073E being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:21,966 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,966 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:21,966 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,967 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:21,967 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:21,968 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:21,968 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,971 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:21,972 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,973 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: D347A587508E49818C096A89A533073E
2016-01-14 16:08:21,974 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"], id: 102790C3E0694CAB8CFD774F8CCBB7B4
2016-01-14 16:08:21,975 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_-1"]
2016-01-14 16:08:21,976 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:21,977 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:21,973 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4e17c516
2016-01-14 16:08:21,979 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4e17c516
2016-01-14 16:08:21,979 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:21,979 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:21,980 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: FA5EC746EBF84D1494D061EF6FBA33ED, all 1 inputs ready in: 00:00:00.001
2016-01-14 16:08:21,984 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:21,984 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:21,985 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,985 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787701656_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:21,986 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,987 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: FA5EC746EBF84D1494D061EF6FBA33ED, mem on close (mb), free: 340, total: 386, max: 672
2016-01-14 16:08:21 Completed running task attempt: attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,988 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:21,990 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, taskAttemptId=attempt_1452787701656_0001_1_00_000000_0, startTime=1452787701922, finishTime=1452787701989, timeTaken=67, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701980, Process_Duration=6, Process_End_Time=1452787701986, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:21,990 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787701656_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:21,990 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787701656_0001_1_00_000000_0
2016-01-14 16:08:21,991 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:21,991 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:21,993 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:21,992 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:TASK_FINISHED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, taskId=task_1452787701656_0001_1_00_000000, startTime=1452787701922, finishTime=1452787701991, timeTaken=69, status=SUCCEEDED, successfulAttemptID=attempt_1452787701656_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701980, Process_Duration=6, Process_End_Time=1452787701986, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:21,994 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787701656_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:21,995 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] : 1
2016-01-14 16:08:21,995 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:21,995 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787701980, Process_Duration=6, Process_End_Time=1452787701986, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:21,997 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:21,997 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,000 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:22,000 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:VERTEX_FINISHED]: vertexName=FA5EC746EBF84D1494D061EF6FBA33ED, vertexId=vertex_1452787701656_0001_1_00, initRequestedTime=1452787701885, initedTime=1452787701902, startRequestedTime=1452787701904, startedTime=1452787701904, finishTime=1452787701995, timeTaken=91, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701980, Process_Duration=6, Process_End_Time=1452787701986, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787701922, firstTasksToStart=[ task_1452787701656_0001_1_00_000000 ], lastTaskFinishTime=1452787701989, lastTasksToFinish=[ task_1452787701656_0001_1_00_000000 ], minTaskDuration=67, maxTaskDuration=67, avgTaskDuration=67.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787701656_0001_1_00_000000 ], longestDurationTasks=[ task_1452787701656_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:22,000 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:22,000 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:22,001 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:22,001 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787701656_0001_00_000001, stoppedTime=1452787702001, exitStatus=0
2016-01-14 16:08:22,001 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:22,002 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:22,002 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787701656_0001_1
2016-01-14 16:08:22,001 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787701656_0001_00_000001
2016-01-14 16:08:22,002 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787701656_0001_1
2016-01-14 16:08:22,003 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 102790C3E0694CAB8CFD774F8CCBB7B4 for vertex: vertex_1452787701656_0001_1_00 [FA5EC746EBF84D1494D061EF6FBA33ED]
2016-01-14 16:08:22,003 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787701656_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:22,005 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787701656_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:22,006 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787701656_0001_00_000001, Exiting
2016-01-14 16:08:22,006 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787701656_0001_00_000001
2016-01-14 16:08:22,006 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787701656_0001_00_000001
2016-01-14 16:08:22,012 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787701656_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:22,012 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787701656_0001_00_000001 completed successfully
2016-01-14 16:08:22,017 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787701656_0001_1, queueSize=0
2016-01-14 16:08:22,017 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:22,017 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787701656_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787701656_0001_1, startTime=1452787701883, finishTime=1452787702015, timeTaken=132, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787701980, Process_Duration=6, Process_End_Time=1452787701986, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:22,018 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787701656_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:22,018 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787701656_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:22,018 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787701656_0001_00_000001
2016-01-14 16:08:22,018 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787701656_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:22 Completed Dag: dag_1452787701656_0001_1
2016-01-14 16:08:22,019 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787701656_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:22,019 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787701656_0001_1_post
2016-01-14 16:08:22,019 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,019 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:22,027 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.-1_UNKNOWN_-1, applicationId=application_1452787701656_0001
2016-01-14 16:08:22,030 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:22,030 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:22,031 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:22,031 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:22,031 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:22,031 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:22,033 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:22,034 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:22,034 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:22,035 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:22,036 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:22,037 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:22,037 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:22,043 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/175A3A97EF1D4CABBE34786BB1013CAA/F673691F4D0C4985B46673967375AFD9/.tez/application_1452787701656_0001
2016-01-14 16:08:22,045 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.414
2016-01-14 16:08:22,151 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_-1
2016-01-14 16:08:22,186 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:22,186 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:22,237 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.010
2016-01-14 16:08:22,240 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.012
2016-01-14 16:08:22,240 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:22,241 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:22,241 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_'field2'
2016-01-14 16:08:22,276 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:22,276 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:22,334 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-14 16:08:22,349 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-14 16:08:22,350 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:22,350 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:22,351 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:22,376 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:22,378 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,402 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:22,403 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:22,406 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"]
2016-01-14 16:08:22,406 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:22,407 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:22,408 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:22,409 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,409 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:22,430 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:22,436 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:22,436 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:22,436 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:22,450 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001 doesn't exist and is created
2016-01-14 16:08:22,473 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:22,474 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:22,475 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001
2016-01-14 16:08:22,480 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787702436_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:22,498 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:22,500 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:22,503 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:22,503 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:22,503 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001/localmode-log-dir
2016-01-14 16:08:22,504 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001/localmode-log-dir/history.txt.appattempt_1452787702436_0001_000000, maxErrors=10
2016-01-14 16:08:22,505 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:22,505 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787702436_0001_000000, appSubmitTime=1452787702479, launchTime=1452787702480
2016-01-14 16:08:22,511 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:22,517 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:22,519 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:22,519 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:22,521 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:39067
2016-01-14 16:08:22,523 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:22,528 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787702436_0001_000000, startTime=1452787702528
2016-01-14 16:08:22,528 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:22,528 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:22,574 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:22,574 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:22,574 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452787702436_0001, dagName=[757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,592 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,594 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787702436_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001/localmode-log-dir/dag_1452787702436_0001_1.dot
2016-01-14 16:08:22,595 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001/localmode-log-dir/dag_1452787702436_0001_1-tez-dag.pb.txt
2016-01-14 16:08:22,604 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787702436_0001_1
2016-01-14 16:08:22,604 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,605 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22 Running Dag: dag_1452787702436_0001_1
2016-01-14 16:08:22,617 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:22,617 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787702436_0001_1, submitTime=1452787702593
2016-01-14 16:08:22,618 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex F9ACF725E9B042AA9240B898B1897189
2016-01-14 16:08:22,618 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:22,618 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:22,619 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787702436_0001_1, initTime=1452787702617
2016-01-14 16:08:22,619 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702436_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:22,620 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:DAG_STARTED]: dagID=dag_1452787702436_0001_1, startTime=1452787702619
2016-01-14 16:08:22,620 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:22,620 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702436_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:22,620 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: F9ACF725E9B042AA9240B898B1897189 : {C6279ACEA0424821B1D7BC7029B6E7AB={InputName=C6279ACEA0424821B1D7BC7029B6E7AB}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:22,620 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452787702436_0001, dagName=[757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,620 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:22,620 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: C6279ACEA0424821B1D7BC7029B6E7AB, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:22,621 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,621 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,622 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,622 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]. Starting root input initializers: 1
2016-01-14 16:08:22,623 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:22,624 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: C6279ACEA0424821B1D7BC7029B6E7AB on vertex vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,626 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:22,626 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input C6279ACEA0424821B1D7BC7029B6E7AB asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:22,627 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:22,628 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:22,630 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:22,632 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: C6279ACEA0424821B1D7BC7029B6E7AB on vertex vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,632 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:22,632 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {C6279ACEA0424821B1D7BC7029B6E7AB=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:22,633 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] parallelism set to 1
2016-01-14 16:08:22,633 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:22,633 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787702436_0001_1_00, eventCount=1
2016-01-14 16:08:22,633 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,634 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=A329068D94A34F488C59974327D932E8, vertexId=vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:22,634 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=A329068D94A34F488C59974327D932E8, vertexId=vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,635 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=A329068D94A34F488C59974327D932E8, vertexName=F9ACF725E9B042AA9240B898B1897189, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:22,636 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=A329068D94A34F488C59974327D932E8, vertexId=vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:VERTEX_INITIALIZED]: vertexName=F9ACF725E9B042AA9240B898B1897189, vertexId=vertex_1452787702436_0001_1_00, initRequestedTime=1452787702620, initedTime=1452787702637, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:22,637 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:22,637 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] with distanceFromRoot: 0
2016-01-14 16:08:22,637 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:22,638 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in F9ACF725E9B042AA9240B898B1897189
2016-01-14 16:08:22,638 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,638 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787702436_0001_1_00, startRequestedTime=1452787702637, startedTime=1452787702637
2016-01-14 16:08:22,638 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:22,638 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:22,639 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:22,639 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:TASK_STARTED]: vertexName=F9ACF725E9B042AA9240B898B1897189, taskId=task_1452787702436_0001_1_00_000000, scheduledTime=1452787702639, launchTime=1452787702639
2016-01-14 16:08:22,640 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702436_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:22,640 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,640 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field', VertexName: F9ACF725E9B042AA9240B898B1897189, VertexParallelism: 1, TaskAttemptID:attempt_1452787702436_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C6279ACEA0424821B1D7BC7029B6E7AB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A329068D94A34F488C59974327D932E8, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:22,641 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702436_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:22,641 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:22,642 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:22,642 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:22,643 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:22,644 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787702436_0001_00_000001
2016-01-14 16:08:22,644 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:22,644 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787702436_0001, with dag id: dag_1452787702436_0001_1
2016-01-14 16:08:22,646 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787702436_0001_00_000001
2016-01-14 16:08:22,646 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:22,647 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787702436_0001_00_000001, launchTime=1452787702647
2016-01-14 16:08:22,647 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:22,648 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:22,648 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787702436_0001_00_000001
2016-01-14 16:08:22,654 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787702436_0001_1_00_000000_0] to container: [container_1452787702436_0001_00_000001]
2016-01-14 16:08:22,654 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:22,655 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787702436_0001_1_00_000000_0] started. Is using containerId: [container_1452787702436_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:22,656 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:22,656 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=F9ACF725E9B042AA9240B898B1897189, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0, startTime=1452787702655, containerId=container_1452787702436_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787702436_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:22,656 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787702436_0001_00_000001 given task: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,657 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787702436_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,657 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702436_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:22,657 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702436_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:22 Starting to run new task attempt: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,658 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,658 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,658 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:22,658 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:22,658 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:22,658 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:22,658 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:22,658 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD] every.every/(1/1) ...ESULTS.-1_UNKNOWN_'field', VertexName: F9ACF725E9B042AA9240B898B1897189, VertexParallelism: 1, TaskAttemptID:attempt_1452787702436_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=C6279ACEA0424821B1D7BC7029B6E7AB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=A329068D94A34F488C59974327D932E8, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:22,658 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:22,659 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,659 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:22,659 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:22,660 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787702436_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:22,661 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=C6279ACEA0424821B1D7BC7029B6E7AB, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:22,662 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:22,662 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:22,662 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=A329068D94A34F488C59974327D932E8, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:22,662 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,662 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,663 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:22,663 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: A329068D94A34F488C59974327D932E8
2016-01-14 16:08:22,663 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:22,663 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: A329068D94A34F488C59974327D932E8
2016-01-14 16:08:22,669 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:22,670 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,671 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,671 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:22,681 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: F9ACF725E9B042AA9240B898B1897189, ordinal: 0
2016-01-14 16:08:22,681 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F9ACF725E9B042AA9240B898B1897189, mem on start (mb), free: 249, total: 386, max: 672
2016-01-14 16:08:22,682 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:22,682 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:22,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:22,682 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:22,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: A329068D94A34F488C59974327D932E8
2016-01-14 16:08:22,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:22,684 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:22,684 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:22,684 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:22,684 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:22,685 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:22,685 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:22,685 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:22,685 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, C6279ACEA0424821B1D7BC7029B6E7AB, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:22,686 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, A329068D94A34F488C59974327D932E8, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:22,686 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:22,686 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: C6279ACEA0424821B1D7BC7029B6E7AB being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:22,686 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,686 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:22,687 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,686 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:22,687 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:22,687 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:22,688 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,688 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:22,688 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@55f88c89
2016-01-14 16:08:22,690 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@55f88c89
2016-01-14 16:08:22,690 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:22,690 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:22,691 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:22,692 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: C6279ACEA0424821B1D7BC7029B6E7AB
2016-01-14 16:08:22,692 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"], id: A329068D94A34F488C59974327D932E8
2016-01-14 16:08:22,693 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_'field'"]
2016-01-14 16:08:22,693 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:22,694 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:22,694 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: F9ACF725E9B042AA9240B898B1897189, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:22,697 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:22,697 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:22,697 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,698 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787702436_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:22,698 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,699 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: F9ACF725E9B042AA9240B898B1897189, mem on close (mb), free: 248, total: 386, max: 672
2016-01-14 16:08:22 Completed running task attempt: attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,699 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:22,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787702694, Process_Duration=4, Process_End_Time=1452787702698, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:22,700 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:22,701 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,701 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787702436_0001_00_000001
2016-01-14 16:08:22,701 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=F9ACF725E9B042AA9240B898B1897189, taskAttemptId=attempt_1452787702436_0001_1_00_000000_0, startTime=1452787702655, finishTime=1452787702700, timeTaken=45, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787702694, Process_Duration=4, Process_End_Time=1452787702698, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:22,701 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702436_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:22,701 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787702436_0001_1_00_000000_0
2016-01-14 16:08:22,701 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:22,703 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:22,703 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:TASK_FINISHED]: vertexName=F9ACF725E9B042AA9240B898B1897189, taskId=task_1452787702436_0001_1_00_000000, startTime=1452787702655, finishTime=1452787702701, timeTaken=46, status=SUCCEEDED, successfulAttemptID=attempt_1452787702436_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787702694, Process_Duration=4, Process_End_Time=1452787702698, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:22,703 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702436_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:22,704 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:22,704 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] : 1
2016-01-14 16:08:22,704 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,707 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:VERTEX_FINISHED]: vertexName=F9ACF725E9B042AA9240B898B1897189, vertexId=vertex_1452787702436_0001_1_00, initRequestedTime=1452787702620, initedTime=1452787702637, startRequestedTime=1452787702637, startedTime=1452787702637, finishTime=1452787702704, timeTaken=67, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787702694, Process_Duration=4, Process_End_Time=1452787702698, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787702655, firstTasksToStart=[ task_1452787702436_0001_1_00_000000 ], lastTaskFinishTime=1452787702700, lastTasksToFinish=[ task_1452787702436_0001_1_00_000000 ], minTaskDuration=45, maxTaskDuration=45, avgTaskDuration=45.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787702436_0001_1_00_000000 ], longestDurationTasks=[ task_1452787702436_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:22,707 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:22,707 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:22,708 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787702436_0001_00_000001, stoppedTime=1452787702707, exitStatus=0
2016-01-14 16:08:22,708 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:22,708 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:22,708 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787702436_0001_1
2016-01-14 16:08:22,708 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787702436_0001_1
2016-01-14 16:08:22,709 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: A329068D94A34F488C59974327D932E8 for vertex: vertex_1452787702436_0001_1_00 [F9ACF725E9B042AA9240B898B1897189]
2016-01-14 16:08:22,710 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:22,711 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:22,712 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787702436_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:22,712 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787702436_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:22,713 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787702436_0001_00_000001, Exiting
2016-01-14 16:08:22,713 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787702436_0001_00_000001
2016-01-14 16:08:22,713 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787702436_0001_00_000001
2016-01-14 16:08:22,715 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787702436_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:22,715 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787702436_0001_00_000001 completed successfully
2016-01-14 16:08:22,719 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787702436_0001_1, queueSize=0
2016-01-14 16:08:22,719 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:22,720 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702436_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787702436_0001_1, startTime=1452787702619, finishTime=1452787702718, timeTaken=99, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=132, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787702694, Process_Duration=4, Process_End_Time=1452787702698, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:22,720 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787702436_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:22,721 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702436_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:22,721 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787702436_0001_00_000001
2016-01-14 16:08:22,721 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702436_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:22 Completed Dag: dag_1452787702436_0001_1
2016-01-14 16:08:22,722 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787702436_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:22,722 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787702436_0001_1_post
2016-01-14 16:08:22,722 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:22,723 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:22,728 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_'field', applicationId=application_1452787702436_0001
2016-01-14 16:08:22,732 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:22,732 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:22,732 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:22,732 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:22,732 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:22,733 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:22,733 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:22,734 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:22,734 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:22,734 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:22,735 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:22,735 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:22,735 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:22,740 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/757F55ED3C30456C9B37D0D33DF15509/AF90A0A508B1436783E90AE7D4EEAAFD/.tez/application_1452787702436_0001
2016-01-14 16:08:22,741 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.339
2016-01-14 16:08:22,819 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_'field'
2016-01-14 16:08:22,851 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:22,851 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:22,891 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.013
2016-01-14 16:08:22,903 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 16:08:22,904 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:22,904 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:22,904 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:22,920 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:22,920 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:22,934 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:22,934 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:22,935 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"]
2016-01-14 16:08:22,935 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:22,936 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:22,936 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:22,937 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:22,937 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:22,955 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:22,960 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:22,961 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:22,961 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:22,970 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001 doesn't exist and is created
2016-01-14 16:08:22,988 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:22,989 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:22,989 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001
2016-01-14 16:08:22,992 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787702961_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:23,003 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:23,004 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:23,006 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:23,006 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:23,006 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001/localmode-log-dir
2016-01-14 16:08:23,006 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001/localmode-log-dir/history.txt.appattempt_1452787702961_0001_000000, maxErrors=10
2016-01-14 16:08:23,006 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:23,006 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787702961_0001_000000, appSubmitTime=1452787702992, launchTime=1452787702992
2016-01-14 16:08:23,012 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:23,014 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:23,015 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:23,015 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:23,016 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:46559
2016-01-14 16:08:23,018 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:23,021 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787702961_0001_000000, startTime=1452787703021
2016-01-14 16:08:23,021 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:23,021 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:23,089 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:23,089 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:23,089 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452787702961_0001, dagName=[7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:23,108 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:23,110 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787702961_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001/localmode-log-dir/dag_1452787702961_0001_1.dot
2016-01-14 16:08:23,111 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001/localmode-log-dir/dag_1452787702961_0001_1-tez-dag.pb.txt
2016-01-14 16:08:23,121 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787702961_0001_1
2016-01-14 16:08:23,121 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,121 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:23 Running Dag: dag_1452787702961_0001_1
2016-01-14 16:08:23,133 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787702961_0001_1, submitTime=1452787703109
2016-01-14 16:08:23,133 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:23,134 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AD9101F7E6E148E79DDC3A1C5B0E72DD
2016-01-14 16:08:23,134 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:23,134 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787702961_0001_1, initTime=1452787703133
2016-01-14 16:08:23,134 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:23,135 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702961_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:23,136 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:DAG_STARTED]: dagID=dag_1452787702961_0001_1, startTime=1452787703136
2016-01-14 16:08:23,136 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452787702961_0001, dagName=[7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:23,136 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:23,136 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:23,137 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702961_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:23,137 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AD9101F7E6E148E79DDC3A1C5B0E72DD : {D2B1B60D5C304176A1B742EEF149619C={InputName=D2B1B60D5C304176A1B742EEF149619C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:23,137 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: D2B1B60D5C304176A1B742EEF149619C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:23,137 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,137 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,137 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,138 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]. Starting root input initializers: 1
2016-01-14 16:08:23,138 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:23,138 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: D2B1B60D5C304176A1B742EEF149619C on vertex vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,141 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:23,141 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input D2B1B60D5C304176A1B742EEF149619C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:23,141 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:23,142 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:23,144 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:23,145 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: D2B1B60D5C304176A1B742EEF149619C on vertex vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,145 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {D2B1B60D5C304176A1B742EEF149619C=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] parallelism set to 1
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:23,146 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787702961_0001_1_00, eventCount=1
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=23574803263E4708AA94BCD11CCFDB70, vertexId=vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:23,146 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=23574803263E4708AA94BCD11CCFDB70, vertexId=vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,148 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=23574803263E4708AA94BCD11CCFDB70, vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:23,148 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=23574803263E4708AA94BCD11CCFDB70, vertexId=vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,149 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:23,149 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, vertexId=vertex_1452787702961_0001_1_00, initRequestedTime=1452787703137, initedTime=1452787703149, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:23,149 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] with distanceFromRoot: 0
2016-01-14 16:08:23,150 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:23,150 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AD9101F7E6E148E79DDC3A1C5B0E72DD
2016-01-14 16:08:23,150 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,150 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:23,151 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787702961_0001_1_00, startRequestedTime=1452787703150, startedTime=1452787703150
2016-01-14 16:08:23,151 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:23,152 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:23,152 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:TASK_STARTED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, taskId=task_1452787702961_0001_1_00_000000, scheduledTime=1452787703151, launchTime=1452787703151
2016-01-14 16:08:23,152 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702961_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:23,152 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,153 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, VertexName: AD9101F7E6E148E79DDC3A1C5B0E72DD, VertexParallelism: 1, TaskAttemptID:attempt_1452787702961_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D2B1B60D5C304176A1B742EEF149619C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=23574803263E4708AA94BCD11CCFDB70, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:23,153 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702961_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:23,153 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:23,154 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:23,154 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:23,155 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:23,155 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787702961_0001_00_000001
2016-01-14 16:08:23,155 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:23,157 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787702961_0001_00_000001
2016-01-14 16:08:23,157 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:23,158 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:23,158 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:23,159 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787702961_0001_00_000001, launchTime=1452787703158
2016-01-14 16:08:23,160 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787702961_0001_00_000001
2016-01-14 16:08:23,160 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787702961_0001_1_00_000000_0] to container: [container_1452787702961_0001_00_000001]
2016-01-14 16:08:23,161 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:23,161 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787702961_0001_00_000001 given task: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,161 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787702961_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,161 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787702961_0001_1_00_000000_0] started. Is using containerId: [container_1452787702961_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:23,161 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0, startTime=1452787703161, containerId=container_1452787702961_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787702961_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:23,162 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702961_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:23,162 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702961_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:23,162 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:23 Starting to run new task attempt: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,163 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,163 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,163 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:23,163 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:23,163 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:23,163 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:23,164 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:23,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA] every.every/(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, VertexName: AD9101F7E6E148E79DDC3A1C5B0E72DD, VertexParallelism: 1, TaskAttemptID:attempt_1452787702961_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D2B1B60D5C304176A1B742EEF149619C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=23574803263E4708AA94BCD11CCFDB70, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:23,164 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:23,165 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,165 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:23,165 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=D2B1B60D5C304176A1B742EEF149619C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:23,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=23574803263E4708AA94BCD11CCFDB70, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:23,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,166 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787702961_0001, with dag id: dag_1452787702961_0001_1
2016-01-14 16:08:23,169 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:23,169 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 23574803263E4708AA94BCD11CCFDB70
2016-01-14 16:08:23,170 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:23,170 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 23574803263E4708AA94BCD11CCFDB70
2016-01-14 16:08:23,168 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787702961_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:23,168 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:23,171 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,172 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,172 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:23,180 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:23,180 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,180 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,189 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:23,189 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 23574803263E4708AA94BCD11CCFDB70
2016-01-14 16:08:23,191 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AD9101F7E6E148E79DDC3A1C5B0E72DD, ordinal: 0
2016-01-14 16:08:23,191 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AD9101F7E6E148E79DDC3A1C5B0E72DD, mem on start (mb), free: 170, total: 386, max: 672
2016-01-14 16:08:23,191 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,191 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:23,192 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:23,192 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:23,193 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:23,194 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:23,194 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:23,194 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:23,195 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:23,195 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:23,196 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:23,196 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 23574803263E4708AA94BCD11CCFDB70, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:23,197 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, D2B1B60D5C304176A1B742EEF149619C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:23,197 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:23,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: D2B1B60D5C304176A1B742EEF149619C being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:23,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,198 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:23,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,198 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:23,199 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:23,199 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:23,199 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,199 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:23,200 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1e871ab4
2016-01-14 16:08:23,202 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1e871ab4
2016-01-14 16:08:23,202 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:23,202 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:23,204 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,205 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: D2B1B60D5C304176A1B742EEF149619C
2016-01-14 16:08:23,206 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"], id: 23574803263E4708AA94BCD11CCFDB70
2016-01-14 16:08:23,206 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_RESULTS"]
2016-01-14 16:08:23,207 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,207 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:23,208 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AD9101F7E6E148E79DDC3A1C5B0E72DD, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:23,211 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:23,212 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:23,213 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,213 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787702961_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:23,215 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,215 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AD9101F7E6E148E79DDC3A1C5B0E72DD, mem on close (mb), free: 169, total: 386, max: 672
2016-01-14 16:08:23 Completed running task attempt: attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,217 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:23,219 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787703209, Process_Duration=6, Process_End_Time=1452787703215, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:23,219 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:23,220 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,220 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, taskAttemptId=attempt_1452787702961_0001_1_00_000000_0, startTime=1452787703161, finishTime=1452787703219, timeTaken=58, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703209, Process_Duration=6, Process_End_Time=1452787703215, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,220 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787702961_0001_00_000001
2016-01-14 16:08:23,220 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787702961_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:23,220 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787702961_0001_1_00_000000_0
2016-01-14 16:08:23,221 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:23,221 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:TASK_FINISHED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, taskId=task_1452787702961_0001_1_00_000000, startTime=1452787703161, finishTime=1452787703220, timeTaken=59, status=SUCCEEDED, successfulAttemptID=attempt_1452787702961_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703209, Process_Duration=6, Process_End_Time=1452787703215, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,222 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:23,223 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:23,224 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787702961_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:23,225 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] : 1
2016-01-14 16:08:23,225 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,227 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:23,228 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:VERTEX_FINISHED]: vertexName=AD9101F7E6E148E79DDC3A1C5B0E72DD, vertexId=vertex_1452787702961_0001_1_00, initRequestedTime=1452787703137, initedTime=1452787703149, startRequestedTime=1452787703150, startedTime=1452787703150, finishTime=1452787703225, timeTaken=75, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703209, Process_Duration=6, Process_End_Time=1452787703215, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787703161, firstTasksToStart=[ task_1452787702961_0001_1_00_000000 ], lastTaskFinishTime=1452787703219, lastTasksToFinish=[ task_1452787702961_0001_1_00_000000 ], minTaskDuration=58, maxTaskDuration=58, avgTaskDuration=58.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787702961_0001_1_00_000000 ], longestDurationTasks=[ task_1452787702961_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:23,228 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:23,228 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:23,228 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787702961_0001_00_000001, stoppedTime=1452787703228, exitStatus=0
2016-01-14 16:08:23,228 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:23,228 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:23,229 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:23,229 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787702961_0001_1
2016-01-14 16:08:23,229 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787702961_0001_1
2016-01-14 16:08:23,229 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 23574803263E4708AA94BCD11CCFDB70 for vertex: vertex_1452787702961_0001_1_00 [AD9101F7E6E148E79DDC3A1C5B0E72DD]
2016-01-14 16:08:23,232 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787702961_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:23,232 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787702961_0001_00_000001: 12 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:23,232 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787702961_0001_00_000001, Exiting
2016-01-14 16:08:23,232 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787702961_0001_00_000001
2016-01-14 16:08:23,232 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787702961_0001_00_000001
2016-01-14 16:08:23,234 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787702961_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:23,235 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787702961_0001_00_000001 completed successfully
2016-01-14 16:08:23,241 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787702961_0001_1, queueSize=0
2016-01-14 16:08:23,241 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:23,242 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787702961_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787702961_0001_1, startTime=1452787703136, finishTime=1452787703240, timeTaken=104, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=404750336, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703209, Process_Duration=6, Process_End_Time=1452787703215, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,242 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787702961_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:23,243 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787702961_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:23,243 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787702961_0001_00_000001
2016-01-14 16:08:23,243 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787702961_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:23 Completed Dag: dag_1452787702961_0001_1
2016-01-14 16:08:23,243 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787702961_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:23,244 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787702961_0001_1_post
2016-01-14 16:08:23,244 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,244 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:23,250 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.-1_UNKNOWN_RESULTS, applicationId=application_1452787702961_0001
2016-01-14 16:08:23,251 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:23,251 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:23,252 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:23,252 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:23,252 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:23,252 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:23,253 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:23,253 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:23,253 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:23,254 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:23,254 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:23,254 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:23,254 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:23,258 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/7C427AC2A21B4F249A7E1AE7583815C0/CB75E51A5F5A411EB1C85C0D6C72B0AA/.tez/application_1452787702961_0001
2016-01-14 16:08:23,258 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.324
2016-01-14 16:08:23,342 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_RESULTS
2016-01-14 16:08:23,374 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:23,375 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:23,438 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.017
2016-01-14 16:08:23,450 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 16:08:23,451 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:23,451 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:23,451 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:23,474 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:23,475 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,490 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:23,490 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,490 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"]
2016-01-14 16:08:23,491 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:23,491 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:23,492 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:23,493 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,493 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:23,508 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:23,512 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:23,513 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:23,514 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:23,523 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001 doesn't exist and is created
2016-01-14 16:08:23,540 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:23,540 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:23,541 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001
2016-01-14 16:08:23,544 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787703513_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:23,558 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:23,560 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:23,562 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:23,562 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:23,563 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001/localmode-log-dir
2016-01-14 16:08:23,564 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001/localmode-log-dir/history.txt.appattempt_1452787703513_0001_000000, maxErrors=10
2016-01-14 16:08:23,565 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:23,565 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787703513_0001_000000, appSubmitTime=1452787703543, launchTime=1452787703543
2016-01-14 16:08:23,569 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:23,571 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:23,573 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:57906
2016-01-14 16:08:23,574 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:23,574 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:23,575 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:23,577 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:23,577 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787703513_0001_000000, startTime=1452787703577
2016-01-14 16:08:23,578 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:23,641 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:23,641 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:23,641 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452787703513_0001, dagName=[BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,658 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,659 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787703513_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001/localmode-log-dir/dag_1452787703513_0001_1.dot
2016-01-14 16:08:23,660 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001/localmode-log-dir/dag_1452787703513_0001_1-tez-dag.pb.txt
2016-01-14 16:08:23,667 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787703513_0001_1
2016-01-14 16:08:23,667 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,667 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23 Running Dag: dag_1452787703513_0001_1
2016-01-14 16:08:23,679 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:23,679 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787703513_0001_1, submitTime=1452787703658
2016-01-14 16:08:23,679 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex C0B37FB3D5E74F77ABCEC04AC87E6BC5
2016-01-14 16:08:23,680 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:23,680 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:23,680 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787703513_0001_1, initTime=1452787703679
2016-01-14 16:08:23,680 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703513_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:23,681 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:DAG_STARTED]: dagID=dag_1452787703513_0001_1, startTime=1452787703681
2016-01-14 16:08:23,681 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:23,681 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703513_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:23,681 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: C0B37FB3D5E74F77ABCEC04AC87E6BC5 : {9961698B067B43959E10E6032AF27F90={InputName=9961698B067B43959E10E6032AF27F90}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:23,682 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 9961698B067B43959E10E6032AF27F90, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:23,682 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,682 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,682 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,681 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:23,682 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]. Starting root input initializers: 1
2016-01-14 16:08:23,683 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:23,683 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 9961698B067B43959E10E6032AF27F90 on vertex vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,683 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452787703513_0001, dagName=[BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,685 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:23,685 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 9961698B067B43959E10E6032AF27F90 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:23,685 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:23,685 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:23,687 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:23,687 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 9961698B067B43959E10E6032AF27F90 on vertex vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,688 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:23,688 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {9961698B067B43959E10E6032AF27F90=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:23,688 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] parallelism set to 1
2016-01-14 16:08:23,688 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:23,688 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787703513_0001_1_00, eventCount=1
2016-01-14 16:08:23,689 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,689 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=C893FC346A524C2DA354F6343AAC3ACE, vertexId=vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:23,689 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=C893FC346A524C2DA354F6343AAC3ACE, vertexId=vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,691 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=C893FC346A524C2DA354F6343AAC3ACE, vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:23,691 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=C893FC346A524C2DA354F6343AAC3ACE, vertexId=vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,692 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:23,693 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:VERTEX_INITIALIZED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, vertexId=vertex_1452787703513_0001_1_00, initRequestedTime=1452787703681, initedTime=1452787703692, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:23,693 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] with distanceFromRoot: 0
2016-01-14 16:08:23,693 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:23,693 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in C0B37FB3D5E74F77ABCEC04AC87E6BC5
2016-01-14 16:08:23,693 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,694 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:23,694 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787703513_0001_1_00, startRequestedTime=1452787703693, startedTime=1452787703693
2016-01-14 16:08:23,695 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:23,695 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:23,696 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:TASK_STARTED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, taskId=task_1452787703513_0001_1_00_000000, scheduledTime=1452787703695, launchTime=1452787703695
2016-01-14 16:08:23,696 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703513_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:23,696 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,696 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, VertexName: C0B37FB3D5E74F77ABCEC04AC87E6BC5, VertexParallelism: 1, TaskAttemptID:attempt_1452787703513_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=9961698B067B43959E10E6032AF27F90, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C893FC346A524C2DA354F6343AAC3ACE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:23,696 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703513_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:23,697 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:23,697 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:23,698 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:23,698 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:23,698 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787703513_0001_00_000001
2016-01-14 16:08:23,698 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:23,700 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787703513_0001_00_000001
2016-01-14 16:08:23,701 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:23,701 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:23,701 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:23,702 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787703513_0001_00_000001, launchTime=1452787703701
2016-01-14 16:08:23,702 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787703513_0001_00_000001
2016-01-14 16:08:23,703 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787703513_0001_1_00_000000_0] to container: [container_1452787703513_0001_00_000001]
2016-01-14 16:08:23,704 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:23,704 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787703513_0001_1_00_000000_0] started. Is using containerId: [container_1452787703513_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:23,704 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0, startTime=1452787703704, containerId=container_1452787703513_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787703513_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:23,704 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:23,704 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703513_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:23,705 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703513_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:23,705 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787703513_0001_00_000001 given task: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,705 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787703513_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23 Starting to run new task attempt: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,706 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,706 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,707 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:23,707 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:23,707 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:23,707 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:23,708 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:23,709 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787703513_0001, with dag id: dag_1452787703513_0001_1
2016-01-14 16:08:23,709 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE] every.every/(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, VertexName: C0B37FB3D5E74F77ABCEC04AC87E6BC5, VertexParallelism: 1, TaskAttemptID:attempt_1452787703513_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=9961698B067B43959E10E6032AF27F90, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C893FC346A524C2DA354F6343AAC3ACE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:23,709 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:23,710 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,710 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:23,710 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,711 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,711 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=C893FC346A524C2DA354F6343AAC3ACE, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:23,713 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:23,714 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=9961698B067B43959E10E6032AF27F90, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:23,714 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: C893FC346A524C2DA354F6343AAC3ACE
2016-01-14 16:08:23,714 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:23,714 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: C893FC346A524C2DA354F6343AAC3ACE
2016-01-14 16:08:23,715 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:23,715 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:23,715 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,717 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,723 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:23,723 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,723 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,725 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787703513_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:23,731 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: C0B37FB3D5E74F77ABCEC04AC87E6BC5, ordinal: 0
2016-01-14 16:08:23,732 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C0B37FB3D5E74F77ABCEC04AC87E6BC5, mem on start (mb), free: 304, total: 384, max: 672
2016-01-14 16:08:23,732 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:23,732 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:23,732 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:23,736 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:23,736 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: C893FC346A524C2DA354F6343AAC3ACE
2016-01-14 16:08:23,736 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:23,737 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:23,737 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:23,737 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:23,738 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:23,738 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:23,738 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:23,738 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:23,739 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, C893FC346A524C2DA354F6343AAC3ACE, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:23,739 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 9961698B067B43959E10E6032AF27F90, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:23,739 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:23,739 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 9961698B067B43959E10E6032AF27F90 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:23,739 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,740 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:23,740 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,741 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:23,741 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:23,741 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:23,742 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,742 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:23,743 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@19dfe5aa
2016-01-14 16:08:23,743 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@19dfe5aa
2016-01-14 16:08:23,744 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:23,744 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:23,746 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,746 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 9961698B067B43959E10E6032AF27F90
2016-01-14 16:08:23,747 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"], id: C893FC346A524C2DA354F6343AAC3ACE
2016-01-14 16:08:23,747 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_UNKNOWN_ALL"]
2016-01-14 16:08:23,747 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,748 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:23,748 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: C0B37FB3D5E74F77ABCEC04AC87E6BC5, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:23,751 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:23,751 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:23,752 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,752 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787703513_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:23,753 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,753 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: C0B37FB3D5E74F77ABCEC04AC87E6BC5, mem on close (mb), free: 302, total: 384, max: 672
2016-01-14 16:08:23 Completed running task attempt: attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,755 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:23,756 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787703748, Process_Duration=5, Process_End_Time=1452787703753, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:23,756 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, taskAttemptId=attempt_1452787703513_0001_1_00_000000_0, startTime=1452787703704, finishTime=1452787703756, timeTaken=52, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703748, Process_Duration=5, Process_End_Time=1452787703753, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,756 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:23,757 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703513_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:23,757 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:23,760 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,760 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787703513_0001_1_00_000000_0
2016-01-14 16:08:23,760 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:23,761 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787703513_0001_00_000001
2016-01-14 16:08:23,761 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:TASK_FINISHED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, taskId=task_1452787703513_0001_1_00_000000, startTime=1452787703704, finishTime=1452787703761, timeTaken=57, status=SUCCEEDED, successfulAttemptID=attempt_1452787703513_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703748, Process_Duration=5, Process_End_Time=1452787703753, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,762 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703513_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:23,762 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] : 1
2016-01-14 16:08:23,762 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,762 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:23,763 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:23,764 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:VERTEX_FINISHED]: vertexName=C0B37FB3D5E74F77ABCEC04AC87E6BC5, vertexId=vertex_1452787703513_0001_1_00, initRequestedTime=1452787703681, initedTime=1452787703692, startRequestedTime=1452787703693, startedTime=1452787703693, finishTime=1452787703762, timeTaken=69, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703748, Process_Duration=5, Process_End_Time=1452787703753, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787703704, firstTasksToStart=[ task_1452787703513_0001_1_00_000000 ], lastTaskFinishTime=1452787703756, lastTasksToFinish=[ task_1452787703513_0001_1_00_000000 ], minTaskDuration=52, maxTaskDuration=52, avgTaskDuration=52.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787703513_0001_1_00_000000 ], longestDurationTasks=[ task_1452787703513_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:23,764 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:23,764 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:23,764 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787703513_0001_00_000001, stoppedTime=1452787703764, exitStatus=0
2016-01-14 16:08:23,764 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:23,765 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:23,765 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:23,765 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787703513_0001_1
2016-01-14 16:08:23,765 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787703513_0001_1
2016-01-14 16:08:23,765 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: C893FC346A524C2DA354F6343AAC3ACE for vertex: vertex_1452787703513_0001_1_00 [C0B37FB3D5E74F77ABCEC04AC87E6BC5]
2016-01-14 16:08:23,772 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787703513_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:23,772 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787703513_0001_00_000001: 11 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:23,772 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787703513_0001_00_000001, Exiting
2016-01-14 16:08:23,772 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787703513_0001_00_000001
2016-01-14 16:08:23,772 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787703513_0001_00_000001
2016-01-14 16:08:23,775 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787703513_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:23,775 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787703513_0001_00_000001 completed successfully
2016-01-14 16:08:23,776 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787703513_0001_1, queueSize=0
2016-01-14 16:08:23,776 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:23,776 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703513_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787703513_0001_1, startTime=1452787703681, finishTime=1452787703774, timeTaken=93, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787703748, Process_Duration=5, Process_End_Time=1452787703753, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:23,776 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787703513_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:23,777 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703513_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:23,777 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703513_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:23,777 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787703513_0001_00_000001
2016-01-14 16:08:23 Completed Dag: dag_1452787703513_0001_1
2016-01-14 16:08:23,778 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787703513_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:23,778 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787703513_0001_1_post
2016-01-14 16:08:23,778 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:23,779 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:23,788 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.-1_UNKNOWN_ALL, applicationId=application_1452787703513_0001
2016-01-14 16:08:23,790 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:23,791 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:23,791 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:23,791 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:23,791 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:23,791 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:23,792 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:23,792 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:23,793 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:23,793 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:23,793 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:23,794 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:23,794 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:23,799 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/BDC6EAC9AEFA470396248EC7F9F7A04C/FEBE87482A8E41CF9197B12986B921AE/.tez/application_1452787703513_0001
2016-01-14 16:08:23,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.309
2016-01-14 16:08:23,870 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_UNKNOWN_ALL
2016-01-14 16:08:23,876 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:23,876 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:23,900 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:23,900 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:23,935 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 16:08:23,942 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:08:23,942 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:23,943 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:23,943 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:23,956 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:23,957 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:23,967 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:23,967 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:23,968 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"]
2016-01-14 16:08:23,968 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:23,968 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:23,969 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:23,969 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:23,970 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:23,982 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:23,987 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:23,987 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:23,987 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:23,997 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001 doesn't exist and is created
2016-01-14 16:08:24,013 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:24,013 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:24,014 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001
2016-01-14 16:08:24,017 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787703987_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:24,028 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:24,029 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:24,031 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:24,032 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:24,032 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001/localmode-log-dir
2016-01-14 16:08:24,032 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001/localmode-log-dir/history.txt.appattempt_1452787703987_0001_000000, maxErrors=10
2016-01-14 16:08:24,032 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:24,032 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787703987_0001_000000, appSubmitTime=1452787704017, launchTime=1452787704017
2016-01-14 16:08:24,037 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:24,038 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:24,038 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:37634
2016-01-14 16:08:24,043 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:24,043 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:24,043 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:24,046 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787703987_0001_000000, startTime=1452787704046
2016-01-14 16:08:24,046 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:24,046 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:24,114 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:24,114 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:24,114 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452787703987_0001, dagName=[91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24,131 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24,133 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787703987_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001/localmode-log-dir/dag_1452787703987_0001_1.dot
2016-01-14 16:08:24,133 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001/localmode-log-dir/dag_1452787703987_0001_1-tez-dag.pb.txt
2016-01-14 16:08:24,138 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787703987_0001_1
2016-01-14 16:08:24,139 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,139 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24 Running Dag: dag_1452787703987_0001_1
2016-01-14 16:08:24,150 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787703987_0001_1, submitTime=1452787704132
2016-01-14 16:08:24,150 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:24,150 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex AE2FE1DCE73F46E482010D121E9D83C5
2016-01-14 16:08:24,150 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:24,151 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787703987_0001_1, initTime=1452787704150
2016-01-14 16:08:24,151 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:24,151 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703987_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:24,152 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:24,152 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:DAG_STARTED]: dagID=dag_1452787703987_0001_1, startTime=1452787704152
2016-01-14 16:08:24,152 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:24,153 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703987_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:24,153 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452787703987_0001, dagName=[91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24,153 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: AE2FE1DCE73F46E482010D121E9D83C5 : {CF866D1324204536882DCDB2B4F43721={InputName=CF866D1324204536882DCDB2B4F43721}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:24,153 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: CF866D1324204536882DCDB2B4F43721, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:24,153 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,153 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,153 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,154 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]. Starting root input initializers: 1
2016-01-14 16:08:24,154 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:24,156 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: CF866D1324204536882DCDB2B4F43721 on vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,158 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:24,158 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input CF866D1324204536882DCDB2B4F43721 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:24,159 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:24,159 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:24,161 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:24,162 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: CF866D1324204536882DCDB2B4F43721 on vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,162 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:24,163 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {CF866D1324204536882DCDB2B4F43721=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:24,163 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] parallelism set to 1
2016-01-14 16:08:24,163 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:24,163 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787703987_0001_1_00, eventCount=1
2016-01-14 16:08:24,163 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,164 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=6756EE6DDA0B4559A32A459AFCF3A41E, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:24,164 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=6756EE6DDA0B4559A32A459AFCF3A41E, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,166 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=6756EE6DDA0B4559A32A459AFCF3A41E, vertexName=AE2FE1DCE73F46E482010D121E9D83C5, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:24,166 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=6756EE6DDA0B4559A32A459AFCF3A41E, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,167 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:24,168 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:VERTEX_INITIALIZED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, vertexId=vertex_1452787703987_0001_1_00, initRequestedTime=1452787704153, initedTime=1452787704167, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:24,168 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] with distanceFromRoot: 0
2016-01-14 16:08:24,168 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:24,168 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in AE2FE1DCE73F46E482010D121E9D83C5
2016-01-14 16:08:24,169 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,169 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:24,169 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787703987_0001_1_00, startRequestedTime=1452787704168, startedTime=1452787704168
2016-01-14 16:08:24,170 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:24,170 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:24,171 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:TASK_STARTED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, taskId=task_1452787703987_0001_1_00_000000, scheduledTime=1452787704170, launchTime=1452787704170
2016-01-14 16:08:24,171 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787703987_0001, with dag id: dag_1452787703987_0001_1
2016-01-14 16:08:24,171 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703987_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:24,172 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,172 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1, VertexName: AE2FE1DCE73F46E482010D121E9D83C5, VertexParallelism: 1, TaskAttemptID:attempt_1452787703987_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CF866D1324204536882DCDB2B4F43721, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6756EE6DDA0B4559A32A459AFCF3A41E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:24,173 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703987_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:24,173 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:24,174 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:24,175 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:24,176 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:24,176 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787703987_0001_00_000001
2016-01-14 16:08:24,177 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703987_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:24,178 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787703987_0001_00_000001
2016-01-14 16:08:24,178 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:24,179 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703987_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:24,179 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787703987_0001_00_000001, launchTime=1452787704179
2016-01-14 16:08:24,179 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:24,180 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787703987_0001_00_000001
2016-01-14 16:08:24,181 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787703987_0001_1_00_000000_0] to container: [container_1452787703987_0001_00_000001]
2016-01-14 16:08:24,181 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703987_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:24,181 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787703987_0001_00_000001 given task: attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,181 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787703987_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,182 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787703987_0001_1_00_000000_0] started. Is using containerId: [container_1452787703987_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:24 Starting to run new task attempt: attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,182 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,182 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,182 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:24,182 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:24,183 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:24,183 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:24,183 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:24,183 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:24,184 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9] every.every/(1/1) ...eld'_RESULTS.-1_VALUES_-1, VertexName: AE2FE1DCE73F46E482010D121E9D83C5, VertexParallelism: 1, TaskAttemptID:attempt_1452787703987_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=CF866D1324204536882DCDB2B4F43721, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=6756EE6DDA0B4559A32A459AFCF3A41E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:24,184 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, taskAttemptId=attempt_1452787703987_0001_1_00_000000_0, startTime=1452787704181, containerId=container_1452787703987_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787703987_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:24,184 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:24,185 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703987_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:24,185 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703987_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:24,185 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,185 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:24,186 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,186 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,186 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=CF866D1324204536882DCDB2B4F43721, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:24,187 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=6756EE6DDA0B4559A32A459AFCF3A41E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:24,187 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:24,187 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:24,187 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,188 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 6756EE6DDA0B4559A32A459AFCF3A41E
2016-01-14 16:08:24,188 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:24,188 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 6756EE6DDA0B4559A32A459AFCF3A41E
2016-01-14 16:08:24,188 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,189 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:24,193 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787703987_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:24,193 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:24,194 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,194 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,202 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: AE2FE1DCE73F46E482010D121E9D83C5, ordinal: 0
2016-01-14 16:08:24,202 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AE2FE1DCE73F46E482010D121E9D83C5, mem on start (mb), free: 228, total: 384, max: 672
2016-01-14 16:08:24,202 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,202 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:24,203 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:24,202 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:24,203 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 6756EE6DDA0B4559A32A459AFCF3A41E
2016-01-14 16:08:24,203 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:24,204 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:24,204 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:24,204 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:24,205 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:24,205 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:24,206 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:24,207 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:24,207 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 6756EE6DDA0B4559A32A459AFCF3A41E, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:24,207 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, CF866D1324204536882DCDB2B4F43721, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:24,208 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:24,208 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,208 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:24,208 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,208 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: CF866D1324204536882DCDB2B4F43721 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:24,209 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:24,209 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:24,209 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:24,209 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,210 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:24,211 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@27daa766
2016-01-14 16:08:24,212 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,212 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@27daa766
2016-01-14 16:08:24,212 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:24,212 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:24,213 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,213 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"], id: 6756EE6DDA0B4559A32A459AFCF3A41E
2016-01-14 16:08:24,213 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_-1"]
2016-01-14 16:08:24,213 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,213 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:24,214 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: AE2FE1DCE73F46E482010D121E9D83C5, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:24,215 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,218 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,219 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,222 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:24,222 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:24,223 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787703987_0001_1_00_000000_0
2016-01-14 16:08:24,224 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787703987_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:24,226 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787703987_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,233 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=528, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787704214, Process_Duration=11, Process_End_Time=1452787704225, Read_Duration=0, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:24,233 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: AE2FE1DCE73F46E482010D121E9D83C5, mem on close (mb), free: 226, total: 384, max: 672
2016-01-14 16:08:24,234 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=AE2FE1DCE73F46E482010D121E9D83C5, index=0
2016-01-14 16:08:24,234 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=AE2FE1DCE73F46E482010D121E9D83C5, sourceVertex=CF866D1324204536882DCDB2B4F43721
2016-01-14 16:08:24,234 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=AE2FE1DCE73F46E482010D121E9D83C5, sourceVertex=6756EE6DDA0B4559A32A459AFCF3A41E
2016-01-14 16:08:24,235 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787703987_0001_00_000001
2016-01-14 16:08:24,235 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787703987_0001_00_000001
2016-01-14 16:08:24,235 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, taskAttemptId=attempt_1452787703987_0001_1_00_000000_0, startTime=1452787704181, finishTime=1452787704233, timeTaken=52, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=528, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787704214, Process_Duration=11, Process_End_Time=1452787704225, Read_Duration=0, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:24,236 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703987_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:24,237 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787703987_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:24,237 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787703987_0001_00_000001 completed but with errors
2016-01-14 16:08:24,236 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:24,237 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787703987_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:24,239 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:TASK_FINISHED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, taskId=task_1452787703987_0001_1_00_000000, startTime=1452787704181, finishTime=1452787704239, timeTaken=58, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:24,240 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787703987_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:24,240 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:24,240 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:24,242 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(686)) - Container container_1452787703987_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:24,242 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:24,245 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787703987_0001_00_000001, stoppedTime=1452787704242, exitStatus=1
2016-01-14 16:08:24,245 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787703987_0001_00_000001 transitioned from RUNNING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:24,245 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] : 1
2016-01-14 16:08:24,245 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] because task failed: task_1452787703987_0001_1_00_000000
2016-01-14 16:08:24,246 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:24,247 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:24,247 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,248 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=6756EE6DDA0B4559A32A459AFCF3A41E, vertexId=vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,253 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:24,254 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:VERTEX_FINISHED]: vertexName=AE2FE1DCE73F46E482010D121E9D83C5, vertexId=vertex_1452787703987_0001_1_00, initRequestedTime=1452787704153, initedTime=1452787704167, startRequestedTime=1452787704168, startedTime=1452787704168, finishTime=1452787704252, timeTaken=84, status=FAILED, diagnostics=Task failed, taskId=task_1452787703987_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787704181, firstTasksToStart=[ task_1452787703987_0001_1_00_000000 ], lastTaskFinishTime=1452787704233, lastTasksToFinish=[ task_1452787703987_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:24,254 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:24,255 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787703987_0001_1_00_000000_0 failed: true container: container_1452787703987_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:24,255 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787703987_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:24,258 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:24,258 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:24,258 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787703987_0001_1
2016-01-14 16:08:24,258 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 6756EE6DDA0B4559A32A459AFCF3A41E for vertex: vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5]
2016-01-14 16:08:24,259 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787703987_0001_1, queueSize=0
2016-01-14 16:08:24,259 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:24,260 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787703987_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787703987_0001_1, startTime=1452787704152, finishTime=1452787704259, timeTaken=107, status=FAILED, diagnostics=Vertex failed, vertexName=AE2FE1DCE73F46E482010D121E9D83C5, vertexId=vertex_1452787703987_0001_1_00, diagnostics=[Task failed, taskId=task_1452787703987_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787703987_0001_1_00 [AE2FE1DCE73F46E482010D121E9D83C5] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:24,260 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787703987_0001_1 finished with state: FAILED
2016-01-14 16:08:24,261 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787703987_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:24 Completed Dag: dag_1452787703987_0001_1
2016-01-14 16:08:24,261 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787703987_0001_1, dagState=FAILED
2016-01-14 16:08:24,262 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787703987_0001_1_post
2016-01-14 16:08:24,262 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,262 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:24,268 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...eld'_RESULTS.-1_VALUES_-1, applicationId=application_1452787703987_0001
2016-01-14 16:08:24,272 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:24,272 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:24,273 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:24,273 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:24,273 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:24,274 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:24,274 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:24,276 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:24,276 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:24,277 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:24,277 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:24,277 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:24,278 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:24,282 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/91238EE617E946248B3CBFF05F8F6CD6/CCEB48347CE847088856B28C1262ECC9/.tez/application_1452787703987_0001
2016-01-14 16:08:24,282 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 16:08:24,282 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...eld'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24,283 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 16:08:24,283 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.316
2016-01-14 16:08:24,284 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_-1
2016-01-14 16:08:24,313 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:24,314 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:24,349 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.007
2016-01-14 16:08:24,354 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.012
2016-01-14 16:08:24,354 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:24,355 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:24,355 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_'field2'
2016-01-14 16:08:24,376 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:24,376 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:24,414 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 16:08:24,421 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:08:24,422 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:24,422 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:24,422 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:24,436 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:24,436 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,447 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:24,447 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,448 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"]
2016-01-14 16:08:24,449 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:24,450 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:24,450 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:24,452 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,452 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:24,464 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:24,468 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:24,469 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:24,469 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:24,478 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001 doesn't exist and is created
2016-01-14 16:08:24,494 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:24,494 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:24,495 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001
2016-01-14 16:08:24,498 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787704469_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:24,508 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:24,508 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:24,510 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:24,510 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:24,510 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001/localmode-log-dir
2016-01-14 16:08:24,511 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001/localmode-log-dir/history.txt.appattempt_1452787704469_0001_000000, maxErrors=10
2016-01-14 16:08:24,511 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:24,511 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787704469_0001_000000, appSubmitTime=1452787704497, launchTime=1452787704498
2016-01-14 16:08:24,514 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:24,516 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:24,517 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:24,517 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:24,518 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:51639
2016-01-14 16:08:24,523 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:24,525 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787704469_0001_000000, startTime=1452787704525
2016-01-14 16:08:24,525 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:24,525 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:24,595 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:24,595 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:24,595 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452787704469_0001, dagName=[EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,612 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,614 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787704469_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001/localmode-log-dir/dag_1452787704469_0001_1.dot
2016-01-14 16:08:24,615 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001/localmode-log-dir/dag_1452787704469_0001_1-tez-dag.pb.txt
2016-01-14 16:08:24,620 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787704469_0001_1
2016-01-14 16:08:24,620 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,620 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24 Running Dag: dag_1452787704469_0001_1
2016-01-14 16:08:24,623 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:24,623 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:24,633 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787704469_0001_1, submitTime=1452787704613
2016-01-14 16:08:24,633 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:24,636 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex BC0941F7977B4E14B7568F8D72D55606
2016-01-14 16:08:24,636 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:24,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787704469_0001_1, initTime=1452787704636
2016-01-14 16:08:24,637 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:24,638 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704469_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:24,639 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:DAG_STARTED]: dagID=dag_1452787704469_0001_1, startTime=1452787704638
2016-01-14 16:08:24,639 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:24,639 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704469_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:24,640 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: BC0941F7977B4E14B7568F8D72D55606 : {4EDC7B783DBE4289B39B9CC41BC4FD3C={InputName=4EDC7B783DBE4289B39B9CC41BC4FD3C}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:24,640 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 4EDC7B783DBE4289B39B9CC41BC4FD3C, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:24,640 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:24,640 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,640 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,640 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,641 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]. Starting root input initializers: 1
2016-01-14 16:08:24,640 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452787704469_0001, dagName=[EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,643 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:24,644 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 4EDC7B783DBE4289B39B9CC41BC4FD3C on vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,645 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:24,645 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 4EDC7B783DBE4289B39B9CC41BC4FD3C asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:24,646 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:24,646 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:24,648 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:24,649 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 4EDC7B783DBE4289B39B9CC41BC4FD3C on vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,649 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:24,649 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {4EDC7B783DBE4289B39B9CC41BC4FD3C=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:24,650 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] parallelism set to 1
2016-01-14 16:08:24,650 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:24,651 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787704469_0001_1_00, eventCount=1
2016-01-14 16:08:24,651 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,652 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=1931E85EA6F4475DBEB973E7F507C274, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:24,652 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=1931E85EA6F4475DBEB973E7F507C274, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,654 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=1931E85EA6F4475DBEB973E7F507C274, vertexName=BC0941F7977B4E14B7568F8D72D55606, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:24,655 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=1931E85EA6F4475DBEB973E7F507C274, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,657 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:VERTEX_INITIALIZED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, vertexId=vertex_1452787704469_0001_1_00, initRequestedTime=1452787704640, initedTime=1452787704656, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:24,657 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] with distanceFromRoot: 0
2016-01-14 16:08:24,657 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:24,658 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:24,658 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in BC0941F7977B4E14B7568F8D72D55606
2016-01-14 16:08:24,658 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,659 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:24,659 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787704469_0001_1_00, startRequestedTime=1452787704658, startedTime=1452787704658
2016-01-14 16:08:24,660 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:24,660 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:24,661 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:TASK_STARTED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, taskId=task_1452787704469_0001_1_00_000000, scheduledTime=1452787704660, launchTime=1452787704660
2016-01-14 16:08:24,661 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704469_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:24,661 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,662 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS, VertexName: BC0941F7977B4E14B7568F8D72D55606, VertexParallelism: 1, TaskAttemptID:attempt_1452787704469_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4EDC7B783DBE4289B39B9CC41BC4FD3C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1931E85EA6F4475DBEB973E7F507C274, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:24,662 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704469_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:24,662 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:24,665 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787704469_0001, with dag id: dag_1452787704469_0001_1
2016-01-14 16:08:24,668 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:24,668 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:24,668 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:24,669 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787704469_0001_00_000001
2016-01-14 16:08:24,669 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:24,671 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787704469_0001_00_000001
2016-01-14 16:08:24,671 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:24,673 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:24,673 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787704469_0001_00_000001, launchTime=1452787704673
2016-01-14 16:08:24,673 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:24,674 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787704469_0001_00_000001
2016-01-14 16:08:24,675 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787704469_0001_1_00_000000_0] to container: [container_1452787704469_0001_00_000001]
2016-01-14 16:08:24,675 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:24,675 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787704469_0001_00_000001 given task: attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,675 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787704469_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,676 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787704469_0001_1_00_000000_0] started. Is using containerId: [container_1452787704469_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:24,676 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:24,676 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, taskAttemptId=attempt_1452787704469_0001_1_00_000000_0, startTime=1452787704675, containerId=container_1452787704469_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787704469_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:24,677 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704469_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:24,677 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704469_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:24 Starting to run new task attempt: attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,677 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,678 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,678 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:24,678 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:24,678 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:24,678 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:24,679 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:24,679 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC] every.every/(1/1) ...RESULTS.-1_VALUES_RESULTS, VertexName: BC0941F7977B4E14B7568F8D72D55606, VertexParallelism: 1, TaskAttemptID:attempt_1452787704469_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=4EDC7B783DBE4289B39B9CC41BC4FD3C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=1931E85EA6F4475DBEB973E7F507C274, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:24,679 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:24,680 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,680 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:24,680 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,680 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,681 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=4EDC7B783DBE4289B39B9CC41BC4FD3C, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:24,681 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=1931E85EA6F4475DBEB973E7F507C274, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:24,681 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:24,682 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,682 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,682 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:24,683 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 1931E85EA6F4475DBEB973E7F507C274
2016-01-14 16:08:24,683 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:24,683 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 1931E85EA6F4475DBEB973E7F507C274
2016-01-14 16:08:24,685 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:24,689 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:24,689 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,689 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,697 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787704469_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:24,700 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:24,700 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 1931E85EA6F4475DBEB973E7F507C274
2016-01-14 16:08:24,705 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: BC0941F7977B4E14B7568F8D72D55606, ordinal: 0
2016-01-14 16:08:24,705 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BC0941F7977B4E14B7568F8D72D55606, mem on start (mb), free: 151, total: 384, max: 672
2016-01-14 16:08:24,705 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:24,706 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:24,706 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:24,706 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:24,706 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:24,707 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:24,707 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:24,707 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:24,708 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:24,708 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:24,708 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:24,709 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 4EDC7B783DBE4289B39B9CC41BC4FD3C, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:24,709 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 1931E85EA6F4475DBEB973E7F507C274, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:24,709 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:24,709 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 4EDC7B783DBE4289B39B9CC41BC4FD3C being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:24,709 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,710 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:24,710 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,710 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:24,711 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:24,711 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:24,711 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,715 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,715 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,716 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"], id: 1931E85EA6F4475DBEB973E7F507C274
2016-01-14 16:08:24,716 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_RESULTS"]
2016-01-14 16:08:24,716 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,716 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:24,717 INFO  input.MRInput (MRInput.java:checkAndAwaitRecordReaderInitialization(597)) - Awaiting RecordReader initialization
2016-01-14 16:08:24,717 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:24,717 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@603603cb
2016-01-14 16:08:24,718 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@603603cb
2016-01-14 16:08:24,719 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:24,719 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:24,719 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: BC0941F7977B4E14B7568F8D72D55606, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:24,720 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,721 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,722 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,723 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:24,723 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:24,724 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787704469_0001_1_00_000000_0
2016-01-14 16:08:24,724 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787704469_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:24,725 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787704469_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:24,729 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:24,729 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, taskAttemptId=attempt_1452787704469_0001_1_00_000000_0, startTime=1452787704675, finishTime=1452787704729, timeTaken=54, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787704719, Process_Duration=6, Process_End_Time=1452787704725, Read_Duration=1, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:24,730 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704469_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:24,730 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787704469_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:24,730 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:24,730 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:TASK_FINISHED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, taskId=task_1452787704469_0001_1_00_000000, startTime=1452787704675, finishTime=1452787704730, timeTaken=55, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:24,731 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704469_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:24,731 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:24,731 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] : 1
2016-01-14 16:08:24,731 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] because task failed: task_1452787704469_0001_1_00_000000
2016-01-14 16:08:24,731 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:24,732 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:24,732 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,732 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=1931E85EA6F4475DBEB973E7F507C274, vertexId=vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,733 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:24,734 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:VERTEX_FINISHED]: vertexName=BC0941F7977B4E14B7568F8D72D55606, vertexId=vertex_1452787704469_0001_1_00, initRequestedTime=1452787704640, initedTime=1452787704656, startRequestedTime=1452787704658, startedTime=1452787704658, finishTime=1452787704733, timeTaken=75, status=FAILED, diagnostics=Task failed, taskId=task_1452787704469_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787704675, firstTasksToStart=[ task_1452787704469_0001_1_00_000000 ], lastTaskFinishTime=1452787704729, lastTasksToFinish=[ task_1452787704469_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:24,738 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:24,738 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 19 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787704719, Process_Duration=6, Process_End_Time=1452787704725, Read_Duration=1, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:24,738 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: BC0941F7977B4E14B7568F8D72D55606, mem on close (mb), free: 148, total: 384, max: 672
2016-01-14 16:08:24,738 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=BC0941F7977B4E14B7568F8D72D55606, index=0
2016-01-14 16:08:24,739 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=BC0941F7977B4E14B7568F8D72D55606, sourceVertex=4EDC7B783DBE4289B39B9CC41BC4FD3C
2016-01-14 16:08:24,739 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=BC0941F7977B4E14B7568F8D72D55606, sourceVertex=1931E85EA6F4475DBEB973E7F507C274
2016-01-14 16:08:24,739 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787704469_0001_00_000001
2016-01-14 16:08:24,739 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787704469_0001_00_000001
2016-01-14 16:08:24,740 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:24,741 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787704469_0001_00_000001, stoppedTime=1452787704740, exitStatus=0
2016-01-14 16:08:24,741 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:24,741 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787704469_0001_1_00_000000_0 failed: true container: container_1452787704469_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:24,748 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:24,749 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787704469_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:24,749 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:24,749 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787704469_0001_1
2016-01-14 16:08:24,749 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: 1931E85EA6F4475DBEB973E7F507C274 for vertex: vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606]
2016-01-14 16:08:24,750 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787704469_0001_1, queueSize=0
2016-01-14 16:08:24,750 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:24,751 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704469_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787704469_0001_1, startTime=1452787704638, finishTime=1452787704749, timeTaken=111, status=FAILED, diagnostics=Vertex failed, vertexName=BC0941F7977B4E14B7568F8D72D55606, vertexId=vertex_1452787704469_0001_1_00, diagnostics=[Task failed, taskId=task_1452787704469_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787704469_0001_1_00 [BC0941F7977B4E14B7568F8D72D55606] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:24,751 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787704469_0001_1 finished with state: FAILED
2016-01-14 16:08:24,751 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704469_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:24,752 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787704469_0001_00_000001
2016-01-14 16:08:24 Completed Dag: dag_1452787704469_0001_1
2016-01-14 16:08:24,752 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787704469_0001_1, dagState=FAILED
2016-01-14 16:08:24,752 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787704469_0001_1_post
2016-01-14 16:08:24,752 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:24,752 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:24,752 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from STOP_REQUESTED to STOPPING via event C_NM_STOP_SENT
2016-01-14 16:08:24,749 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787704469_0001_00_000001 completed but with errors
2016-01-14 16:08:24,754 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452787704469_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:24,755 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704469_0001_00_000001 transitioned from STOPPING to COMPLETED via event C_COMPLETED
2016-01-14 16:08:24,755 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704469_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:24,768 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...RESULTS.-1_VALUES_RESULTS, applicationId=application_1452787704469_0001
2016-01-14 16:08:24,773 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:24,773 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:24,773 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:24,773 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:24,773 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:24,774 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:24,774 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:24,774 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:24,774 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:24,775 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:24,775 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:24,775 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:24,775 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:24,781 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/EFA7C17063B84753B83213BEE25FA9CE/A2F1A75297234922AC96FC1278B5BABC/.tez/application_1452787704469_0001
2016-01-14 16:08:24,781 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 16:08:24,782 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,782 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 16:08:24,783 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.335
2016-01-14 16:08:24,783 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_RESULTS
2016-01-14 16:08:24,840 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:24,841 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:24,880 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.012
2016-01-14 16:08:24,888 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 16:08:24,888 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:24,889 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:24,889 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:24,904 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:24,904 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:24,915 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:24,915 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:24,916 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"]
2016-01-14 16:08:24,916 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:24,916 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:24,916 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:24,918 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:24,918 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:24,930 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:24,934 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:24,935 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:24,935 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:24,944 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001 doesn't exist and is created
2016-01-14 16:08:24,959 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:24,959 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:24,960 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001
2016-01-14 16:08:24,963 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787704934_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:24,973 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:24,974 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:24,976 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:24,976 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:24,976 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001/localmode-log-dir
2016-01-14 16:08:24,977 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001/localmode-log-dir/history.txt.appattempt_1452787704934_0001_000000, maxErrors=10
2016-01-14 16:08:24,977 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:24,977 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787704934_0001_000000, appSubmitTime=1452787704962, launchTime=1452787704963
2016-01-14 16:08:24,984 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:46079
2016-01-14 16:08:24,984 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:24,988 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:24,988 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:24,989 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:24,989 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:24,994 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787704934_0001_000000, startTime=1452787704994
2016-01-14 16:08:24,994 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:24,994 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:25,060 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:25,060 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:25,060 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452787704934_0001, dagName=[D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25,076 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25,078 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787704934_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001/localmode-log-dir/dag_1452787704934_0001_1.dot
2016-01-14 16:08:25,078 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001/localmode-log-dir/dag_1452787704934_0001_1-tez-dag.pb.txt
2016-01-14 16:08:25,083 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787704934_0001_1
2016-01-14 16:08:25,083 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,084 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25 Running Dag: dag_1452787704934_0001_1
2016-01-14 16:08:25,097 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787704934_0001_1, submitTime=1452787705077
2016-01-14 16:08:25,097 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:25,098 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B5D4B984971A42F590F1A00DADD3B035
2016-01-14 16:08:25,098 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:25,098 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787704934_0001_1, initTime=1452787705098
2016-01-14 16:08:25,099 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:25,100 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704934_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:25,101 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:DAG_STARTED]: dagID=dag_1452787704934_0001_1, startTime=1452787705100
2016-01-14 16:08:25,101 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:25,101 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:25,101 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452787704934_0001, dagName=[D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25,101 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704934_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:25,103 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B5D4B984971A42F590F1A00DADD3B035 : {91A61A8AE3684AEE8C251B1102124310={InputName=91A61A8AE3684AEE8C251B1102124310}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:25,103 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 91A61A8AE3684AEE8C251B1102124310, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:25,103 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,103 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,103 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,104 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]. Starting root input initializers: 1
2016-01-14 16:08:25,104 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:25,105 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 91A61A8AE3684AEE8C251B1102124310 on vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,106 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:25,106 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 91A61A8AE3684AEE8C251B1102124310 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:25,107 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:25,107 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:25,108 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:25,109 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 91A61A8AE3684AEE8C251B1102124310 on vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,110 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:25,110 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {91A61A8AE3684AEE8C251B1102124310=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:25,110 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] parallelism set to 1
2016-01-14 16:08:25,110 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:25,110 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787704934_0001_1_00, eventCount=1
2016-01-14 16:08:25,111 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,111 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=C3AB2F238449423C9068D89C040DFD0F, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:25,111 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=C3AB2F238449423C9068D89C040DFD0F, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,113 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=C3AB2F238449423C9068D89C040DFD0F, vertexName=B5D4B984971A42F590F1A00DADD3B035, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:25,113 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=C3AB2F238449423C9068D89C040DFD0F, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,114 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:25,115 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, vertexId=vertex_1452787704934_0001_1_00, initRequestedTime=1452787705103, initedTime=1452787705114, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:25,115 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] with distanceFromRoot: 0
2016-01-14 16:08:25,115 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:25,116 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B5D4B984971A42F590F1A00DADD3B035
2016-01-14 16:08:25,116 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,116 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:25,117 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787704934_0001_1_00, startRequestedTime=1452787705116, startedTime=1452787705116
2016-01-14 16:08:25,117 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:25,117 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:25,118 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:TASK_STARTED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, taskId=task_1452787704934_0001_1_00_000000, scheduledTime=1452787705117, launchTime=1452787705117
2016-01-14 16:08:25,118 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704934_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:25,119 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,119 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL, VertexName: B5D4B984971A42F590F1A00DADD3B035, VertexParallelism: 1, TaskAttemptID:attempt_1452787704934_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=91A61A8AE3684AEE8C251B1102124310, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C3AB2F238449423C9068D89C040DFD0F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:25,119 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704934_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:25,120 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787704934_0001, with dag id: dag_1452787704934_0001_1
2016-01-14 16:08:25,120 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:25,121 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:25,121 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:25,122 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:25,122 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787704934_0001_00_000001
2016-01-14 16:08:25,124 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704934_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:25,126 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787704934_0001_00_000001
2016-01-14 16:08:25,126 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:25,127 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:25,127 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704934_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:25,127 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787704934_0001_00_000001, launchTime=1452787705127
2016-01-14 16:08:25,128 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787704934_0001_00_000001
2016-01-14 16:08:25,128 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787704934_0001_1_00_000000_0] to container: [container_1452787704934_0001_00_000001]
2016-01-14 16:08:25,128 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704934_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:25,129 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787704934_0001_00_000001 given task: attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,129 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787704934_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,129 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787704934_0001_1_00_000000_0] started. Is using containerId: [container_1452787704934_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:25 Starting to run new task attempt: attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,130 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:25,130 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, taskAttemptId=attempt_1452787704934_0001_1_00_000000_0, startTime=1452787705129, containerId=container_1452787704934_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787704934_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:25,130 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,130 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,130 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704934_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:25,131 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:25,131 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:25,131 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704934_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:25,131 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:25,132 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:25,133 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:25,133 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370] every.every/(1/1) ...ld'_RESULTS.-1_VALUES_ALL, VertexName: B5D4B984971A42F590F1A00DADD3B035, VertexParallelism: 1, TaskAttemptID:attempt_1452787704934_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=91A61A8AE3684AEE8C251B1102124310, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=C3AB2F238449423C9068D89C040DFD0F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:25,133 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:25,133 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,134 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:25,134 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,135 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787704934_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:25,135 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,135 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=91A61A8AE3684AEE8C251B1102124310, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:25,136 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:25,137 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,137 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,138 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:25,140 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=C3AB2F238449423C9068D89C040DFD0F, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:25,142 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:25,142 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:25,142 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: C3AB2F238449423C9068D89C040DFD0F
2016-01-14 16:08:25,142 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:25,142 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: C3AB2F238449423C9068D89C040DFD0F
2016-01-14 16:08:25,142 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,143 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,150 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B5D4B984971A42F590F1A00DADD3B035, ordinal: 0
2016-01-14 16:08:25,150 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B5D4B984971A42F590F1A00DADD3B035, mem on start (mb), free: 293, total: 385, max: 672
2016-01-14 16:08:25,150 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,150 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:25,150 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:25,157 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:25,157 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: C3AB2F238449423C9068D89C040DFD0F
2016-01-14 16:08:25,157 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:25,157 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:25,157 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:25,157 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:25,157 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:25,158 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:25,158 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:25,158 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:25,158 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 91A61A8AE3684AEE8C251B1102124310, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:25,158 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, C3AB2F238449423C9068D89C040DFD0F, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:25,158 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:25,158 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 91A61A8AE3684AEE8C251B1102124310 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:25,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:25,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:25,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,159 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:25,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,159 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:25,160 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,163 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:25,164 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,164 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@729b0c63
2016-01-14 16:08:25,165 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,166 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"], id: C3AB2F238449423C9068D89C040DFD0F
2016-01-14 16:08:25,166 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_VALUES_ALL"]
2016-01-14 16:08:25,167 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,167 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:25,168 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@729b0c63
2016-01-14 16:08:25,168 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:25,168 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:25,169 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B5D4B984971A42F590F1A00DADD3B035, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:25,169 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:25,170 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:25,171 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:25,172 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:25,172 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:25,172 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787704934_0001_1_00_000000_0
2016-01-14 16:08:25,172 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787704934_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:25,173 INFO  task.TezTaskRunner (TezTaskRunner.java:run(221)) - Encounted an error while executing task: attempt_1452787704934_0001_1_00_000000_0
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2016-01-14 16:08:25,183 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 18 [[File System Counters FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0][cascading.flow.SliceCounters Process_Begin_Time=1452787705169, Process_Duration=4, Process_End_Time=1452787705173, Read_Duration=0, Tuples_Read=1][cascading.flow.StepCounters Tuples_Read=1]]
2016-01-14 16:08:25,183 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B5D4B984971A42F590F1A00DADD3B035, mem on close (mb), free: 291, total: 385, max: 672
2016-01-14 16:08:25,183 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, taskAttemptId=attempt_1452787704934_0001_1_00_000000_0, startTime=1452787705129, finishTime=1452787705183, timeTaken=54, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
, counters=Counters: 19, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=51, FILE_BYTES_WRITTEN=8, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=0, cascading.flow.SliceCounters, Process_Begin_Time=1452787705169, Process_Duration=4, Process_End_Time=1452787705173, Read_Duration=0, Tuples_Read=1, cascading.flow.StepCounters, Tuples_Read=1
2016-01-14 16:08:25,183 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:25,184 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704934_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS due to event TA_FAILED
2016-01-14 16:08:25,183 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(729)) - Closed processor for vertex=B5D4B984971A42F590F1A00DADD3B035, index=0
2016-01-14 16:08:25,184 INFO  impl.TaskImpl (TaskImpl.java:transition(1296)) - Failing task: task_1452787704934_0001_1_00_000000, currentFailedAttempts: 1, maxFailedAttempts: 1
2016-01-14 16:08:25,184 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(753)) - Close input for vertex=B5D4B984971A42F590F1A00DADD3B035, sourceVertex=91A61A8AE3684AEE8C251B1102124310
2016-01-14 16:08:25,184 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:25,184 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(772)) - Close input for vertex=B5D4B984971A42F590F1A00DADD3B035, sourceVertex=C3AB2F238449423C9068D89C040DFD0F
2016-01-14 16:08:25,184 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:TASK_FINISHED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, taskId=task_1452787704934_0001_1_00_000000, startTime=1452787705129, finishTime=1452787705184, timeTaken=55, status=FAILED, successfulAttemptID=null, diagnostics=TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
], counters=Counters: 0
2016-01-14 16:08:25,185 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787704934_0001_1_00_000000 Task Transitioned from RUNNING to FAILED due to event T_ATTEMPT_FAILED
2016-01-14 16:08:25,185 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787704934_0001_00_000001
2016-01-14 16:08:25,185 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] : 1
2016-01-14 16:08:25,185 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:25,186 INFO  impl.VertexImpl (VertexImpl.java:transition(3543)) - Failing vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] because task failed: task_1452787704934_0001_1_00_000000
2016-01-14 16:08:25,186 INFO  impl.VertexImpl (VertexImpl.java:tryEnactKill(1842)) - Killing tasks in vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] due to trigger: OWN_TASK_FAILURE
2016-01-14 16:08:25,185 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787704934_0001_00_000001
2016-01-14 16:08:25,186 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1754)) - Vertex failed as one or more tasks failed. failedTasks:1
2016-01-14 16:08:25,186 INFO  impl.VertexImpl (VertexImpl.java:abortVertex(3302)) - Invoking committer abort for vertex, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,186 INFO  impl.VertexImpl (VertexImpl.java:run(3310)) - Invoking committer abort for output=C3AB2F238449423C9068D89C040DFD0F, vertexId=vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,195 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787704934_0001_00_000001 = ContainerExecutionResult{exitStatus=EXECUTION_FAILURE, throwable=org.apache.tez.dag.api.TezException: java.lang.reflect.UndeclaredThrowableException, errorMessage='TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException'}
2016-01-14 16:08:25,195 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(279)) - Container: container_1452787704934_0001_00_000001 completed but with errors
2016-01-14 16:08:25,195 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:25,196 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:VERTEX_FINISHED]: vertexName=B5D4B984971A42F590F1A00DADD3B035, vertexId=vertex_1452787704934_0001_1_00, initRequestedTime=1452787705103, initedTime=1452787705114, startRequestedTime=1452787705116, startedTime=1452787705116, finishTime=1452787705195, timeTaken=79, status=FAILED, diagnostics=Task failed, taskId=task_1452787704934_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]]
Vertex failed as one or more tasks failed. failedTasks:1
Vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] killed/failed due to:null, counters=Counters: 0, vertexStats=firstTaskStartTime=1452787705129, firstTasksToStart=[ task_1452787704934_0001_1_00_000000 ], lastTaskFinishTime=1452787705183, lastTasksToFinish=[ task_1452787704934_0001_1_00_000000 ], minTaskDuration=-1, maxTaskDuration=-1, avgTaskDuration=-1.0, numSuccessfulTasks=0, shortestDurationTasks=[  ], longestDurationTasks=[  ], vertexTaskStats={numFailedTasks=1, numSucceededTasks=0, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=1, numCompletedTasks=1}
2016-01-14 16:08:25,196 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] transitioned from RUNNING to FAILED due to event V_TASK_COMPLETED
2016-01-14 16:08:25,196 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:25,196 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787704934_0001_00_000001, stoppedTime=1452787705196, exitStatus=0
2016-01-14 16:08:25,197 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704934_0001_00_000001 transitioned from RUNNING to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:25,197 INFO  node.AMNodeImpl (AMNodeImpl.java:transition(294)) - Attempt failed on node: 127.0.0.1:0 TA: attempt_1452787704934_0001_1_00_000000_0 failed: true container: container_1452787704934_0001_00_000001 numFailedTAs: 0
2016-01-14 16:08:25,198 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] completed., numCompletedVertices=1, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=0, numVertices=1
2016-01-14 16:08:25,198 INFO  impl.DAGImpl (DAGImpl.java:checkDAGForCompletion(1082)) - DAG failed due to vertex failure. failedVertices:1 killedVertices:0
2016-01-14 16:08:25,198 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787704934_0001_1
2016-01-14 16:08:25,198 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(926)) - Aborting output: C3AB2F238449423C9068D89C040DFD0F for vertex: vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035]
2016-01-14 16:08:25,199 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787704934_0001_1, queueSize=0
2016-01-14 16:08:25,199 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:25,200 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787704934_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787704934_0001_1, startTime=1452787705100, finishTime=1452787705199, timeTaken=99, status=FAILED, diagnostics=Vertex failed, vertexName=B5D4B984971A42F590F1A00DADD3B035, vertexId=vertex_1452787704934_0001_1_00, diagnostics=[Task failed, taskId=task_1452787704934_0001_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.FunctionEachStage$1.collect(FunctionEachStage.java:81)
	at cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:145)
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:133)
	at cascading.TestFunction.operate(TestFunction.java:86)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.tez.stream.element.TezSourceStage.run(TezSourceStage.java:95)
	at cascading.flow.tez.FlowProcessor.run(FlowProcessor.java:165)
	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:334)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
	at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1452787704934_0001_1_00 [B5D4B984971A42F590F1A00DADD3B035] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=Counters: 2, org.apache.tez.common.counters.DAGCounter, NUM_FAILED_TASKS=1, TOTAL_LAUNCHED_TASKS=1
2016-01-14 16:08:25,200 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787704934_0001_1 finished with state: FAILED
2016-01-14 16:08:25,200 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787704934_0001_1 transitioned from RUNNING to FAILED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:25,201 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(1033)) - Container container_1452787704934_0001_00_000001 exited with diagnostics set to TaskExecutionFailure: java.lang.reflect.UndeclaredThrowableException
2016-01-14 16:08:25,201 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787704934_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:25,201 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787704934_0001_00_000001
2016-01-14 16:08:25 Completed Dag: dag_1452787704934_0001_1
2016-01-14 16:08:25,201 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787704934_0001_1, dagState=FAILED
2016-01-14 16:08:25,201 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787704934_0001_1_post
2016-01-14 16:08:25,201 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,202 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:25,202 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787704934_0001_1_00_000000_0 TaskAttempt Transitioned from FAIL_IN_PROGRESS to FAILED due to event TA_CONTAINER_TERMINATED
2016-01-14 16:08:25,213 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.-1_VALUES_ALL, applicationId=application_1452787704934_0001
2016-01-14 16:08:25,215 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:25,215 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:25,215 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:25,215 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:25,215 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:25,216 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:25,216 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:25,216 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:25,217 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:25,217 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:25,217 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:25,218 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:25,218 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:25,221 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/D3429A3387804A749154122146C8FD8B/AB01809BDA1340E580A47CE32C1AB370/.tez/application_1452787704934_0001
2016-01-14 16:08:25,222 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping all jobs
2016-01-14 16:08:25,222 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopping: (1/1) ...ld'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25,222 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] stopped all jobs
2016-01-14 16:08:25,224 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.308
2016-01-14 16:08:25,224 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_VALUES_ALL
2016-01-14 16:08:25,246 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:25,247 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:25,264 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:25,264 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:25,280 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.006
2016-01-14 16:08:25,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.010
2016-01-14 16:08:25,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:25,286 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:25,287 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_'field2'
2016-01-14 16:08:25,308 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:25,309 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:25,342 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.009
2016-01-14 16:08:25,360 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-14 16:08:25,361 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:25,361 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:25,361 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:25,375 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:25,376 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,388 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:25,388 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,389 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"]
2016-01-14 16:08:25,389 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:25,390 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:25,390 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:25,393 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,393 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:25,407 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:25,413 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:25,413 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:25,414 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:25,424 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001 doesn't exist and is created
2016-01-14 16:08:25,443 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:25,444 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:25,444 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001
2016-01-14 16:08:25,448 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787705413_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:25,458 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:25,459 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:25,461 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:25,461 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:25,461 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001/localmode-log-dir
2016-01-14 16:08:25,462 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001/localmode-log-dir/history.txt.appattempt_1452787705413_0001_000000, maxErrors=10
2016-01-14 16:08:25,462 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:25,462 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787705413_0001_000000, appSubmitTime=1452787705447, launchTime=1452787705447
2016-01-14 16:08:25,469 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:25,470 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:55161
2016-01-14 16:08:25,474 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:25,475 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:25,475 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:25,481 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:25,483 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787705413_0001_000000, startTime=1452787705483
2016-01-14 16:08:25,483 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:25,483 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:25,545 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:25,545 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:25,545 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452787705413_0001, dagName=[36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,562 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,563 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787705413_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001/localmode-log-dir/dag_1452787705413_0001_1.dot
2016-01-14 16:08:25,564 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001/localmode-log-dir/dag_1452787705413_0001_1-tez-dag.pb.txt
2016-01-14 16:08:25,569 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787705413_0001_1
2016-01-14 16:08:25,569 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,569 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25 Running Dag: dag_1452787705413_0001_1
2016-01-14 16:08:25,581 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:25,582 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787705413_0001_1, submitTime=1452787705562
2016-01-14 16:08:25,582 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex CFFBEE5A1C524954846B988643FBC8B6
2016-01-14 16:08:25,583 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:25,583 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:25,584 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787705413_0001_1, initTime=1452787705582
2016-01-14 16:08:25,584 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705413_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:25,584 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:DAG_STARTED]: dagID=dag_1452787705413_0001_1, startTime=1452787705584
2016-01-14 16:08:25,584 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:25,585 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705413_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:25,585 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:25,585 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: CFFBEE5A1C524954846B988643FBC8B6 : {0E08DBA5CE864189808FF87D736B2FF9={InputName=0E08DBA5CE864189808FF87D736B2FF9}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:25,585 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 0E08DBA5CE864189808FF87D736B2FF9, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:25,585 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,585 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,585 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,586 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]. Starting root input initializers: 1
2016-01-14 16:08:25,588 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452787705413_0001, dagName=[36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,588 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:25,588 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 0E08DBA5CE864189808FF87D736B2FF9 on vertex vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,590 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:25,590 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 0E08DBA5CE864189808FF87D736B2FF9 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:25,590 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:25,591 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:25,592 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:25,593 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 0E08DBA5CE864189808FF87D736B2FF9 on vertex vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,593 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:25,593 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {0E08DBA5CE864189808FF87D736B2FF9=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:25,594 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] parallelism set to 1
2016-01-14 16:08:25,594 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:25,594 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787705413_0001_1_00, eventCount=1
2016-01-14 16:08:25,595 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,595 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=61D3681347CF4A909CEE58BAFAC9B907, vertexId=vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:25,595 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=61D3681347CF4A909CEE58BAFAC9B907, vertexId=vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,597 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=61D3681347CF4A909CEE58BAFAC9B907, vertexName=CFFBEE5A1C524954846B988643FBC8B6, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:25,597 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=61D3681347CF4A909CEE58BAFAC9B907, vertexId=vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,599 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:25,599 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:VERTEX_INITIALIZED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, vertexId=vertex_1452787705413_0001_1_00, initRequestedTime=1452787705585, initedTime=1452787705598, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:25,599 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] with distanceFromRoot: 0
2016-01-14 16:08:25,599 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:25,599 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in CFFBEE5A1C524954846B988643FBC8B6
2016-01-14 16:08:25,599 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,600 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:25,600 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787705413_0001_1_00, startRequestedTime=1452787705599, startedTime=1452787705599
2016-01-14 16:08:25,600 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:25,601 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:25,601 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:TASK_STARTED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, taskId=task_1452787705413_0001_1_00_000000, scheduledTime=1452787705601, launchTime=1452787705601
2016-01-14 16:08:25,601 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705413_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:25,602 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,602 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS, VertexName: CFFBEE5A1C524954846B988643FBC8B6, VertexParallelism: 1, TaskAttemptID:attempt_1452787705413_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0E08DBA5CE864189808FF87D736B2FF9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=61D3681347CF4A909CEE58BAFAC9B907, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:25,603 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705413_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:25,603 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:25,604 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:25,604 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:25,604 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:25,605 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787705413_0001_00_000001
2016-01-14 16:08:25,605 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:25,607 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787705413_0001_00_000001
2016-01-14 16:08:25,607 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:25,607 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:25,608 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:25,608 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787705413_0001_00_000001, launchTime=1452787705608
2016-01-14 16:08:25,609 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787705413_0001_00_000001
2016-01-14 16:08:25,609 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787705413_0001_1_00_000000_0] to container: [container_1452787705413_0001_00_000001]
2016-01-14 16:08:25,610 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:25,610 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787705413_0001_00_000001 given task: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,610 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787705413_0001, with dag id: dag_1452787705413_0001_1
2016-01-14 16:08:25,610 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787705413_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25 Starting to run new task attempt: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,610 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787705413_0001_1_00_000000_0] started. Is using containerId: [container_1452787705413_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:25,611 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,611 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,611 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:25,611 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:25,612 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:25,612 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:25,612 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:25,612 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:25,611 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0, startTime=1452787705610, containerId=container_1452787705413_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787705413_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:25,612 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705413_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:25,612 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705413_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:25,613 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0] every.every/(1/1) ...'_RESULTS.-1_ARGS_RESULTS, VertexName: CFFBEE5A1C524954846B988643FBC8B6, VertexParallelism: 1, TaskAttemptID:attempt_1452787705413_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=0E08DBA5CE864189808FF87D736B2FF9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=61D3681347CF4A909CEE58BAFAC9B907, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:25,613 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:25,613 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,613 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:25,613 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,616 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=0E08DBA5CE864189808FF87D736B2FF9, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:25,616 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,616 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=61D3681347CF4A909CEE58BAFAC9B907, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:25,618 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:25,618 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 61D3681347CF4A909CEE58BAFAC9B907
2016-01-14 16:08:25,618 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:25,618 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 61D3681347CF4A909CEE58BAFAC9B907
2016-01-14 16:08:25,618 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787705413_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:25,619 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:25,620 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,620 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,621 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:25,624 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:25,625 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,625 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,630 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: CFFBEE5A1C524954846B988643FBC8B6, ordinal: 0
2016-01-14 16:08:25,632 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CFFBEE5A1C524954846B988643FBC8B6, mem on start (mb), free: 216, total: 385, max: 672
2016-01-14 16:08:25,632 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:25,632 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:25,632 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:25,633 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:25,633 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 61D3681347CF4A909CEE58BAFAC9B907
2016-01-14 16:08:25,634 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:25,634 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:25,634 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:25,635 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:25,635 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:25,635 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:25,636 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:25,636 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:25,636 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 61D3681347CF4A909CEE58BAFAC9B907, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:25,636 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 0E08DBA5CE864189808FF87D736B2FF9, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:25,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:25,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 0E08DBA5CE864189808FF87D736B2FF9 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:25,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,637 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:25,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,637 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:25,638 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:25,638 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:25,639 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,639 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:25,639 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2230658c
2016-01-14 16:08:25,640 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2230658c
2016-01-14 16:08:25,643 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:25,643 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:25,642 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,646 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 0E08DBA5CE864189808FF87D736B2FF9
2016-01-14 16:08:25,647 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"], id: 61D3681347CF4A909CEE58BAFAC9B907
2016-01-14 16:08:25,647 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.-1_ARGS_RESULTS"]
2016-01-14 16:08:25,647 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,648 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:25,648 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: CFFBEE5A1C524954846B988643FBC8B6, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:25,651 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:25,652 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:25,652 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,653 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787705413_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:25,654 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,654 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: CFFBEE5A1C524954846B988643FBC8B6, mem on close (mb), free: 215, total: 385, max: 672
2016-01-14 16:08:25 Completed running task attempt: attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,655 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:25,657 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:25,657 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, taskAttemptId=attempt_1452787705413_0001_1_00_000000_0, startTime=1452787705610, finishTime=1452787705657, timeTaken=47, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787705648, Process_Duration=6, Process_End_Time=1452787705654, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:25,657 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705413_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:25,658 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787705413_0001_1_00_000000_0
2016-01-14 16:08:25,658 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:TASK_FINISHED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, taskId=task_1452787705413_0001_1_00_000000, startTime=1452787705610, finishTime=1452787705658, timeTaken=48, status=SUCCEEDED, successfulAttemptID=attempt_1452787705413_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787705648, Process_Duration=6, Process_End_Time=1452787705654, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:25,659 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705413_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:25,659 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] : 1
2016-01-14 16:08:25,659 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,660 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:25,661 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:25,660 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:VERTEX_FINISHED]: vertexName=CFFBEE5A1C524954846B988643FBC8B6, vertexId=vertex_1452787705413_0001_1_00, initRequestedTime=1452787705585, initedTime=1452787705598, startRequestedTime=1452787705599, startedTime=1452787705599, finishTime=1452787705659, timeTaken=60, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787705648, Process_Duration=6, Process_End_Time=1452787705654, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787705610, firstTasksToStart=[ task_1452787705413_0001_1_00_000000 ], lastTaskFinishTime=1452787705657, lastTasksToFinish=[ task_1452787705413_0001_1_00_000000 ], minTaskDuration=47, maxTaskDuration=47, avgTaskDuration=47.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787705413_0001_1_00_000000 ], longestDurationTasks=[ task_1452787705413_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:25,662 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:25,662 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:25,663 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:25,664 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787705413_0001_00_000001, stoppedTime=1452787705664, exitStatus=0
2016-01-14 16:08:25,664 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:25,664 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:25,664 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:25,665 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787705648, Process_Duration=6, Process_End_Time=1452787705654, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:25,665 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:25,665 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,666 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787705413_0001_00_000001
2016-01-14 16:08:25,665 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787705413_0001_1
2016-01-14 16:08:25,666 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787705413_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:25,666 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787705413_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:25,666 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787705413_0001_1
2016-01-14 16:08:25,667 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787705413_0001_00_000001, Exiting
2016-01-14 16:08:25,667 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787705413_0001_00_000001
2016-01-14 16:08:25,667 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787705413_0001_00_000001
2016-01-14 16:08:25,667 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 61D3681347CF4A909CEE58BAFAC9B907 for vertex: vertex_1452787705413_0001_1_00 [CFFBEE5A1C524954846B988643FBC8B6]
2016-01-14 16:08:25,671 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787705413_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:25,671 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787705413_0001_00_000001 completed successfully
2016-01-14 16:08:25,678 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787705413_0001_1, queueSize=0
2016-01-14 16:08:25,679 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:25,679 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705413_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787705413_0001_1, startTime=1452787705584, finishTime=1452787705677, timeTaken=93, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403701760, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787705648, Process_Duration=6, Process_End_Time=1452787705654, Read_Duration=1, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:25,679 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787705413_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:25,679 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705413_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:25,679 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705413_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:25,680 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787705413_0001_00_000001
2016-01-14 16:08:25 Completed Dag: dag_1452787705413_0001_1
2016-01-14 16:08:25,680 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787705413_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:25,680 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787705413_0001_1_post
2016-01-14 16:08:25,680 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:25,680 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:25,687 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...'_RESULTS.-1_ARGS_RESULTS, applicationId=application_1452787705413_0001
2016-01-14 16:08:25,690 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:25,690 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:25,691 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:25,691 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:25,691 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:25,691 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:25,692 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:25,693 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:25,693 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:25,693 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:25,694 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:25,694 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:25,694 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:25,698 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/36E4FC94FD20457E88F771C7729BEA00/AD0B2989A8284C2DAE996BC8C7C0BEF0/.tez/application_1452787705413_0001
2016-01-14 16:08:25,699 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.311
2016-01-14 16:08:25,764 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_RESULTS
2016-01-14 16:08:25,786 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:25,786 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:25,817 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.004
2016-01-14 16:08:25,819 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: ILLEGAL, in: 00:00.006
2016-01-14 16:08:25,819 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:25,819 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, found assembly to be malformed
2016-01-14 16:08:25,820 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.-1_ARGS_ALL
2016-01-14 16:08:25,840 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:25,841 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:25,848 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:25,848 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:25,880 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:25,883 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:08:25,883 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:25,884 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:25,884 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:25,898 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:25,898 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1
2016-01-14 16:08:25,909 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:25,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:25,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"]
2016-01-14 16:08:25,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:25,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:25,910 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:25,912 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:25,912 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:25,925 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:25,929 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:25,930 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:25,930 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:25,940 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001 doesn't exist and is created
2016-01-14 16:08:25,956 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:25,956 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:25,957 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001
2016-01-14 16:08:25,960 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787705930_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:25,970 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:25,971 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:25,973 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:25,973 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:25,973 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001/localmode-log-dir
2016-01-14 16:08:25,974 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001/localmode-log-dir/history.txt.appattempt_1452787705930_0001_000000, maxErrors=10
2016-01-14 16:08:25,974 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:25,974 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787705930_0001_000000, appSubmitTime=1452787705960, launchTime=1452787705960
2016-01-14 16:08:25,980 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:25,984 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:45809
2016-01-14 16:08:25,986 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:25,987 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:25,988 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:25,994 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:25,996 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787705930_0001_000000, startTime=1452787705996
2016-01-14 16:08:25,996 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:25,996 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:26,057 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:26,057 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:26,057 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452787705930_0001, dagName=[ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:26,087 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:26,089 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787705930_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001/localmode-log-dir/dag_1452787705930_0001_1.dot
2016-01-14 16:08:26,089 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001/localmode-log-dir/dag_1452787705930_0001_1-tez-dag.pb.txt
2016-01-14 16:08:26,095 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787705930_0001_1
2016-01-14 16:08:26,095 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,095 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:26 Running Dag: dag_1452787705930_0001_1
2016-01-14 16:08:26,106 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787705930_0001_1, submitTime=1452787706088
2016-01-14 16:08:26,106 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:26,107 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B98F53A5648C424B983DC3CC7EEFDF1D
2016-01-14 16:08:26,107 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:26,107 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787705930_0001_1, initTime=1452787706106
2016-01-14 16:08:26,107 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:26,108 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705930_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:26,109 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:DAG_STARTED]: dagID=dag_1452787705930_0001_1, startTime=1452787706108
2016-01-14 16:08:26,109 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:26,109 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:26,109 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452787705930_0001, dagName=[ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1
2016-01-14 16:08:26,109 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705930_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B98F53A5648C424B983DC3CC7EEFDF1D : {855915D5C2C74D63811526AF96A61CC1={InputName=855915D5C2C74D63811526AF96A61CC1}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 855915D5C2C74D63811526AF96A61CC1, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,110 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]. Starting root input initializers: 1
2016-01-14 16:08:26,111 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:26,111 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 855915D5C2C74D63811526AF96A61CC1 on vertex vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,112 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:26,113 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 855915D5C2C74D63811526AF96A61CC1 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:26,113 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:26,113 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:26,114 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:26,117 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 855915D5C2C74D63811526AF96A61CC1 on vertex vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,117 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:26,117 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {855915D5C2C74D63811526AF96A61CC1=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:26,117 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] parallelism set to 1
2016-01-14 16:08:26,117 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:26,118 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787705930_0001_1_00, eventCount=1
2016-01-14 16:08:26,118 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,118 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=19CA88D057E64CA0A29D921557D73C47, vertexId=vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:26,118 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=19CA88D057E64CA0A29D921557D73C47, vertexId=vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,119 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=19CA88D057E64CA0A29D921557D73C47, vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:26,120 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=19CA88D057E64CA0A29D921557D73C47, vertexId=vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,121 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:26,121 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, vertexId=vertex_1452787705930_0001_1_00, initRequestedTime=1452787706110, initedTime=1452787706121, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:26,121 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] with distanceFromRoot: 0
2016-01-14 16:08:26,121 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:26,122 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B98F53A5648C424B983DC3CC7EEFDF1D
2016-01-14 16:08:26,122 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,122 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:26,122 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787705930_0001_1_00, startRequestedTime=1452787706122, startedTime=1452787706122
2016-01-14 16:08:26,123 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:26,123 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:26,123 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:TASK_STARTED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, taskId=task_1452787705930_0001_1_00_000000, scheduledTime=1452787706123, launchTime=1452787706123
2016-01-14 16:08:26,124 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705930_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:26,124 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,124 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1, VertexName: B98F53A5648C424B983DC3CC7EEFDF1D, VertexParallelism: 1, TaskAttemptID:attempt_1452787705930_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=855915D5C2C74D63811526AF96A61CC1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=19CA88D057E64CA0A29D921557D73C47, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:26,125 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705930_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:26,125 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:26,126 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:26,127 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:26,127 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:26,128 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787705930_0001_00_000001
2016-01-14 16:08:26,128 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:26,130 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787705930_0001_00_000001
2016-01-14 16:08:26,131 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:26,131 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:26,132 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787705930_0001_00_000001, launchTime=1452787706131
2016-01-14 16:08:26,131 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:26,132 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787705930_0001_00_000001
2016-01-14 16:08:26,134 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787705930_0001_1_00_000000_0] to container: [container_1452787705930_0001_00_000001]
2016-01-14 16:08:26,134 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:26,135 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787705930_0001_00_000001 given task: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,135 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787705930_0001_1_00_000000_0] started. Is using containerId: [container_1452787705930_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:26,135 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787705930_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,136 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:26,136 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0, startTime=1452787706135, containerId=container_1452787705930_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787705930_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:26,136 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705930_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:26 Starting to run new task attempt: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,136 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,136 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,137 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:26,137 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705930_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:26,137 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:26,137 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:26,137 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:26,137 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:26,138 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520] every.every/(1/1) ...ld'_RESULTS.0_'field2'_-1, VertexName: B98F53A5648C424B983DC3CC7EEFDF1D, VertexParallelism: 1, TaskAttemptID:attempt_1452787705930_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=855915D5C2C74D63811526AF96A61CC1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=19CA88D057E64CA0A29D921557D73C47, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:26,138 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:26,139 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,139 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787705930_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:26,139 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:26,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787705930_0001, with dag id: dag_1452787705930_0001_1
2016-01-14 16:08:26,140 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,142 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=855915D5C2C74D63811526AF96A61CC1, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:26,142 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,144 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=19CA88D057E64CA0A29D921557D73C47, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:26,144 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:26,144 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,145 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,146 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:26,145 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:26,147 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 19CA88D057E64CA0A29D921557D73C47
2016-01-14 16:08:26,147 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:26,147 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 19CA88D057E64CA0A29D921557D73C47
2016-01-14 16:08:26,150 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:26,150 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,150 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,156 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: B98F53A5648C424B983DC3CC7EEFDF1D, ordinal: 0
2016-01-14 16:08:26,156 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B98F53A5648C424B983DC3CC7EEFDF1D, mem on start (mb), free: 328, total: 384, max: 672
2016-01-14 16:08:26,156 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,157 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:26,157 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:26,163 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:26,163 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 19CA88D057E64CA0A29D921557D73C47
2016-01-14 16:08:26,163 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:26,163 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:26,163 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:26,163 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:26,164 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:26,164 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:26,164 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:26,164 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:26,164 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 855915D5C2C74D63811526AF96A61CC1, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:26,164 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 19CA88D057E64CA0A29D921557D73C47, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:26,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:26,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 855915D5C2C74D63811526AF96A61CC1 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:26,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,165 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:26,165 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,164 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:26,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:26,166 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:26,166 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,166 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:26,167 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@36844406
2016-01-14 16:08:26,168 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@36844406
2016-01-14 16:08:26,168 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:26,168 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:26,169 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,169 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 855915D5C2C74D63811526AF96A61CC1
2016-01-14 16:08:26,169 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"], id: 19CA88D057E64CA0A29D921557D73C47
2016-01-14 16:08:26,170 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_-1"]
2016-01-14 16:08:26,170 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,170 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:26,170 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: B98F53A5648C424B983DC3CC7EEFDF1D, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:26,173 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:26,173 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:26,173 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,174 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787705930_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:26,174 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,175 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: B98F53A5648C424B983DC3CC7EEFDF1D, mem on close (mb), free: 326, total: 384, max: 672
2016-01-14 16:08:26 Completed running task attempt: attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,176 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:26,177 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:26,177 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, taskAttemptId=attempt_1452787705930_0001_1_00_000000_0, startTime=1452787706135, finishTime=1452787706177, timeTaken=42, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706171, Process_Duration=3, Process_End_Time=1452787706174, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,177 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787705930_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:26,177 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787705930_0001_1_00_000000_0
2016-01-14 16:08:26,178 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:26,178 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:TASK_FINISHED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, taskId=task_1452787705930_0001_1_00_000000, startTime=1452787706135, finishTime=1452787706178, timeTaken=43, status=SUCCEEDED, successfulAttemptID=attempt_1452787705930_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706171, Process_Duration=3, Process_End_Time=1452787706174, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,178 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787705930_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:26,179 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] : 1
2016-01-14 16:08:26,179 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,179 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:26,180 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:VERTEX_FINISHED]: vertexName=B98F53A5648C424B983DC3CC7EEFDF1D, vertexId=vertex_1452787705930_0001_1_00, initRequestedTime=1452787706110, initedTime=1452787706121, startRequestedTime=1452787706122, startedTime=1452787706122, finishTime=1452787706179, timeTaken=57, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706171, Process_Duration=3, Process_End_Time=1452787706174, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787706135, firstTasksToStart=[ task_1452787705930_0001_1_00_000000 ], lastTaskFinishTime=1452787706177, lastTasksToFinish=[ task_1452787705930_0001_1_00_000000 ], minTaskDuration=42, maxTaskDuration=42, avgTaskDuration=42.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787705930_0001_1_00_000000 ], longestDurationTasks=[ task_1452787705930_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:26,181 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:26,181 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:26,182 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787706171, Process_Duration=3, Process_End_Time=1452787706174, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:26,182 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:26,182 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:26,182 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787705930_0001_00_000001, stoppedTime=1452787706182, exitStatus=0
2016-01-14 16:08:26,184 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:26,184 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:26,184 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,184 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:26,185 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787705930_0001_1
2016-01-14 16:08:26,185 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787705930_0001_1
2016-01-14 16:08:26,185 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 19CA88D057E64CA0A29D921557D73C47 for vertex: vertex_1452787705930_0001_1_00 [B98F53A5648C424B983DC3CC7EEFDF1D]
2016-01-14 16:08:26,187 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787705930_0001_00_000001
2016-01-14 16:08:26,187 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787705930_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:26,187 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787705930_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:26,188 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787705930_0001_00_000001, Exiting
2016-01-14 16:08:26,188 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787705930_0001_00_000001
2016-01-14 16:08:26,188 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787705930_0001_00_000001
2016-01-14 16:08:26,190 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787705930_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:26,190 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787705930_0001_00_000001 completed successfully
2016-01-14 16:08:26,196 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787705930_0001_1, queueSize=0
2016-01-14 16:08:26,196 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:26,197 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787705930_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787705930_0001_1, startTime=1452787706108, finishTime=1452787706195, timeTaken=87, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=152, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706171, Process_Duration=3, Process_End_Time=1452787706174, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,197 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787705930_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:26,197 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787705930_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:26,197 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787705930_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:26,197 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787705930_0001_00_000001
2016-01-14 16:08:26 Completed Dag: dag_1452787705930_0001_1
2016-01-14 16:08:26,197 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787705930_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:26,198 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787705930_0001_1_post
2016-01-14 16:08:26,198 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,198 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:26,204 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ld'_RESULTS.0_'field2'_-1, applicationId=application_1452787705930_0001
2016-01-14 16:08:26,206 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:26,206 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:26,206 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:26,206 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:26,206 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:26,207 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:26,207 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:26,208 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:26,208 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:26,208 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:26,208 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:26,209 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:26,209 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:26,214 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/ED238F8AD341441EA8BD02A7F1507AC0/B38082DAFFD142AE9468857076A95520/.tez/application_1452787705930_0001
2016-01-14 16:08:26,214 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.305
2016-01-14 16:08:26,279 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_-1
2016-01-14 16:08:26,308 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:26,308 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:26,352 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.008
2016-01-14 16:08:26,358 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:26,359 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:26,359 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:26,359 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:26,375 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:26,376 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'
2016-01-14 16:08:26,384 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:26,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"]
2016-01-14 16:08:26,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:26,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:26,385 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:26,386 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:26,386 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:26,389 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:26,389 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:26,398 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:26,402 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:26,403 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:26,403 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:26,412 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001 doesn't exist and is created
2016-01-14 16:08:26,427 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:26,427 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:26,428 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001
2016-01-14 16:08:26,431 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787706403_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:26,441 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:26,442 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:26,443 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:26,444 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:26,444 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001/localmode-log-dir
2016-01-14 16:08:26,444 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001/localmode-log-dir/history.txt.appattempt_1452787706403_0001_000000, maxErrors=10
2016-01-14 16:08:26,444 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:26,445 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787706403_0001_000000, appSubmitTime=1452787706430, launchTime=1452787706430
2016-01-14 16:08:26,451 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:48029
2016-01-14 16:08:26,451 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:26,452 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:26,454 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:26,454 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:26,455 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:26,457 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787706403_0001_000000, startTime=1452787706457
2016-01-14 16:08:26,457 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:26,458 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:26,528 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:26,528 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:26,528 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452787706403_0001, dagName=[AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:26,542 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:26,544 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787706403_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001/localmode-log-dir/dag_1452787706403_0001_1.dot
2016-01-14 16:08:26,544 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001/localmode-log-dir/dag_1452787706403_0001_1-tez-dag.pb.txt
2016-01-14 16:08:26,549 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787706403_0001_1
2016-01-14 16:08:26,549 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,550 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:26 Running Dag: dag_1452787706403_0001_1
2016-01-14 16:08:26,560 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787706403_0001_1, submitTime=1452787706542
2016-01-14 16:08:26,560 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:26,560 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E7E7C875973C43B7B1B536E423AC1944
2016-01-14 16:08:26,561 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:26,561 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787706403_0001_1, initTime=1452787706560
2016-01-14 16:08:26,561 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:26,562 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706403_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:26,562 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:DAG_STARTED]: dagID=dag_1452787706403_0001_1, startTime=1452787706562
2016-01-14 16:08:26,562 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:26,562 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:26,562 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706403_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:26,563 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E7E7C875973C43B7B1B536E423AC1944 : {D9B0DBE0FBEE47F1BC62A6721A515C53={InputName=D9B0DBE0FBEE47F1BC62A6721A515C53}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:26,563 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: D9B0DBE0FBEE47F1BC62A6721A515C53, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:26,563 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,563 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452787706403_0001, dagName=[AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2'
2016-01-14 16:08:26,563 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,563 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,564 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]. Starting root input initializers: 1
2016-01-14 16:08:26,564 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:26,564 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: D9B0DBE0FBEE47F1BC62A6721A515C53 on vertex vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,566 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:26,566 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input D9B0DBE0FBEE47F1BC62A6721A515C53 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:26,567 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:26,567 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:26,568 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:26,568 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: D9B0DBE0FBEE47F1BC62A6721A515C53 on vertex vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,569 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:26,569 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {D9B0DBE0FBEE47F1BC62A6721A515C53=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:26,569 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] parallelism set to 1
2016-01-14 16:08:26,569 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:26,569 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787706403_0001_1_00, eventCount=1
2016-01-14 16:08:26,570 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,570 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=D797D69B8ACC44F9AB69D10672513B85, vertexId=vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:26,570 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=D797D69B8ACC44F9AB69D10672513B85, vertexId=vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,571 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=D797D69B8ACC44F9AB69D10672513B85, vertexName=E7E7C875973C43B7B1B536E423AC1944, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:26,572 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=D797D69B8ACC44F9AB69D10672513B85, vertexId=vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,572 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:26,573 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, vertexId=vertex_1452787706403_0001_1_00, initRequestedTime=1452787706563, initedTime=1452787706572, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:26,573 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] with distanceFromRoot: 0
2016-01-14 16:08:26,573 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:26,573 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E7E7C875973C43B7B1B536E423AC1944
2016-01-14 16:08:26,573 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,574 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:26,574 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787706403_0001_1_00, startRequestedTime=1452787706573, startedTime=1452787706573
2016-01-14 16:08:26,574 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:26,575 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:26,575 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:TASK_STARTED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, taskId=task_1452787706403_0001_1_00_000000, scheduledTime=1452787706575, launchTime=1452787706575
2016-01-14 16:08:26,576 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706403_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:26,576 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,576 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2', VertexName: E7E7C875973C43B7B1B536E423AC1944, VertexParallelism: 1, TaskAttemptID:attempt_1452787706403_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D9B0DBE0FBEE47F1BC62A6721A515C53, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D797D69B8ACC44F9AB69D10672513B85, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:26,576 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706403_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:26,577 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:26,577 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:26,578 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:26,578 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:26,578 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787706403_0001_00_000001
2016-01-14 16:08:26,578 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:26,580 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787706403_0001_00_000001
2016-01-14 16:08:26,580 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:26,581 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:26,581 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787706403_0001, with dag id: dag_1452787706403_0001_1
2016-01-14 16:08:26,582 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:26,582 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787706403_0001_00_000001, launchTime=1452787706581
2016-01-14 16:08:26,583 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787706403_0001_00_000001
2016-01-14 16:08:26,584 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787706403_0001_1_00_000000_0] to container: [container_1452787706403_0001_00_000001]
2016-01-14 16:08:26,584 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:26,585 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787706403_0001_00_000001 given task: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,585 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787706403_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,585 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787706403_0001_1_00_000000_0] started. Is using containerId: [container_1452787706403_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:26,585 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0, startTime=1452787706585, containerId=container_1452787706403_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787706403_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:26,586 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706403_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:26 Starting to run new task attempt: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,586 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,586 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,586 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:26,586 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706403_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:26,586 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:26,587 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:26,587 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:26,588 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:26,588 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:26,588 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684] every.every/(1/1) ...SULTS.0_'field2'_'field2', VertexName: E7E7C875973C43B7B1B536E423AC1944, VertexParallelism: 1, TaskAttemptID:attempt_1452787706403_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=D9B0DBE0FBEE47F1BC62A6721A515C53, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=D797D69B8ACC44F9AB69D10672513B85, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:26,588 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:26,589 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,589 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:26,590 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,590 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787706403_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:26,591 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,591 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=D797D69B8ACC44F9AB69D10672513B85, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:26,591 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=D9B0DBE0FBEE47F1BC62A6721A515C53, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:26,591 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:26,591 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:26,592 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: D797D69B8ACC44F9AB69D10672513B85
2016-01-14 16:08:26,592 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:26,592 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: D797D69B8ACC44F9AB69D10672513B85
2016-01-14 16:08:26,592 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,593 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,594 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:26,597 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:26,598 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,598 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,605 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E7E7C875973C43B7B1B536E423AC1944, ordinal: 0
2016-01-14 16:08:26,605 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E7E7C875973C43B7B1B536E423AC1944, mem on start (mb), free: 252, total: 384, max: 672
2016-01-14 16:08:26,605 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:26,606 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:26,606 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:26,610 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:26,610 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: D797D69B8ACC44F9AB69D10672513B85
2016-01-14 16:08:26,611 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:26,611 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:26,611 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:26,611 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:26,611 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:26,612 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:26,612 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:26,612 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:26,612 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, D797D69B8ACC44F9AB69D10672513B85, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:26,613 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, D9B0DBE0FBEE47F1BC62A6721A515C53, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:26,613 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:26,613 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,614 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:26,614 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,614 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: D9B0DBE0FBEE47F1BC62A6721A515C53 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:26,614 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:26,615 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:26,615 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:26,615 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,616 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:26,617 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@21b4869f
2016-01-14 16:08:26,618 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@21b4869f
2016-01-14 16:08:26,618 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:26,618 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,618 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:26,619 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: D9B0DBE0FBEE47F1BC62A6721A515C53
2016-01-14 16:08:26,619 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"], id: D797D69B8ACC44F9AB69D10672513B85
2016-01-14 16:08:26,619 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_'field2'"]
2016-01-14 16:08:26,619 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,619 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:26,620 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E7E7C875973C43B7B1B536E423AC1944, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:26,631 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:26,631 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:26,632 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,632 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787706403_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:26,633 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,633 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E7E7C875973C43B7B1B536E423AC1944, mem on close (mb), free: 250, total: 384, max: 672
2016-01-14 16:08:26 Completed running task attempt: attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,634 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:26,635 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787706620, Process_Duration=13, Process_End_Time=1452787706633, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=9][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:26,636 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:26,636 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, taskAttemptId=attempt_1452787706403_0001_1_00_000000_0, startTime=1452787706585, finishTime=1452787706635, timeTaken=50, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706620, Process_Duration=13, Process_End_Time=1452787706633, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=9, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,636 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706403_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:26,636 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:26,636 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787706403_0001_1_00_000000_0
2016-01-14 16:08:26,636 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,636 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:26,637 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:TASK_FINISHED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, taskId=task_1452787706403_0001_1_00_000000, startTime=1452787706585, finishTime=1452787706636, timeTaken=51, status=SUCCEEDED, successfulAttemptID=attempt_1452787706403_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706620, Process_Duration=13, Process_End_Time=1452787706633, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=9, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,637 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787706403_0001_00_000001
2016-01-14 16:08:26,637 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706403_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:26,638 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] : 1
2016-01-14 16:08:26,638 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,637 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:26,639 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:26,639 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:VERTEX_FINISHED]: vertexName=E7E7C875973C43B7B1B536E423AC1944, vertexId=vertex_1452787706403_0001_1_00, initRequestedTime=1452787706563, initedTime=1452787706572, startRequestedTime=1452787706573, startedTime=1452787706573, finishTime=1452787706638, timeTaken=65, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706620, Process_Duration=13, Process_End_Time=1452787706633, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=9, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787706585, firstTasksToStart=[ task_1452787706403_0001_1_00_000000 ], lastTaskFinishTime=1452787706635, lastTasksToFinish=[ task_1452787706403_0001_1_00_000000 ], minTaskDuration=50, maxTaskDuration=50, avgTaskDuration=50.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787706403_0001_1_00_000000 ], longestDurationTasks=[ task_1452787706403_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:26,639 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:26,639 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:26,640 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787706403_0001_00_000001, stoppedTime=1452787706640, exitStatus=0
2016-01-14 16:08:26,640 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:26,640 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:26,640 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:26,640 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787706403_0001_1
2016-01-14 16:08:26,641 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787706403_0001_1
2016-01-14 16:08:26,641 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: D797D69B8ACC44F9AB69D10672513B85 for vertex: vertex_1452787706403_0001_1_00 [E7E7C875973C43B7B1B536E423AC1944]
2016-01-14 16:08:26,648 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787706403_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:26,648 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787706403_0001_00_000001: 10 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:26,648 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787706403_0001_00_000001, Exiting
2016-01-14 16:08:26,648 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787706403_0001_00_000001
2016-01-14 16:08:26,648 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787706403_0001_00_000001
2016-01-14 16:08:26,650 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787706403_0001_1, queueSize=0
2016-01-14 16:08:26,650 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787706403_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:26,650 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706403_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787706403_0001_1, startTime=1452787706562, finishTime=1452787706647, timeTaken=85, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787706620, Process_Duration=13, Process_End_Time=1452787706633, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=9, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:26,650 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:26,650 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787706403_0001_00_000001 completed successfully
2016-01-14 16:08:26,651 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787706403_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:26,651 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706403_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:26,652 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706403_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:26,652 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787706403_0001_00_000001
2016-01-14 16:08:26 Completed Dag: dag_1452787706403_0001_1
2016-01-14 16:08:26,653 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787706403_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:26,653 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787706403_0001_1_post
2016-01-14 16:08:26,653 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:26,653 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:26,658 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...SULTS.0_'field2'_'field2', applicationId=application_1452787706403_0001
2016-01-14 16:08:26,660 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:26,660 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:26,660 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:26,661 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:26,661 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:26,661 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:26,662 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:26,662 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:26,662 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:26,663 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:26,663 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:26,663 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:26,664 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:26,667 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/AC61ADC7C86A457EA66B60813FD1600C/CD7DED0797AD4568A6D862F6B972F684/.tez/application_1452787706403_0001
2016-01-14 16:08:26,668 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.284
2016-01-14 16:08:26,734 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_'field2'
2016-01-14 16:08:26,754 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:26,754 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:26,794 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.011
2016-01-14 16:08:26,799 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.016
2016-01-14 16:08:26,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:26,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:26,800 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:26,813 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:26,813 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS
2016-01-14 16:08:26,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:26,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:26,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"]
2016-01-14 16:08:26,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:26,822 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:26,823 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:26,823 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:26,823 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:26,841 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:26,846 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:26,847 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:26,847 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:26,857 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001 doesn't exist and is created
2016-01-14 16:08:26,872 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:26,872 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:26,873 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001
2016-01-14 16:08:26,876 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787706847_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:26,886 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:26,886 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:26,888 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:26,888 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:26,889 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001/localmode-log-dir
2016-01-14 16:08:26,889 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001/localmode-log-dir/history.txt.appattempt_1452787706847_0001_000000, maxErrors=10
2016-01-14 16:08:26,889 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:26,889 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787706847_0001_000000, appSubmitTime=1452787706875, launchTime=1452787706875
2016-01-14 16:08:26,894 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:26,895 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:26,896 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:26,896 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:26,899 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:45872
2016-01-14 16:08:26,902 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:26,904 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787706847_0001_000000, startTime=1452787706904
2016-01-14 16:08:26,905 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:26,905 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:26,973 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:26,973 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:26,973 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452787706847_0001, dagName=[1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:26,988 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:26,989 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787706847_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001/localmode-log-dir/dag_1452787706847_0001_1.dot
2016-01-14 16:08:26,990 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001/localmode-log-dir/dag_1452787706847_0001_1-tez-dag.pb.txt
2016-01-14 16:08:27,005 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787706847_0001_1
2016-01-14 16:08:27,005 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,006 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:27 Running Dag: dag_1452787706847_0001_1
2016-01-14 16:08:27,017 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:27,018 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787706847_0001_1, submitTime=1452787706988
2016-01-14 16:08:27,018 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex E0EF08A648904039A94246587893B7BF
2016-01-14 16:08:27,018 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:27,019 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:27,019 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787706847_0001_1, initTime=1452787707018
2016-01-14 16:08:27,020 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706847_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:27,020 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:27,020 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:DAG_STARTED]: dagID=dag_1452787706847_0001_1, startTime=1452787707020
2016-01-14 16:08:27,020 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:27,020 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706847_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:27,021 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: E0EF08A648904039A94246587893B7BF : {838F4AF9F7EB4F81A0A385CD1876F987={InputName=838F4AF9F7EB4F81A0A385CD1876F987}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:27,021 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 838F4AF9F7EB4F81A0A385CD1876F987, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:27,021 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,021 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,021 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,025 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]. Starting root input initializers: 1
2016-01-14 16:08:27,025 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:27,026 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452787706847_0001, dagName=[1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS
2016-01-14 16:08:27,026 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 838F4AF9F7EB4F81A0A385CD1876F987 on vertex vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,028 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:27,028 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 838F4AF9F7EB4F81A0A385CD1876F987 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:27,028 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:27,029 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:27,030 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:27,031 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 838F4AF9F7EB4F81A0A385CD1876F987 on vertex vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,031 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,031 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {838F4AF9F7EB4F81A0A385CD1876F987=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:27,031 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] parallelism set to 1
2016-01-14 16:08:27,031 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,032 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787706847_0001_1_00, eventCount=1
2016-01-14 16:08:27,032 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:27,032 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,032 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=932D487A2FD44C69B5752B3B1451901E, vertexId=vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:27,032 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:27,034 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=932D487A2FD44C69B5752B3B1451901E, vertexId=vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,036 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=932D487A2FD44C69B5752B3B1451901E, vertexName=E0EF08A648904039A94246587893B7BF, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:27,036 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=932D487A2FD44C69B5752B3B1451901E, vertexId=vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,037 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:27,038 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:VERTEX_INITIALIZED]: vertexName=E0EF08A648904039A94246587893B7BF, vertexId=vertex_1452787706847_0001_1_00, initRequestedTime=1452787707021, initedTime=1452787707037, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:27,038 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] with distanceFromRoot: 0
2016-01-14 16:08:27,038 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:27,038 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in E0EF08A648904039A94246587893B7BF
2016-01-14 16:08:27,038 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,038 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:27,039 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787706847_0001_1_00, startRequestedTime=1452787707038, startedTime=1452787707038
2016-01-14 16:08:27,039 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:27,039 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:27,040 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:TASK_STARTED]: vertexName=E0EF08A648904039A94246587893B7BF, taskId=task_1452787706847_0001_1_00_000000, scheduledTime=1452787707039, launchTime=1452787707039
2016-01-14 16:08:27,040 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706847_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:27,040 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,040 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS, VertexName: E0EF08A648904039A94246587893B7BF, VertexParallelism: 1, TaskAttemptID:attempt_1452787706847_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=838F4AF9F7EB4F81A0A385CD1876F987, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=932D487A2FD44C69B5752B3B1451901E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:27,041 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706847_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:27,041 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:27,041 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787706847_0001, with dag id: dag_1452787706847_0001_1
2016-01-14 16:08:27,043 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:27,043 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:27,043 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:27,044 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787706847_0001_00_000001
2016-01-14 16:08:27,044 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:27,046 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787706847_0001_00_000001
2016-01-14 16:08:27,046 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:27,046 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:27,047 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787706847_0001_00_000001, launchTime=1452787707046
2016-01-14 16:08:27,046 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:27,047 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787706847_0001_00_000001
2016-01-14 16:08:27,048 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787706847_0001_1_00_000000_0] to container: [container_1452787706847_0001_00_000001]
2016-01-14 16:08:27,049 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:27,049 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787706847_0001_00_000001 given task: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,049 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787706847_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27 Starting to run new task attempt: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,050 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787706847_0001_1_00_000000_0] started. Is using containerId: [container_1452787706847_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:27,050 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,050 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,050 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:27,051 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:27,050 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=E0EF08A648904039A94246587893B7BF, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0, startTime=1452787707050, containerId=container_1452787706847_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787706847_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:27,050 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:27,051 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706847_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:27,051 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:27,051 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706847_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:27,051 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:27,051 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:27,052 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1] every.every/(1/1) ...ESULTS.0_'field2'_RESULTS, VertexName: E0EF08A648904039A94246587893B7BF, VertexParallelism: 1, TaskAttemptID:attempt_1452787706847_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=838F4AF9F7EB4F81A0A385CD1876F987, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=932D487A2FD44C69B5752B3B1451901E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:27,052 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:27,052 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,052 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:27,052 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,054 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=838F4AF9F7EB4F81A0A385CD1876F987, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:27,054 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:27,054 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,054 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,059 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,058 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787706847_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:27,057 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=932D487A2FD44C69B5752B3B1451901E, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:27,060 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:27,060 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 932D487A2FD44C69B5752B3B1451901E
2016-01-14 16:08:27,060 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:27,061 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 932D487A2FD44C69B5752B3B1451901E
2016-01-14 16:08:27,061 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:27,062 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:27,062 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,063 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,072 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:27,072 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 932D487A2FD44C69B5752B3B1451901E
2016-01-14 16:08:27,076 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: E0EF08A648904039A94246587893B7BF, ordinal: 0
2016-01-14 16:08:27,076 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E0EF08A648904039A94246587893B7BF, mem on start (mb), free: 175, total: 384, max: 672
2016-01-14 16:08:27,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:27,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:27,076 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:27,077 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:27,077 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:27,077 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:27,078 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:27,078 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:27,078 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:27,078 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:27,078 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 838F4AF9F7EB4F81A0A385CD1876F987, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:27,078 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 932D487A2FD44C69B5752B3B1451901E, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:27,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:27,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 838F4AF9F7EB4F81A0A385CD1876F987 being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:27,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,079 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:27,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,079 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:27,080 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:27,080 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:27,080 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,080 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:27,083 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@1494a702
2016-01-14 16:08:27,083 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,084 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@1494a702
2016-01-14 16:08:27,084 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:27,084 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:27,085 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 838F4AF9F7EB4F81A0A385CD1876F987
2016-01-14 16:08:27,085 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"], id: 932D487A2FD44C69B5752B3B1451901E
2016-01-14 16:08:27,085 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_RESULTS"]
2016-01-14 16:08:27,085 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,085 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:27,086 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: E0EF08A648904039A94246587893B7BF, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:27,089 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:27,089 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:27,089 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,090 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787706847_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:27,090 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,090 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: E0EF08A648904039A94246587893B7BF, mem on close (mb), free: 174, total: 384, max: 672
2016-01-14 16:08:27 Completed running task attempt: attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,092 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:27,093 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=E0EF08A648904039A94246587893B7BF, taskAttemptId=attempt_1452787706847_0001_1_00_000000_0, startTime=1452787707050, finishTime=1452787707093, timeTaken=43, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707086, Process_Duration=4, Process_End_Time=1452787707090, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,093 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787706847_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:27,093 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787706847_0001_1_00_000000_0
2016-01-14 16:08:27,094 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:27,094 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:TASK_FINISHED]: vertexName=E0EF08A648904039A94246587893B7BF, taskId=task_1452787706847_0001_1_00_000000, startTime=1452787707050, finishTime=1452787707094, timeTaken=44, status=SUCCEEDED, successfulAttemptID=attempt_1452787706847_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707086, Process_Duration=4, Process_End_Time=1452787707090, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,094 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:27,095 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787706847_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:27,095 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] : 1
2016-01-14 16:08:27,095 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,095 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:27,096 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:VERTEX_FINISHED]: vertexName=E0EF08A648904039A94246587893B7BF, vertexId=vertex_1452787706847_0001_1_00, initRequestedTime=1452787707021, initedTime=1452787707037, startRequestedTime=1452787707038, startedTime=1452787707038, finishTime=1452787707095, timeTaken=57, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707086, Process_Duration=4, Process_End_Time=1452787707090, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787707050, firstTasksToStart=[ task_1452787706847_0001_1_00_000000 ], lastTaskFinishTime=1452787707093, lastTasksToFinish=[ task_1452787706847_0001_1_00_000000 ], minTaskDuration=43, maxTaskDuration=43, avgTaskDuration=43.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787706847_0001_1_00_000000 ], longestDurationTasks=[ task_1452787706847_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:27,096 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:27,097 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:27,097 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787706847_0001_00_000001, stoppedTime=1452787707097, exitStatus=0
2016-01-14 16:08:27,097 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:27,097 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:27,097 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787706847_0001_1
2016-01-14 16:08:27,098 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787706847_0001_1
2016-01-14 16:08:27,098 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 932D487A2FD44C69B5752B3B1451901E for vertex: vertex_1452787706847_0001_1_00 [E0EF08A648904039A94246587893B7BF]
2016-01-14 16:08:27,100 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:27,097 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 22 [[org.apache.tez.common.counters.DAGCounter RACK_LOCAL_TASKS=1][File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787707086, Process_Duration=4, Process_End_Time=1452787707090, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:27,101 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:27,101 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,101 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787706847_0001_00_000001
2016-01-14 16:08:27,101 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787706847_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:27,101 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787706847_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:27,101 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:27,101 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787706847_0001_00_000001, Exiting
2016-01-14 16:08:27,101 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787706847_0001_00_000001
2016-01-14 16:08:27,102 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787706847_0001_00_000001
2016-01-14 16:08:27,104 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787706847_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:27,104 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787706847_0001_00_000001 completed successfully
2016-01-14 16:08:27,110 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787706847_0001_1, queueSize=0
2016-01-14 16:08:27,110 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:27,110 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787706847_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787706847_0001_1, startTime=1452787707020, finishTime=1452787707109, timeTaken=89, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=672, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=402653184, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707086, Process_Duration=4, Process_End_Time=1452787707090, Read_Duration=2, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,110 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787706847_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:27,110 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787706847_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:27,111 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787706847_0001_00_000001
2016-01-14 16:08:27,111 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787706847_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:27 Completed Dag: dag_1452787706847_0001_1
2016-01-14 16:08:27,112 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787706847_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:27,112 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787706847_0001_1_post
2016-01-14 16:08:27,113 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,113 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:27,117 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...ESULTS.0_'field2'_RESULTS, applicationId=application_1452787706847_0001
2016-01-14 16:08:27,119 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:27,119 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:27,119 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:27,119 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:27,119 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:27,120 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:27,120 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:27,121 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:27,121 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:27,121 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:27,122 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:27,122 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:27,122 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:27,127 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/1DE11905E75D453FB313D597125BE0BB/BF5B042CA91744D2B8D6A809E7C41ED1/.tez/application_1452787706847_0001
2016-01-14 16:08:27,128 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.305
2016-01-14 16:08:27,197 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_RESULTS
2016-01-14 16:08:27,217 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:27,217 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:27,248 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.009
2016-01-14 16:08:27,258 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.018
2016-01-14 16:08:27,259 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:27,259 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:27,259 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:27,288 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:27,289 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,299 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:27,299 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,300 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"]
2016-01-14 16:08:27,300 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:27,300 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:27,300 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:27,300 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,302 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:27,314 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:27,318 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:27,319 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:27,319 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:27,328 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001 doesn't exist and is created
2016-01-14 16:08:27,343 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:27,343 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:27,344 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001
2016-01-14 16:08:27,347 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787707319_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:27,356 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:27,357 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:27,359 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:27,359 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:27,359 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001/localmode-log-dir
2016-01-14 16:08:27,360 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001/localmode-log-dir/history.txt.appattempt_1452787707319_0001_000000, maxErrors=10
2016-01-14 16:08:27,360 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:27,360 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787707319_0001_000000, appSubmitTime=1452787707346, launchTime=1452787707346
2016-01-14 16:08:27,364 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:27,366 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:27,367 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:27,367 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:27,370 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:44189
2016-01-14 16:08:27,371 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:27,374 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787707319_0001_000000, startTime=1452787707374
2016-01-14 16:08:27,375 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:27,375 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:27,443 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:27,443 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:27,444 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452787707319_0001, dagName=[776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,458 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,460 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787707319_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001/localmode-log-dir/dag_1452787707319_0001_1.dot
2016-01-14 16:08:27,460 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001/localmode-log-dir/dag_1452787707319_0001_1-tez-dag.pb.txt
2016-01-14 16:08:27,465 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787707319_0001_1
2016-01-14 16:08:27,465 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,466 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27 Running Dag: dag_1452787707319_0001_1
2016-01-14 16:08:27,477 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787707319_0001_1, submitTime=1452787707459
2016-01-14 16:08:27,477 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:27,478 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex D9B991A2FC1844E086101E9AD6927E58
2016-01-14 16:08:27,478 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:27,479 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:27,479 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787707319_0001_1, initTime=1452787707477
2016-01-14 16:08:27,480 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787707319_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:27,480 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:DAG_STARTED]: dagID=dag_1452787707319_0001_1, startTime=1452787707480
2016-01-14 16:08:27,480 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:27,480 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:27,480 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787707319_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:27,480 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: D9B991A2FC1844E086101E9AD6927E58 : {07B4E09DF18042AEB0FCD9A70A2C7FEE={InputName=07B4E09DF18042AEB0FCD9A70A2C7FEE}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 07B4E09DF18042AEB0FCD9A70A2C7FEE, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]. Starting root input initializers: 1
2016-01-14 16:08:27,481 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:27,482 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 07B4E09DF18042AEB0FCD9A70A2C7FEE on vertex vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,482 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452787707319_0001, dagName=[776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,485 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:27,485 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 07B4E09DF18042AEB0FCD9A70A2C7FEE asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:27,485 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:27,486 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:27,487 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:27,487 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 07B4E09DF18042AEB0FCD9A70A2C7FEE on vertex vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,488 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,488 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {07B4E09DF18042AEB0FCD9A70A2C7FEE=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:27,488 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] parallelism set to 1
2016-01-14 16:08:27,488 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,488 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787707319_0001_1_00, eventCount=1
2016-01-14 16:08:27,489 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,489 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=371FE588973A4C3C8FEC7BEBCCF40810, vertexId=vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:27,489 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=371FE588973A4C3C8FEC7BEBCCF40810, vertexId=vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,491 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=371FE588973A4C3C8FEC7BEBCCF40810, vertexName=D9B991A2FC1844E086101E9AD6927E58, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:27,491 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=371FE588973A4C3C8FEC7BEBCCF40810, vertexId=vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,492 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:VERTEX_INITIALIZED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, vertexId=vertex_1452787707319_0001_1_00, initRequestedTime=1452787707480, initedTime=1452787707492, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:27,492 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] with distanceFromRoot: 0
2016-01-14 16:08:27,492 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:27,493 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:27,493 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in D9B991A2FC1844E086101E9AD6927E58
2016-01-14 16:08:27,493 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,494 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:27,494 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787707319_0001_1_00, startRequestedTime=1452787707493, startedTime=1452787707493
2016-01-14 16:08:27,494 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:27,495 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:27,495 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:TASK_STARTED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, taskId=task_1452787707319_0001_1_00_000000, scheduledTime=1452787707494, launchTime=1452787707494
2016-01-14 16:08:27,495 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787707319_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:27,496 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,496 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL, VertexName: D9B991A2FC1844E086101E9AD6927E58, VertexParallelism: 1, TaskAttemptID:attempt_1452787707319_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=07B4E09DF18042AEB0FCD9A70A2C7FEE, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=371FE588973A4C3C8FEC7BEBCCF40810, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:27,496 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787707319_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:27,497 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:27,497 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:27,498 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:27,498 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:27,499 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787707319_0001_00_000001
2016-01-14 16:08:27,499 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:27,500 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787707319_0001, with dag id: dag_1452787707319_0001_1
2016-01-14 16:08:27,501 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787707319_0001_00_000001
2016-01-14 16:08:27,501 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(144)) - DAGAppMaster metrics system already initialized!
2016-01-14 16:08:27,502 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from LAUNCHING to IDLE via event C_LAUNCHED
2016-01-14 16:08:27,502 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_LAUNCHED to history file
2016-01-14 16:08:27,503 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:CONTAINER_LAUNCHED]: containerId=container_1452787707319_0001_00_000001, launchTime=1452787707502
2016-01-14 16:08:27,504 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787707319_0001_00_000001
2016-01-14 16:08:27,505 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(827)) - Assigned taskAttempt + [attempt_1452787707319_0001_1_00_000000_0] to container: [container_1452787707319_0001_00_000001]
2016-01-14 16:08:27,505 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from IDLE to RUNNING via event C_PULL_TA
2016-01-14 16:08:27,505 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(240)) - Container with id: container_1452787707319_0001_00_000001 given task: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,505 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787707319_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,505 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1146)) - TaskAttempt: [attempt_1452787707319_0001_1_00_000000_0] started. Is using containerId: [container_1452787707319_0001_00_000001] on NM: [127.0.0.1:0]
2016-01-14 16:08:27,506 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:TASK_ATTEMPT_STARTED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0, startTime=1452787707505, containerId=container_1452787707319_0001_00_000001, nodeId=127.0.0.1:0, inProgressLogs=127.0.0.1:0/node/containerlogs/container_1452787707319_0001_00_000001/teamcity, completedLogs=
2016-01-14 16:08:27 Starting to run new task attempt: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,506 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787707319_0001_1_00_000000_0 TaskAttempt Transitioned from START_WAIT to RUNNING due to event TA_STARTED_REMOTELY
2016-01-14 16:08:27,506 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_STARTED to history file
2016-01-14 16:08:27,506 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,506 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,506 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(273)) - Refreshing UGI since Credentials have changed
2016-01-14 16:08:27,506 INFO  task.TezChild (TezChild.java:handleNewTaskCredentials(276)) - Credentials : #Tokens=1, #SecretKeys=0
2016-01-14 16:08:27,507 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(302)) - Localizing additional local resources for Task : {}
2016-01-14 16:08:27,507 INFO  task.TezChild (TezChild.java:handleNewTaskLocalResources(312)) - Done localizing additional resources
2016-01-14 16:08:27,507 INFO  metrics.TaskCounterUpdater (TaskCounterUpdater.java:initResourceCalculatorPlugin(148)) -  Using ResourceCalculatorProcessTree : [ ]
2016-01-14 16:08:27,507 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:<init>(149)) - Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : [776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F] every.every/(1/1) ...d'_RESULTS.0_'field2'_ALL, VertexName: D9B991A2FC1844E086101E9AD6927E58, VertexParallelism: 1, TaskAttemptID:attempt_1452787707319_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=07B4E09DF18042AEB0FCD9A70A2C7FEE, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=371FE588973A4C3C8FEC7BEBCCF40810, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:27,507 INFO  resources.MemoryDistributor (MemoryDistributor.java:<init>(85)) - InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=704643072
2016-01-14 16:08:27,506 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787707319_0001_1_00_000000 Task Transitioned from SCHEDULED to RUNNING due to event T_ATTEMPT_LAUNCHED
2016-01-14 16:08:27,508 INFO  task.TezTaskRunner (TezTaskRunner.java:run(172)) - Initializing task, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,508 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(191)) - Initializing LogicalProcessorIORuntimeTask
2016-01-14 16:08:27,509 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(195)) - Creating processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,509 INFO  impl.TaskImpl (TaskImpl.java:getTaskAttemptTezEvents(481)) - TaskAttempt:attempt_1452787707319_0001_1_00_000000_0 sent events: (0-1)
2016-01-14 16:08:27,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(389)) - Initializing Input using InputSpec: { sourceVertexName=07B4E09DF18042AEB0FCD9A70A2C7FEE, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }
2016-01-14 16:08:27,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createInput(537)) - Creating Input
2016-01-14 16:08:27,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(438)) - Initializing Output using OutputSpec: { destinationVertexName=371FE588973A4C3C8FEC7BEBCCF40810, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }
2016-01-14 16:08:27,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(488)) - Initializing processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,511 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:createOutput(565)) - Creating Output
2016-01-14 16:08:27,511 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(446)) - Initializing Output with dest edge: 371FE588973A4C3C8FEC7BEBCCF40810
2016-01-14 16:08:27,511 INFO  output.MROutput (MROutput.java:initialize(347)) - Initializing Simple Output
2016-01-14 16:08:27,511 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: OUTPUT, componentVertexName: 371FE588973A4C3C8FEC7BEBCCF40810
2016-01-14 16:08:27,510 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(397)) - Initializing Input with src edge: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,512 INFO  resources.MemoryDistributor$RequestorInfo (MemoryDistributor.java:<init>(233)) - Received request: 0, type: INPUT, componentVertexName: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,516 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(88)) - cascading version: 3.0.4
2016-01-14 16:08:27,518 INFO  input.MRInput (MRInput.java:initialize(440)) - Using New mapreduce API: false, split information via event: true
2016-01-14 16:08:27,518 INFO  input.MRInput (MRInput.java:initializeInternal(493)) - Initialzed MRInput: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,519 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(403)) - Initialized Input with src edge: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,524 INFO  tez.FlowProcessor (FlowProcessor.java:initialize(94)) - flow node id: D9B991A2FC1844E086101E9AD6927E58, ordinal: 0
2016-01-14 16:08:27,524 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D9B991A2FC1844E086101E9AD6927E58, mem on start (mb), free: 306, total: 384, max: 672
2016-01-14 16:08:27,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initializeLogicalIOProcessor(491)) - Initialized processor, processorClassName=cascading.flow.tez.FlowProcessor
2016-01-14 16:08:27,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 2 initializers to finish
2016-01-14 16:08:27,524 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(220)) - Waiting for 1 initializers to finish
2016-01-14 16:08:27,526 INFO  output.MROutput (MROutput.java:initialize(418)) - Initialized Simple Output, using_new_api: false
2016-01-14 16:08:27,526 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(452)) - Initialized Output with dest edge: 371FE588973A4C3C8FEC7BEBCCF40810
2016-01-14 16:08:27,527 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(233)) - All initializers finished
2016-01-14 16:08:27,527 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(124)) - Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
2016-01-14 16:08:27,527 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.output.MROutput
2016-01-14 16:08:27,527 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:27,528 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:getRequestTypeForClass(197)) - Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInput
2016-01-14 16:08:27,528 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:initialProcessMemoryRequestContext(171)) - ScaleFactor: 1, for type: OTHER
2016-01-14 16:08:27,528 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:computeReservedFraction(262)) - InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996
2016-01-14 16:08:27,528 INFO  resources.WeightedScalingMemoryDistributor (WeightedScalingMemoryDistributor.java:assignMemory(126)) - Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 704643072, TotalAvailable: 472110858, TotalRequested/TotalJVMHeap:0.00
2016-01-14 16:08:27,529 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: OUTPUT, 371FE588973A4C3C8FEC7BEBCCF40810, org.apache.tez.mapreduce.output.MROutput: requested=0, allocated=0
2016-01-14 16:08:27,529 INFO  resources.MemoryDistributor (MemoryDistributor.java:makeInitialAllocations(138)) - Informing: INPUT, 07B4E09DF18042AEB0FCD9A70A2C7FEE, org.apache.tez.mapreduce.input.MRInput: requested=0, allocated=0
2016-01-14 16:08:27,529 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(255)) - Starting Inputs/Outputs
2016-01-14 16:08:27,529 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(268)) - Input: 07B4E09DF18042AEB0FCD9A70A2C7FEE being auto started by the framework. Subsequent instances will not be auto-started
2016-01-14 16:08:27,529 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(419)) - Starting Input with src edge: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,530 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:27,530 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:call(421)) - Started Input with src edge: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,530 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(289)) - Num IOs determined for AutoStart: 1
2016-01-14 16:08:27,530 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(291)) - Waiting for 1 IOs to start
2016-01-14 16:08:27,531 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:initialize(304)) - AutoStartComplete
2016-01-14 16:08:27,531 INFO  task.TezTaskRunner (TezTaskRunner.java:run(175)) - Running task, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,531 INFO  input.MRInput (MRInput.java:initFromEventInternal(619)) - Initializing RecordReader from event
2016-01-14 16:08:27,532 INFO  input.MRInput (MRInput.java:initFromEventInternal(630)) - Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@3a278a78
2016-01-14 16:08:27,533 INFO  lib.MRReaderMapred (MRReaderMapred.java:setIncrementalConfigParams(163)) - Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@3a278a78
2016-01-14 16:08:27,533 INFO  input.MRInput (MRInput.java:initFromEventInternal(634)) - Initialized RecordReader from event
2016-01-14 16:08:27,533 INFO  input.MRInput (MRInput.java:processSplitEvent(586)) - Notifying on RecordReader Initialized
2016-01-14 16:08:27,535 INFO  graph.Hadoop2TezStreamGraph (Hadoop2TezStreamGraph.java:buildGraph(151)) - using streamed source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,536 INFO  tez.FlowProcessor (FlowProcessor.java:run(121)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"] streamed: true, id: 07B4E09DF18042AEB0FCD9A70A2C7FEE
2016-01-14 16:08:27,536 INFO  tez.FlowProcessor (FlowProcessor.java:run(124)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"], id: 371FE588973A4C3C8FEC7BEBCCF40810
2016-01-14 16:08:27,536 INFO  element.TezSinkStage (TezSinkStage.java:prepare(57)) - calling MROutput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_'field2'_ALL"]
2016-01-14 16:08:27,536 INFO  element.TezSourceStage (TezSourceStage.java:prepare(63)) - calling MRInput#start() on: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,536 INFO  input.MRInput (MRInput.java:start(450)) - MRInput setup to received events1
2016-01-14 16:08:27,537 INFO  tez.FlowProcessor (FlowProcessor.java:waitForInputsReady(202)) - flow node id: D9B991A2FC1844E086101E9AD6927E58, all 1 inputs ready in: 00:00:00.000
2016-01-14 16:08:27,539 INFO  output.MROutput (MROutput.java:flush(534)) - Flushing Simple Output
2016-01-14 16:08:27,539 INFO  output.MROutput (MROutput.java:flush(544)) - Flushed Simple Output
2016-01-14 16:08:27,539 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:canCommit(353)) - Commit go/no-go request from attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,539 INFO  impl.TaskImpl (TaskImpl.java:canCommit(750)) - attempt_1452787707319_0001_1_00_000000_0 given a go for committing the task output.
2016-01-14 16:08:27,540 INFO  task.TezTaskRunner (TezTaskRunner.java:run(177)) - Closing task, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,540 INFO  tez.FlowProcessor (LogUtil.java:logMemory(59)) - flow node id: D9B991A2FC1844E086101E9AD6927E58, mem on close (mb), free: 304, total: 384, max: 672
2016-01-14 16:08:27 Completed running task attempt: attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,541 INFO  task.TezTaskRunner (TezTaskRunner.java:run(181)) - Task completed, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0, fatalErrorOccurred=false
2016-01-14 16:08:27,542 INFO  runtime.LogicalIOProcessorRuntimeTask (LogicalIOProcessorRuntimeTask.java:cleanup(712)) - Final Counters : Counters: 21 [[File System Counters FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20][cascading.flow.SliceCounters Process_Begin_Time=1452787707537, Process_Duration=3, Process_End_Time=1452787707540, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0][cascading.flow.StepCounters Tuples_Read=20, Tuples_Written=20]]
2016-01-14 16:08:27,542 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:TASK_ATTEMPT_FINISHED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, taskAttemptId=attempt_1452787707319_0001_1_00_000000_0, startTime=1452787707505, finishTime=1452787707542, timeTaken=37, status=SUCCEEDED, errorEnum=, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707537, Process_Duration=3, Process_End_Time=1452787707540, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,542 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: 
2016-01-14 16:08:27,542 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787707319_0001_1_00_000000_0 TaskAttempt Transitioned from RUNNING to SUCCEEDED due to event TA_DONE
2016-01-14 16:08:27,543 INFO  impl.TaskImpl (TaskImpl.java:transition(1052)) - Task succeeded with attempt attempt_1452787707319_0001_1_00_000000_0
2016-01-14 16:08:27,542 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_ATTEMPT_FINISHED to history file
2016-01-14 16:08:27,543 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:TASK_FINISHED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, taskId=task_1452787707319_0001_1_00_000000, startTime=1452787707505, finishTime=1452787707543, timeTaken=38, status=SUCCEEDED, successfulAttemptID=attempt_1452787707319_0001_1_00_000000_0, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707537, Process_Duration=3, Process_End_Time=1452787707540, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,543 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787707319_0001_1_00_000000 Task Transitioned from RUNNING to SUCCEEDED due to event T_ATTEMPT_SUCCEEDED
2016-01-14 16:08:27,543 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_ENDED
2016-01-14 16:08:27,542 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,543 INFO  impl.VertexImpl (VertexImpl.java:transition(3536)) - Num completed Tasks for vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] : 1
2016-01-14 16:08:27,545 INFO  impl.VertexImpl (VertexImpl.java:checkVertexForCompletion(1674)) - Vertex succeeded: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,543 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_FINISHED to history file
2016-01-14 16:08:27,546 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_FINISHED to history file
2016-01-14 16:08:27,546 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:VERTEX_FINISHED]: vertexName=D9B991A2FC1844E086101E9AD6927E58, vertexId=vertex_1452787707319_0001_1_00, initRequestedTime=1452787707480, initedTime=1452787707492, startRequestedTime=1452787707493, startedTime=1452787707493, finishTime=1452787707545, timeTaken=52, status=SUCCEEDED, diagnostics=, counters=Counters: 22, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707537, Process_Duration=3, Process_End_Time=1452787707540, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20, vertexStats=firstTaskStartTime=1452787707505, firstTasksToStart=[ task_1452787707319_0001_1_00_000000 ], lastTaskFinishTime=1452787707542, lastTasksToFinish=[ task_1452787707319_0001_1_00_000000 ], minTaskDuration=37, maxTaskDuration=37, avgTaskDuration=37.0, numSuccessfulTasks=1, shortestDurationTasks=[ task_1452787707319_0001_1_00_000000 ], longestDurationTasks=[ task_1452787707319_0001_1_00_000000 ], vertexTaskStats={numFailedTasks=0, numSucceededTasks=1, numKilledTaskAttempts=0, numKilledTasks=0, numFailedTaskAttempts=0, numCompletedTasks=1}
2016-01-14 16:08:27,547 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] transitioned from RUNNING to SUCCEEDED due to event V_TASK_COMPLETED
2016-01-14 16:08:27,547 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from RUNNING to IDLE via event C_TA_SUCCEEDED
2016-01-14 16:08:27,548 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:CONTAINER_STOPPED]: containerId=container_1452787707319_0001_00_000001, stoppedTime=1452787707547, exitStatus=0
2016-01-14 16:08:27,549 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from IDLE to STOP_REQUESTED via event C_STOP_REQUEST
2016-01-14 16:08:27,549 INFO  impl.DAGImpl (DAGImpl.java:transition(1747)) - Vertex vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58] completed., numCompletedVertices=1, numSuccessfulVertices=1, numFailedVertices=0, numKilledVertices=0, numVertices=1
2016-01-14 16:08:27,549 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(831)) - Calling DAG commit/abort for dag: dag_1452787707319_0001_1
2016-01-14 16:08:27,549 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:DAG_COMMIT_STARTED]: dagID=dag_1452787707319_0001_1
2016-01-14 16:08:27,550 INFO  impl.DAGImpl (DAGImpl.java:commitOrAbortOutputs(892)) - Committing output: 371FE588973A4C3C8FEC7BEBCCF40810 for vertex: vertex_1452787707319_0001_1_00 [D9B991A2FC1844E086101E9AD6927E58]
2016-01-14 16:08:27,545 INFO  task.ContainerReporter (ContainerReporter.java:call(55)) - Attempting to fetch new task for container container_1452787707319_0001_00_000001
2016-01-14 16:08:27,548 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event CONTAINER_STOPPED to history file
2016-01-14 16:08:27,550 INFO  app.TaskAttemptListenerImpTezDag (TaskAttemptListenerImpTezDag.java:getTask(213)) - Container with id: container_1452787707319_0001_00_000001 is valid, but no longer registered, and will be killed
2016-01-14 16:08:27,550 INFO  task.ContainerReporter (ContainerReporter.java:call(65)) - Got TaskUpdate for containerId= container_1452787707319_0001_00_000001: 0 ms after starting to poll. TaskInfo: shouldDie: true
2016-01-14 16:08:27,550 INFO  task.TezChild (TezChild.java:run(207)) - ContainerTask returned shouldDie=true for container container_1452787707319_0001_00_000001, Exiting
2016-01-14 16:08:27,550 INFO  task.TezChild (TezChild.java:shutdown(343)) - Shutdown invoked for container container_1452787707319_0001_00_000001
2016-01-14 16:08:27,550 INFO  task.TezChild (TezChild.java:shutdown(345)) - Shutting down container container_1452787707319_0001_00_000001
2016-01-14 16:08:27,551 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(270)) - ContainerExecutionResult for: container_1452787707319_0001_00_000001 = ContainerExecutionResult{exitStatus=SUCCESS, throwable=null, errorMessage='Asked to die by the AM'}
2016-01-14 16:08:27,551 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:onSuccess(274)) - Container: container_1452787707319_0001_00_000001 completed successfully
2016-01-14 16:08:27,558 INFO  recovery.RecoveryService (RecoveryService.java:handle(306)) - DAG completed, dagId=dag_1452787707319_0001_1, queueSize=0
2016-01-14 16:08:27,558 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_FINISHED to history file
2016-01-14 16:08:27,559 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707319_0001_1][Event:DAG_FINISHED]: dagId=dag_1452787707319_0001_1, startTime=1452787707480, finishTime=1452787707557, timeTaken=77, status=SUCCEEDED, diagnostics=, counters=Counters: 24, org.apache.tez.common.counters.DAGCounter, NUM_SUCCEEDED_TASKS=1, TOTAL_LAUNCHED_TASKS=1, RACK_LOCAL_TASKS=1, File System Counters, FILE_BYTES_READ=77, FILE_BYTES_WRITTEN=272, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=0, CPU_MILLISECONDS=0, PHYSICAL_MEMORY_BYTES=0, VIRTUAL_MEMORY_BYTES=0, COMMITTED_HEAP_BYTES=403177472, INPUT_RECORDS_PROCESSED=0, OUTPUT_RECORDS=20, cascading.flow.SliceCounters, Process_Begin_Time=1452787707537, Process_Duration=3, Process_End_Time=1452787707540, Read_Duration=0, Tuples_Read=20, Tuples_Written=20, Write_Duration=0, cascading.flow.StepCounters, Tuples_Read=20, Tuples_Written=20
2016-01-14 16:08:27,559 INFO  impl.DAGImpl (DAGImpl.java:finished(1180)) - DAG: dag_1452787707319_0001_1 finished with state: SUCCEEDED
2016-01-14 16:08:27,559 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787707319_0001_1 transitioned from RUNNING to SUCCEEDED due to event DAG_VERTEX_COMPLETED
2016-01-14 16:08:27,560 INFO  launcher.LocalContainerLauncher (LocalContainerLauncher.java:stop(242)) - Ignoring stop request for containerId: container_1452787707319_0001_00_000001
2016-01-14 16:08:27,560 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707319_0001_00_000001 transitioned from STOP_REQUESTED to COMPLETED via event C_COMPLETED
2016-01-14 16:08:27 Completed Dag: dag_1452787707319_0001_1
2016-01-14 16:08:27,561 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(579)) - DAG completed, dagId=dag_1452787707319_0001_1, dagState=SUCCEEDED
2016-01-14 16:08:27,561 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787707319_0001_1_post
2016-01-14 16:08:27,561 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,561 INFO  app.DAGAppMaster (DAGAppMaster.java:handle(625)) - Waiting for next DAG to be submitted.
2016-01-14 16:08:27,566 INFO  client.TezClient (TezClient.java:stop(495)) - Shutting down Tez Session, sessionName=(1/1) ...d'_RESULTS.0_'field2'_ALL, applicationId=application_1452787707319_0001
2016-01-14 16:08:27,568 INFO  client.DAGClientHandler (DAGClientHandler.java:shutdownAM(117)) - Received message to shutdown AM
2016-01-14 16:08:27,568 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:setShouldUnregisterFlag(580)) - TaskScheduler notified that it should unregister from RM
2016-01-14 16:08:27,568 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdownTezAM(1088)) - No current running DAG, shutting down the AM
2016-01-14 16:08:27,569 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(692)) - DAGAppMasterShutdownHandler invoked
2016-01-14 16:08:27,569 INFO  app.DAGAppMaster (DAGAppMaster.java:shutdown(701)) - Handling DAGAppMaster shutdown
2016-01-14 16:08:27,569 INFO  app.DAGAppMaster (DAGAppMaster.java:run(721)) - Sleeping for 5 seconds before shutting down
2016-01-14 16:08:27,570 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStop(79)) - Stopping HistoryEventHandler
2016-01-14 16:08:27,570 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(189)) - Stopping RecoveryService
2016-01-14 16:08:27,570 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(192)) - Handle the remaining events in queue, queue size=0
2016-01-14 16:08:27,570 INFO  recovery.RecoveryService (RecoveryService.java:run(166)) - EventQueue take interrupted. Returning
2016-01-14 16:08:27,571 INFO  recovery.RecoveryService (RecoveryService.java:serviceStop(214)) - Closing Summary Stream
2016-01-14 16:08:27,571 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStop(118)) - Stopping SimpleHistoryLoggingService, eventQueueBacklog=0
2016-01-14 16:08:27,571 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:run(105)) - EventQueue take interrupted. Returning
2016-01-14 16:08:27,575 INFO  app.DAGAppMaster (DAGAppMaster.java:run(1773)) - Completed deletion of tez scratch data dir, path=file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/776A42D76E5D4DFEABBD44E7D2E9D4D6/CB729F788574412F810C2D374860C86F/.tez/application_1452787707319_0001
2016-01-14 16:08:27,576 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  completed in: 00:00.276
2016-01-14 16:08:27,645 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output//hadoop2-tez/everyeverypipeassemblyplatform//-1_'field'_RESULTS.0_'field2'_ALL
2016-01-14 16:08:27,665 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:08:27,666 INFO  planner.Hadoop2TezPlanner (Hadoop2TezPlanner.java:initialize(149)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-tez/3.0.4/561447ee876073bb61fddc52e2ad157f45c8edd/cascading-hadoop2-tez-3.0.4.jar
2016-01-14 16:08:27,696 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: NoHashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.007
2016-01-14 16:08:27,703 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] executed rule registry: HashJoinHadoop2TezRuleRegistry, completed as: SUCCESS, in: 00:00.014
2016-01-14 16:08:27,703 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:27,703 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: HashJoinHadoop2TezRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:08:27,704 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] rule registry: NoHashJoinHadoop2TezRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:08:27,717 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt
2016-01-14 16:08:27,718 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tap forcing step to tez local mode: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting
2016-01-14 16:08:27,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/classes/test/data/nums.20.txt"]
2016-01-14 16:08:27,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/output/hadoop2-tez/everyeverypipeassemblyplatform/-1_'field'_RESULTS.0_UNKNOWN_-1"]
2016-01-14 16:08:27,727 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  parallel execution of steps is enabled: false
2016-01-14 16:08:27,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  executing total steps: 1
2016-01-14 16:08:27,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every]  allocating management threads: 1
2016-01-14 16:08:27,728 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] starting step: (1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27,729 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [every.every] 'yarn.timeline-service.enabled' is disabled, please enable to capture detailed metrics of completed flows, this may require starting the YARN timeline server daemon
2016-01-14 16:08:27,733 INFO  app.DAGAppMaster (DAGAppMaster.java:run(731)) - Calling stop for all the services
2016-01-14 16:08:27,733 INFO  app.DAGAppMaster (DAGAppMaster.java:run(742)) - Exiting DAGAppMaster..GoodBye!
2016-01-14 16:08:27,740 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] tez session mode enabled: true
2016-01-14 16:08:27,744 INFO  client.TezClient (TezClient.java:<init>(153)) - Tez Client Version: [ component=tez-api, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:27,745 INFO  client.TezClient (TezClient.java:start(333)) - Session mode. Starting session.
2016-01-14 16:08:27,745 INFO  client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(159)) - Ignoring 'tez.lib.uris' since  'tez.ignore.lib.uris' is set to true
2016-01-14 16:08:27,754 INFO  client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(118)) - Tez system stage directory file:/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001 doesn't exist and is created
2016-01-14 16:08:27,778 INFO  client.LocalClient (LocalClient.java:createDAGAppMaster(328)) - DAGAppMaster thread has been created
2016-01-14 16:08:27,778 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(251)) - DAGAppMaster is not created wait for 100ms...
2016-01-14 16:08:27,779 INFO  client.LocalClient (LocalClient.java:run(275)) - Using staging directory: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001
2016-01-14 16:08:27,782 INFO  app.DAGAppMaster (DAGAppMaster.java:<init>(309)) - Created DAGAppMaster for application appattempt_1452787707745_0001_000000, versionInfo=[ component=tez-dag, version=0.6.2, revision=c04283bf91fd96823eec37056d5c8b1a92728265, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150804-1436 ]
2016-01-14 16:08:27,795 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(333)) - Comparing client version with AM version, clientVersion=0.6.2, AMVersion=0.6.2
2016-01-14 16:08:27,796 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceInit(386)) - Adding session token to jobTokenSecretManager for application
2016-01-14 16:08:27,798 INFO  node.AMNodeTracker (AMNodeTracker.java:serviceInit(77)) - blacklistDisablePercent is 33, blacklistingEnabled: false, maxTaskFailuresPerNode: 1
2016-01-14 16:08:27,798 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceInit(50)) - Initializing HistoryEventHandler
2016-01-14 16:08:27,799 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(66)) - Log file location for SimpleHistoryLoggingService not specified, defaulting to containerLogDir=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001/localmode-log-dir
2016-01-14 16:08:27,799 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceInit(88)) - Initializing SimpleHistoryLoggingService, logFileLocation=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001/localmode-log-dir/history.txt.appattempt_1452787707745_0001_000000, maxErrors=10
2016-01-14 16:08:27,800 INFO  recovery.RecoveryService (RecoveryService.java:serviceInit(109)) - Initializing RecoveryService
2016-01-14 16:08:27,800 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1452787707745_0001_000000, appSubmitTime=1452787707781, launchTime=1452787707782
2016-01-14 16:08:27,810 INFO  history.HistoryEventHandler (HistoryEventHandler.java:serviceStart(73)) - Starting HistoryEventHandler
2016-01-14 16:08:27,813 INFO  client.DAGClientServer (DAGClientServer.java:serviceStart(91)) - Instantiated DAGClientRPCServer at ip-10-187-41-40.ec2.internal/10.187.41.40:52399
2016-01-14 16:08:27,814 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:serviceStart(95)) - Starting SimpleHistoryLoggingService
2016-01-14 16:08:27,815 INFO  recovery.RecoveryService (RecoveryService.java:serviceStart(127)) - Starting RecoveryService
2016-01-14 16:08:27,816 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-dagappmaster.properties,hadoop-metrics2.properties
2016-01-14 16:08:27,816 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_LAUNCHED to history file
2016-01-14 16:08:27,818 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1452787707745_0001_000000, startTime=1452787707818
2016-01-14 16:08:27,818 INFO  app.DAGAppMaster (DAGAppMaster.java:serviceStart(1644)) - In Session mode. Waiting for DAG over RPC
2016-01-14 16:08:27,818 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event AM_STARTED to history file
2016-01-14 16:08:27,879 INFO  client.LocalClient (LocalClient.java:startDAGAppMaster(236)) - DAGAppMaster state: IDLE
2016-01-14 16:08:27,879 INFO  client.TezClient (TezClient.java:start(367)) - The url to track the Tez Session: N/A
2016-01-14 16:08:27,879 INFO  client.TezClient (TezClient.java:submitDAGSession(405)) - Submitting dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, applicationId=application_1452787707745_0001, dagName=[73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27,895 INFO  app.DAGAppMaster (DAGAppMaster.java:submitDAGToAppMaster(1126)) - Starting DAG submitted via RPC: [73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27,897 INFO  app.DAGAppMaster (DAGAppMaster.java:generateDAGVizFile(870)) - Generating DAG graphviz file, dagId=dag_1452787707745_0001_1, filePath=/opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001/localmode-log-dir/dag_1452787707745_0001_1.dot
2016-01-14 16:08:27,897 INFO  app.DAGAppMaster (DAGAppMaster.java:writePBTextFile(887)) - Writing DAG plan to: /opt/buildAgent-8.0.3/work/ca57560bc31094a7/apache-2.4.x-tez-0.6.x/build/test/tmp/.staging/73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E/.tez/application_1452787707745_0001/localmode-log-dir/dag_1452787707745_0001_1-tez-dag.pb.txt
2016-01-14 16:08:27,903 INFO  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(164)) - Redirecting log file based on addend: dag_1452787707745_0001_1
2016-01-14 16:08:27,903 WARN  common.TezUtilsInternal (TezUtilsInternal.java:updateLoggers(179)) - Not configured with appender named: CLA. Cannot reconfigure logger output
2016-01-14 16:08:27,903 INFO  app.DAGAppMaster (DAGAppMaster.java:startDAG(2051)) - Running DAG: [73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27 Running Dag: dag_1452787707745_0001_1
2016-01-14 16:08:27,916 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:DAG_SUBMITTED]: dagID=dag_1452787707745_0001_1, submitTime=1452787707895
2016-01-14 16:08:27,916 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_SUBMITTED to history file
2016-01-14 16:08:27,916 INFO  impl.VertexImpl (VertexImpl.java:setAdditionalOutputs(4033)) - setting additional outputs for vertex B2DD8C693F5948C0923D5AC165B7A96A
2016-01-14 16:08:27,917 INFO  impl.DAGImpl (DAGImpl.java:assignDAGScheduler(1381)) - Using DAG Scheduler: org.apache.tez.dag.app.dag.impl.DAGSchedulerNaturalOrderControlled
2016-01-14 16:08:27,917 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_INITIALIZED to history file
2016-01-14 16:08:27,917 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:DAG_INITIALIZED]: dagID=dag_1452787707745_0001_1, initTime=1452787707916
2016-01-14 16:08:27,917 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787707745_0001_1 transitioned from NEW to INITED due to event DAG_INIT
2016-01-14 16:08:27,918 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:DAG_STARTED]: dagID=dag_1452787707745_0001_1, startTime=1452787707918
2016-01-14 16:08:27,919 INFO  impl.DAGImpl (DAGImpl.java:transition(1614)) - Added additional resources : [[]] to classpath
2016-01-14 16:08:27,919 INFO  impl.DAGImpl (DAGImpl.java:handle(973)) - dag_1452787707745_0001_1 transitioned from INITED to RUNNING due to event DAG_START
2016-01-14 16:08:27,919 INFO  client.TezClient (TezClient.java:submitDAGSession(478)) - Submitted dag to TezSession, sessionName=(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, applicationId=application_1452787707745_0001, dagName=[73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1
2016-01-14 16:08:27,918 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event DAG_STARTED to history file
2016-01-14 16:08:27,919 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2068)) - Root Inputs exist for Vertex: B2DD8C693F5948C0923D5AC165B7A96A : {8962D5CE20624558BAAAEA8DB400C008={InputName=8962D5CE20624558BAAAEA8DB400C008}, {Descriptor=ClassName=org.apache.tez.mapreduce.input.MRInput, hasPayload=true}, {ControllerDescriptor=ClassName=org.apache.tez.mapreduce.common.MRInputAMSplitGenerator, hasPayload=false}}
2016-01-14 16:08:27,920 INFO  impl.VertexImpl (VertexImpl.java:setupVertex(2078)) - Starting root input initializer for input: 8962D5CE20624558BAAAEA8DB400C008, with class: [org.apache.tez.mapreduce.common.MRInputAMSplitGenerator]
2016-01-14 16:08:27,920 INFO  impl.VertexImpl (VertexImpl.java:assignVertexManager(2191)) - Setting vertexManager to RootInputVertexManager for vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,920 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2983)) - Num tasks is -1. Expecting VertexManager/InputInitializers/1-1 split to set #tasks for the vertex vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,920 INFO  impl.VertexImpl (VertexImpl.java:handleInitEvent(2987)) - Vertex will initialize from input initializer. vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,920 INFO  impl.VertexImpl (VertexImpl.java:setupInputInitializerManager(3933)) - Vertex will initialize via inputInitializers vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]. Starting root input initializers: 1
2016-01-14 16:08:27,921 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] transitioned from NEW to INITIALIZING due to event V_INIT
2016-01-14 16:08:27,922 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:run(242)) - Starting InputInitializer for Input: 8962D5CE20624558BAAAEA8DB400C008 on vertex vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,924 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(92)) - Emitting serialized splits: true
2016-01-14 16:08:27,924 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(110)) - Input 8962D5CE20624558BAAAEA8DB400C008 asking for 1 tasks. Headroom: 672 Task Resource: 1024 waves: 1.7
2016-01-14 16:08:27,925 INFO  common.MRInputAMSplitGenerator (MRInputAMSplitGenerator.java:initialize(121)) - Grouping input splits
2016-01-14 16:08:27,925 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(294)) - Generating mapred api input splits
2016-01-14 16:08:27,927 INFO  hadoop.MRInputHelpers (MRInputHelpers.java:generateInputSplitsToMem(300)) - NumSplits: 1, SerializedSize: 404
2016-01-14 16:08:27,928 INFO  dag.RootInputInitializerManager (RootInputInitializerManager.java:onSuccess(272)) - Succeeded InputInitializer for Input: 8962D5CE20624558BAAAEA8DB400C008 on vertex vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,928 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] numTasks: -1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,928 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1374)) - Got updated RootInputsSpecs: {8962D5CE20624558BAAAEA8DB400C008=forAllWorkUnits=true, update=[1]}
2016-01-14 16:08:27,929 INFO  impl.VertexImpl (VertexImpl.java:setParallelism(1393)) - Vertex vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] parallelism set to 1
2016-01-14 16:08:27,929 INFO  impl.VertexImpl (VertexImpl.java:canInitVertex(3195)) - Cannot init vertex: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] numTasks: 1 numUnitializedEdges: 0 numInitializedInputs: 0 initWaitsForRootInitializers: true
2016-01-14 16:08:27,929 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:VERTEX_DATA_MOVEMENT_EVENTS_GENERATED]: vertexId=vertex_1452787707745_0001_1_00, eventCount=1
2016-01-14 16:08:27,929 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1915)) - Invoking committer inits for vertex, vertexId=vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,929 INFO  impl.VertexImpl (VertexImpl.java:initializeCommitters(1927)) - Instantiating committer for output=3978968D15C0477D89B38B2BA3F5F296, vertexId=vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A], committerClass=org.apache.tez.mapreduce.committer.MROutputCommitter
2016-01-14 16:08:27,930 INFO  impl.VertexImpl (VertexImpl.java:run(1945)) - Invoking committer init for output=3978968D15C0477D89B38B2BA3F5F296, vertexId=vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,931 INFO  committer.MROutputCommitter (MROutputCommitter.java:getOutputCommitter(145)) - OutputCommitter for outputName=3978968D15C0477D89B38B2BA3F5F296, vertexName=B2DD8C693F5948C0923D5AC165B7A96A, outputCommitterClass=org.apache.hadoop.mapred.FileOutputCommitter
2016-01-14 16:08:27,932 INFO  impl.VertexImpl (VertexImpl.java:run(1949)) - Invoking committer setup for output=3978968D15C0477D89B38B2BA3F5F296, vertexId=vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,933 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:VERTEX_INITIALIZED]: vertexName=B2DD8C693F5948C0923D5AC165B7A96A, vertexId=vertex_1452787707745_0001_1_00, initRequestedTime=1452787707919, initedTime=1452787707933, numTasks=1, processorName=cascading.flow.tez.FlowProcessor, additionalInputsCount=1
2016-01-14 16:08:27,933 INFO  impl.VertexImpl (VertexImpl.java:startIfPossible(3061)) - Triggering start event for vertex: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] with distanceFromRoot: 0
2016-01-14 16:08:27,933 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_INITIALIZED to history file
2016-01-14 16:08:27,934 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] transitioned from INITIALIZING to INITED due to event V_ROOT_INPUT_INITIALIZED
2016-01-14 16:08:27,935 INFO  impl.ImmediateStartVertexManager (ImmediateStartVertexManager.java:scheduleTasks(99)) - Starting 1 in B2DD8C693F5948C0923D5AC165B7A96A
2016-01-14 16:08:27,935 INFO  impl.VertexImpl (VertexImpl.java:scheduleTasks(1250)) - Routing pending task events for vertex: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,936 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event VERTEX_STARTED to history file
2016-01-14 16:08:27,936 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:VERTEX_STARTED]: vertexId=vertex_1452787707745_0001_1_00, startRequestedTime=1452787707935, startedTime=1452787707935
2016-01-14 16:08:27,937 INFO  impl.VertexImpl (VertexImpl.java:handle(1564)) - vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A] transitioned from INITED to RUNNING due to event V_START
2016-01-14 16:08:27,937 INFO  impl.SimpleHistoryLoggingService (SimpleHistoryLoggingService.java:handleEvent(151)) - Writing event TASK_STARTED to history file
2016-01-14 16:08:27,937 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [every.every] submitted tez dag to app master: application_1452787707745_0001, with dag id: dag_1452787707745_0001_1
2016-01-14 16:08:27,938 INFO  history.HistoryEventHandler (HistoryEventHandler.java:handleCriticalEvent(110)) - [HISTORY][DAG:dag_1452787707745_0001_1][Event:TASK_STARTED]: vertexName=B2DD8C693F5948C0923D5AC165B7A96A, taskId=task_1452787707745_0001_1_00_000000, scheduledTime=1452787707937, launchTime=1452787707937
2016-01-14 16:08:27,938 INFO  impl.TaskImpl (TaskImpl.java:handle(862)) - task_1452787707745_0001_1_00_000000 Task Transitioned from NEW to SCHEDULED due to event T_SCHEDULE
2016-01-14 16:08:27,940 INFO  impl.DAGSchedulerNaturalOrderControlled (DAGSchedulerNaturalOrderControlled.java:scheduleTask(111)) - Scheduled vertex: vertex_1452787707745_0001_1_00 [B2DD8C693F5948C0923D5AC165B7A96A]
2016-01-14 16:08:27,940 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:transition(1014)) - remoteTaskSpec:DAGName : [73BE725B724047C0A8A41E60FE579F4F/B9EDA08B137D40C5A5D7DF2F475E418E] every.every/(1/1) ...eld'_RESULTS.0_UNKNOWN_-1, VertexName: B2DD8C693F5948C0923D5AC165B7A96A, VertexParallelism: 1, TaskAttemptID:attempt_1452787707745_0001_1_00_000000_0, processorName=cascading.flow.tez.FlowProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=8962D5CE20624558BAAAEA8DB400C008, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInput }}, ], outputSpecList=[{{ destinationVertexName=3978968D15C0477D89B38B2BA3F5F296, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ]
2016-01-14 16:08:27,941 INFO  impl.TaskAttemptImpl (TaskAttemptImpl.java:handle(692)) - attempt_1452787707745_0001_1_00_000000_0 TaskAttempt Transitioned from NEW to START_WAIT due to event TA_SCHEDULE
2016-01-14 16:08:27,941 INFO  rm.TaskSchedulerEventHandler (TaskSchedulerEventHandler.java:handleEvent(149)) - Processing the event EventType: S_TA_LAUNCH_REQUEST
2016-01-14 16:08:27,942 INFO  node.AMNodeTracker (AMNodeTracker.java:nodeSeen(91)) - Adding new node: 127.0.0.1:0
2016-01-14 16:08:27,942 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(112)) - Adding #1 tokens and #0 secret keys for NM use for launching container
2016-01-14 16:08:27,943 INFO  container.AMContainerHelpers (AMContainerHelpers.java:createCommonContainerLaunchContext(122)) - Putting shuffle token in serviceData
2016-01-14 16:08:27,943 INFO  container.AMContainerImpl (AMContainerImpl.java:transition(521)) - Sending Launch Request for Container with id: container_1452787707745_0001_00_000001
2016-01-14 16:08:27,943 INFO  container.AMContainerImpl (AMContainerImpl.java:handle(442)) - AMContainer container_1452787707745_0001_00_000001 transitioned from ALLOCATED to LAUNCHING via event C_LAUNCH_REQUEST
2016-01-14 16:08:27,945 INFO  task.TezChild (TezChild.java:newTezChild(432)) - PID, containerIdentifier:  null, container_1452787707745_0